Query (id=5f429df048b5534b:41bcce1800000000): Summary: Session ID: cb46f2a86132b9ec:e155236c20defea8 Session Type: BEESWAX Start Time: 2017-06-27 17:25:05.146679000 End Time: 2017-06-27 17:37:46.170155000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (build affc134b371f6d2dd7df802732a1d80b0b35649a) User: systest@HALXG.CLOUDERA.COM Connected User: systest@HALXG.CLOUDERA.COM Delegated User: Network Address: 10.17.187.36:35904 Default Db: tpcds_30000_parquet Sql Statement: select i_item_id ,i_item_desc ,s_state ,count(ss_quantity) as store_sales_quantitycount ,avg(ss_quantity) as store_sales_quantityave ,stddev_samp(ss_quantity) as store_sales_quantitystdev ,stddev_samp(ss_quantity)/avg(ss_quantity) as store_sales_quantitycov ,count(sr_return_quantity) as store_returns_quantitycount ,avg(sr_return_quantity) as store_returns_quantityave ,stddev_samp(sr_return_quantity) as store_returns_quantitystdev ,stddev_samp(sr_return_quantity)/avg(sr_return_quantity) as store_returns_quantitycov ,count(cs_quantity) as catalog_sales_quantitycount ,avg(cs_quantity) as catalog_sales_quantityave ,stddev_samp(cs_quantity) as catalog_sales_quantitystdev ,stddev_samp(cs_quantity)/avg(cs_quantity) as catalog_sales_quantitycov from store_sales ,store_returns ,catalog_sales ,date_dim d1 ,date_dim d2 ,date_dim d3 ,store ,item where d1.d_quarter_name = '2000Q1' and d1.d_date_sk = ss_sold_date_sk and i_item_sk = ss_item_sk and s_store_sk = ss_store_sk and ss_customer_sk = sr_customer_sk and ss_item_sk = sr_item_sk and ss_ticket_number = sr_ticket_number and sr_returned_date_sk = d2.d_date_sk and d2.d_quarter_name in ('2000Q1','2000Q2','2000Q3') and sr_customer_sk = cs_bill_customer_sk and sr_item_sk = cs_item_sk and cs_sold_date_sk = d3.d_date_sk and d3.d_quarter_name in ('2000Q1','2000Q2','2000Q3') group by i_item_id ,i_item_desc ,s_state order by i_item_id ,i_item_desc ,s_state limit 100 Coordinator: va1026.halxg.cloudera.com:22000 Query Options (non default): SYNC_DDL=1,RUNTIME_FILTER_WAIT_TIME_MS=5000,MAX_NUM_RUNTIME_FILTERS=50,RUNTIME_FILTER_MIN_SIZE=8192,RUNTIME_FILTER_MAX_SIZE=2097152 Plan: ---------------- Per-Host Resource Reservation: Memory=952.00MB Per-Host Resource Estimates: Memory=23.77GB F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 28:MERGING-EXCHANGE [UNPARTITIONED] | order by: i_item_id ASC, i_item_desc ASC, s_state ASC | limit: 100 | mem-estimate=0B mem-reservation=0B | tuple-ids=10 row-size=238B cardinality=100 | F10:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,s_state)] hosts=132 instances=132 16:TOP-N [LIMIT=100] | order by: i_item_id ASC, i_item_desc ASC, s_state ASC | mem-estimate=23.26KB mem-reservation=0B | tuple-ids=10 row-size=238B cardinality=100 | 27:AGGREGATE [FINALIZE] | output: count:merge(ss_quantity), avg:merge(ss_quantity), stddev_samp:merge(ss_quantity), count:merge(sr_return_quantity), avg:merge(sr_return_quantity), stddev_samp:merge(sr_return_quantity), count:merge(cs_quantity), avg:merge(cs_quantity), stddev_samp:merge(cs_quantity) | group by: i_item_id, i_item_desc, s_state | mem-estimate=1.12GB mem-reservation=272.00MB | tuple-ids=9 row-size=238B cardinality=86784053 | 26:EXCHANGE [HASH(i_item_id,i_item_desc,s_state)] | mem-estimate=0B mem-reservation=0B | tuple-ids=8 row-size=238B cardinality=86784053 | F07:PLAN FRAGMENT [HASH(cs_bill_customer_sk,cs_item_sk)] hosts=132 instances=132 15:AGGREGATE [STREAMING] | output: count(ss_quantity), avg(ss_quantity), stddev_samp(ss_quantity), count(sr_return_quantity), avg(sr_return_quantity), stddev_samp(sr_return_quantity), count(cs_quantity), avg(cs_quantity), stddev_samp(cs_quantity) | group by: i_item_id, i_item_desc, s_state | mem-estimate=21.18GB mem-reservation=0B | tuple-ids=8 row-size=238B cardinality=86784053 | 14:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF000 <- s_store_sk | mem-estimate=40.25KB mem-reservation=136.00MB | tuple-ids=2,0,3,7,1,4,5,6 row-size=340B cardinality=86784053 | |--25:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=6 row-size=22B cardinality=1704 | | | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | 06:SCAN HDFS [tpcds_30000_parquet.store, RANDOM] | partitions=1/1 files=1 size=149.35KB | stats-rows=1704 extrapolated-rows=disabled | table stats: rows=1704 size=unavailable | column stats: all | mem-estimate=32.00MB mem-reservation=0B | tuple-ids=6 row-size=22B cardinality=1704 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: cs_sold_date_sk = d3.d_date_sk | runtime filters: RF001 <- d3.d_date_sk | mem-estimate=7.62KB mem-reservation=136.00MB | tuple-ids=2,0,3,7,1,4,5 row-size=318B cardinality=86784053 | |--24:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=5 row-size=26B cardinality=273 | | | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | 05:SCAN HDFS [tpcds_30000_parquet.date_dim d3, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: d3.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | stats-rows=73049 extrapolated-rows=disabled | table stats: rows=73049 size=unavailable | column stats: all | parquet statistics predicates: d3.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | parquet dictionary predicates: d3.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | mem-estimate=32.00MB mem-reservation=0B | tuple-ids=5 row-size=26B cardinality=273 | 12:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: cs_bill_customer_sk = sr_customer_sk, cs_item_sk = sr_item_sk | runtime filters: RF002 <- sr_customer_sk, RF003 <- sr_item_sk | mem-estimate=1.22GB mem-reservation=136.00MB | tuple-ids=2,0,3,7,1,4 row-size=292B cardinality=583964483 | |--23:EXCHANGE [HASH(sr_customer_sk,sr_item_sk)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=0,3,7,1,4 row-size=268B cardinality=583964483 | | | F05:PLAN FRAGMENT [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] hosts=132 instances=132 | 11:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: sr_returned_date_sk = d2.d_date_sk | | runtime filters: RF004 <- d2.d_date_sk | | mem-estimate=7.62KB mem-reservation=136.00MB | | tuple-ids=0,3,7,1,4 row-size=268B cardinality=583964483 | | | |--21:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=4 row-size=26B cardinality=273 | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | 04:SCAN HDFS [tpcds_30000_parquet.date_dim d2, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d2.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | | stats-rows=73049 extrapolated-rows=disabled | | table stats: rows=73049 size=unavailable | | column stats: all | | parquet statistics predicates: d2.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | | parquet dictionary predicates: d2.d_quarter_name IN ('2000Q1', '2000Q2', '2000Q3') | | mem-estimate=32.00MB mem-reservation=0B | | tuple-ids=4 row-size=26B cardinality=273 | | | 10:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: ss_customer_sk = sr_customer_sk, ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number | | runtime filters: RF005 <- sr_customer_sk, RF006 <- sr_item_sk, RF007 <- sr_ticket_number | | mem-estimate=1.88GB mem-reservation=136.00MB | | tuple-ids=0,3,7,1 row-size=242B cardinality=4286684332 | | | |--20:EXCHANGE [HASH(sr_customer_sk,sr_item_sk,sr_ticket_number)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=1 row-size=28B cardinality=8634894693 | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=132 instances=132 | | 01:SCAN HDFS [tpcds_30000_parquet.store_returns, RANDOM] | | partitions=2004/2004 files=2824 size=436.71GB | | runtime filters: RF004 -> sr_returned_date_sk | | stats-rows=8634894693 extrapolated-rows=disabled | | table stats: rows=8634894693 size=unavailable | | column stats: all | | mem-estimate=352.00MB mem-reservation=0B | | tuple-ids=1 row-size=28B cardinality=8634894693 | | | 19:EXCHANGE [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=0,3,7 row-size=214B cardinality=4286684332 | | | F01:PLAN FRAGMENT [RANDOM] hosts=132 instances=132 | 09:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_item_sk = i_item_sk | | runtime filters: RF008 <- i_item_sk | | mem-estimate=75.71MB mem-reservation=136.00MB | | tuple-ids=0,3,7 row-size=214B cardinality=4286684332 | | | |--18:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=7 row-size=156B cardinality=462000 | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=13 instances=13 | | 07:SCAN HDFS [tpcds_30000_parquet.item, RANDOM] | | partitions=1/1 files=13 size=44.38MB | | runtime filters: RF006 -> tpcds_30000_parquet.item.i_item_sk | | stats-rows=462000 extrapolated-rows=disabled | | table stats: rows=462000 size=unavailable | | column stats: all | | mem-estimate=48.00MB mem-reservation=0B | | tuple-ids=7 row-size=156B cardinality=462000 | | | 08:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_sold_date_sk = d1.d_date_sk | | runtime filters: RF009 <- d1.d_date_sk | | mem-estimate=2.54KB mem-reservation=136.00MB | | tuple-ids=0,3 row-size=58B cardinality=4310585844 | | | |--17:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=3 row-size=26B cardinality=91 | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | 03:SCAN HDFS [tpcds_30000_parquet.date_dim d1, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d1.d_quarter_name = '2000Q1' | | stats-rows=73049 extrapolated-rows=disabled | | table stats: rows=73049 size=unavailable | | column stats: all | | parquet statistics predicates: d1.d_quarter_name = '2000Q1' | | parquet dictionary predicates: d1.d_quarter_name = '2000Q1' | | mem-estimate=32.00MB mem-reservation=0B | | tuple-ids=3 row-size=26B cardinality=91 | | | 00:SCAN HDFS [tpcds_30000_parquet.store_sales, RANDOM] | partitions=1824/1824 files=16578 size=3.82TB | runtime filters: RF000 -> ss_store_sk, RF005 -> ss_customer_sk, RF006 -> ss_item_sk, RF007 -> ss_ticket_number, RF008 -> ss_item_sk, RF009 -> ss_sold_date_sk | stats-rows=86401193161 extrapolated-rows=disabled | table stats: rows=86401193161 size=unavailable | column stats: all | mem-estimate=440.00MB mem-reservation=0B | tuple-ids=0 row-size=32B cardinality=86401193161 | 22:EXCHANGE [HASH(cs_bill_customer_sk,cs_item_sk)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=24B cardinality=43202260214 | F00:PLAN FRAGMENT [RANDOM] hosts=132 instances=132 02:SCAN HDFS [tpcds_30000_parquet.catalog_sales, RANDOM] partitions=1837/1837 files=12486 size=2.84TB runtime filters: RF001 -> cs_sold_date_sk, RF002 -> cs_bill_customer_sk, RF003 -> cs_item_sk stats-rows=43202260214 extrapolated-rows=disabled table stats: rows=43202260214 size=unavailable column stats: all mem-estimate=264.00MB mem-reservation=0B tuple-ids=2 row-size=24B cardinality=43202260214 ---------------- Estimated Per-Host Mem: 25523635010 Per-Host Memory Reservation: 998244352 Request Pool: root.default Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 28:MERGING-EXCHANGE 1 1.426ms 1.426ms 100 100 0 0 UNPARTITIONED 16:TOP-N 129 406.353us 1.230ms 6.18K 100 40.00 KB 23.26 KB 27:AGGREGATE 129 4.161ms 8.703ms 6.18K 86.78M 10.58 MB 1.12 GB FINALIZE 26:EXCHANGE 129 359.235us 536.988us 6.18K 86.78M 0 0 HASH(i_item_id,i_item_desc,... 15:AGGREGATE 129 637.367ms 715.358ms 6.18K 86.78M 17.71 MB 21.18 GB STREAMING 14:HASH JOIN 129 2.211ms 3.089ms 42.89K 86.78M 17.17 MB 40.25 KB INNER JOIN, BROADCAST |--25:EXCHANGE 129 70.328us 153.725us 1.70K 1.70K 0 0 BROADCAST | 06:SCAN HDFS 1 5.170ms 5.170ms 1.70K 1.70K 128.00 KB 32.00 MB tpcds_30000_parquet.store 13:HASH JOIN 129 10.162ms 74.649ms 43.65K 86.78M 9.13 MB 7.62 KB INNER JOIN, BROADCAST |--24:EXCHANGE 129 19.249us 46.765us 274 273 0 0 BROADCAST | 05:SCAN HDFS 1 9.210ms 9.210ms 274 273 810.13 KB 32.00 MB tpcds_30000_parquet.date_di... 12:HASH JOIN 129 6s593ms 6s944ms 43.65K 583.96M 656.13 MB 1.22 GB INNER JOIN, PARTITIONED |--23:EXCHANGE 129 204.605ms 268.399ms 184.84M 583.96M 0 0 HASH(sr_customer_sk,sr_item... | 11:HASH JOIN 129 295.773ms 322.533ms 184.84M 583.96M 4.49 MB 7.62 KB INNER JOIN, BROADCAST | |--21:EXCHANGE 129 19.498us 31.583us 274 273 0 0 BROADCAST | | 04:SCAN HDFS 1 8.895ms 8.895ms 274 273 810.13 KB 32.00 MB tpcds_30000_parquet.date_di... | 10:HASH JOIN 129 8s574ms 9s190ms 184.84M 4.29B 521.34 MB 1.88 GB INNER JOIN, PARTITIONED | |--20:EXCHANGE 129 384.265ms 400.827ms 1.23B 8.63B 0 0 HASH(sr_customer_sk,sr_item... | | 01:SCAN HDFS 129 1s197ms 2s287ms 1.23B 8.63B 310.78 MB 352.00 MB tpcds_30000_parquet.store_r... | 19:EXCHANGE 129 1s395ms 1s483ms 2.52B 4.29B 0 0 HASH(ss_customer_sk,ss_item... | 09:HASH JOIN 129 3s274ms 6s278ms 2.52B 4.29B 154.07 MB 75.71 MB INNER JOIN, BROADCAST | |--18:EXCHANGE 129 17.923ms 25.462ms 462.00K 462.00K 0 0 BROADCAST | | 07:SCAN HDFS 13 4s990ms 5s099ms 462.00K 462.00K 8.41 MB 48.00 MB tpcds_30000_parquet.item | 08:HASH JOIN 129 703.379ms 1s362ms 2.52B 4.31B 1.99 MB 2.54 KB INNER JOIN, BROADCAST | |--17:EXCHANGE 129 13.928us 44.245us 91 91 0 0 BROADCAST | | 03:SCAN HDFS 1 9.196ms 9.196ms 91 91 810.13 KB 32.00 MB tpcds_30000_parquet.date_di... | 00:SCAN HDFS 129 3s842ms 4s783ms 2.52B 86.40B 286.34 MB 440.00 MB tpcds_30000_parquet.store_s... 22:EXCHANGE 129 1s415ms 1s468ms 4.78B 43.20B 0 0 HASH(cs_bill_customer_sk,cs... 02:SCAN HDFS 129 5s160ms 5s348ms 4.78B 43.20B 136.39 MB 264.00 MB tpcds_30000_parquet.catalog... Errors: Planner Timeline: 107.000ms - Analysis finished: 10.986ms (10.986ms) - Equivalence classes computed: 11.335ms (349.651us) - Single node plan created: 93.482ms (82.146ms) - Runtime filters computed: 93.889ms (406.636us) - Distributed plan created: 95.622ms (1.732ms) - Lineage info computed: 95.856ms (234.255us) - Planning finished: 107.000ms (11.143ms) Query Timeline: 12m41s - Query submitted: 29.704us (29.704us) - Planning finished: 247.136ms (247.107ms) - Submit for admission: 358.436ms (111.299ms) - Completed admission: 359.440ms (1.003ms) - Ready to start on 130 backends: 429.059ms (69.619ms) - First dynamic filter received: 2s816ms (2s387ms) - All 130 execution backends (792 fragment instances) started: 2s817ms (666.417us) - Rows available: 12m40s (12m37s) - First row fetched: 12m40s (31.320ms) - Unregister query: 12m41s (788.283ms) - ComputeScanRangeAssignmentTimer: 55.045ms ImpalaServer: - ClientFetchWaitTimer: 679.481ms - RowMaterializationTimer: 140.097ms Execution Profile 5f429df048b5534b:41bcce1800000000:(Total: 12m39s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 10 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------- 9 8 0 LOCAL true 0 (129) N/A N/A true 8 9 0 LOCAL false 0 (129) N/A N/A true 7 10 0 REMOTE false 129 (129) N/A N/A true 6 10 0, 7 REMOTE, REMOTE false, false 129 (129) N/A N/A true 5 10 0 REMOTE false 129 (129) N/A N/A true 4 11 1 REMOTE true 1 (3) N/A N/A true 3 12 2 REMOTE false 129 (129) N/A N/A true 2 12 2 REMOTE false 129 (129) N/A N/A true 1 13 2 REMOTE true 1 (3) N/A N/A true 0 14 0 REMOTE false 1 (3) N/A N/A true Backend startup latencies: Count: 130, min / max: 47ms / 569ms, 25th %-ile: 98ms, 50th %-ile: 132ms, 75th %-ile: 215ms, 90th %-ile: 307ms, 95th %-ile: 376ms, 99.9th %-ile: 569ms Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------- 9 8 0 LOCAL true 0 (129) N/A N/A true 8 9 0 LOCAL false 0 (129) N/A N/A true 7 10 0 REMOTE false 0 (129) 1m30s 1m30s false 6 10 0, 7 REMOTE, REMOTE false, false 0 (129) 1m30s 1m30s false 5 10 0 REMOTE false 0 (129) 1m30s 1m30s false 4 11 1 REMOTE true 0 (3) 2s816ms 2s816ms false 3 12 2 REMOTE false 0 (129) 10m36s 10m40s false 2 12 2 REMOTE false 0 (129) 10m36s 10m40s false 1 13 2 REMOTE true 0 (3) 2s816ms 2s816ms false 0 14 0 REMOTE false 0 (3) 2s977ms 2s977ms false Per Node Peak Memory Usage: 10.17.187.36:22000(4.01 MB) 10.17.187.39:22000(1.31 GB) 10.17.187.40:22000(1.23 GB) 10.17.187.41:22000(1.30 GB) 10.17.187.42:22000(1.21 GB) 10.17.187.43:22000(1.31 GB) 10.17.187.44:22000(1.24 GB) 10.17.187.45:22000(1.31 GB) 10.17.187.46:22000(1.36 GB) 10.17.187.47:22000(1.23 GB) 10.17.187.48:22000(1.30 GB) 10.17.187.49:22000(1.31 GB) 10.17.187.51:22000(1.23 GB) 10.17.187.52:22000(1.23 GB) 10.17.187.53:22000(1.23 GB) 10.17.187.54:22000(1.23 GB) 10.17.187.55:22000(1.31 GB) 10.17.187.56:22000(1.25 GB) 10.17.221.11:22000(1.39 GB) 10.17.221.12:22000(1.39 GB) 10.17.221.13:22000(1.24 GB) 10.17.221.14:22000(1.25 GB) 10.17.221.15:22000(1.42 GB) 10.17.221.17:22000(1.43 GB) 10.17.221.18:22000(1.48 GB) 10.17.221.19:22000(1.22 GB) 10.17.221.20:22000(1.39 GB) 10.17.221.21:22000(1.40 GB) 10.17.221.23:22000(1.32 GB) 10.17.221.24:22000(1.29 GB) 10.17.221.25:22000(1.32 GB) 10.17.221.26:22000(1.21 GB) 10.17.221.27:22000(1.20 GB) 10.17.221.28:22000(1.38 GB) 10.17.221.29:22000(1.22 GB) 10.17.221.30:22000(1.32 GB) 10.17.221.32:22000(1.38 GB) 10.17.221.33:22000(1.40 GB) 10.17.221.34:22000(1.40 GB) 10.17.221.35:22000(1.34 GB) 10.17.221.36:22000(1.36 GB) 10.17.221.37:22000(1.23 GB) 10.17.221.38:22000(1.31 GB) 10.17.221.39:22000(1.37 GB) 10.17.221.40:22000(1.23 GB) 10.17.221.41:22000(1.43 GB) 10.17.221.42:22000(1.43 GB) 10.17.221.43:22000(1.29 GB) 10.17.221.44:22000(1.39 GB) 10.17.221.45:22000(1.22 GB) 10.17.221.46:22000(1.38 GB) 10.17.221.47:22000(1.42 GB) 10.17.221.48:22000(1.32 GB) 10.17.221.49:22000(1.39 GB) 10.17.221.50:22000(1.35 GB) 10.17.221.51:22000(1.34 GB) 10.17.221.52:22000(1.40 GB) 10.17.232.11:22000(1.40 GB) 10.17.232.12:22000(1.39 GB) 10.17.232.13:22000(1.41 GB) 10.17.232.14:22000(1.35 GB) 10.17.232.15:22000(1.42 GB) 10.17.232.17:22000(1.41 GB) 10.17.232.18:22000(1.36 GB) 10.17.232.19:22000(1.36 GB) 10.17.232.20:22000(1.37 GB) 10.17.232.21:22000(1.39 GB) 10.17.232.22:22000(1.42 GB) 10.17.232.23:22000(1.38 GB) 10.17.232.24:22000(1.32 GB) 10.17.232.25:22000(1.41 GB) 10.17.232.26:22000(1.35 GB) 10.17.232.27:22000(1.34 GB) 10.17.232.28:22000(1.43 GB) 10.17.232.29:22000(1.40 GB) 10.17.232.30:22000(1.40 GB) 10.17.232.31:22000(1.42 GB) 10.17.232.32:22000(1.42 GB) 10.17.232.33:22000(1.43 GB) 10.17.232.34:22000(1.42 GB) 10.17.232.35:22000(1.30 GB) 10.17.232.36:22000(1.26 GB) 10.17.232.37:22000(1.34 GB) 10.17.232.39:22000(1.33 GB) 10.17.232.40:22000(1.36 GB) 10.17.232.41:22000(1.24 GB) 10.17.232.42:22000(1.22 GB) 10.17.232.43:22000(1.43 GB) 10.17.232.44:22000(1.36 GB) 10.17.232.45:22000(1.33 GB) 10.17.232.46:22000(1.27 GB) 10.17.232.48:22000(1.35 GB) 10.17.232.49:22000(1.41 GB) 10.17.232.50:22000(1.33 GB) 10.17.232.51:22000(1.36 GB) 10.17.232.52:22000(1.41 GB) 10.17.234.36:22000(1.21 GB) 10.17.234.37:22000(1.30 GB) 10.17.234.38:22000(1.22 GB) 10.17.234.39:22000(1.30 GB) 10.17.234.40:22000(1.30 GB) 10.17.234.41:22000(1.23 GB) 10.17.234.42:22000(1.31 GB) 10.17.234.43:22000(1.31 GB) 10.17.234.44:22000(1.21 GB) 10.17.234.45:22000(1.19 GB) 10.17.234.46:22000(1.30 GB) 10.17.234.47:22000(1.31 GB) 10.17.234.48:22000(1.28 GB) 10.17.234.49:22000(1.28 GB) 10.17.234.50:22000(1.28 GB) 10.17.234.51:22000(1.28 GB) 10.17.234.52:22000(1.22 GB) 10.17.246.35:22000(1.32 GB) 10.17.246.36:22000(1.28 GB) 10.17.246.37:22000(1.30 GB) 10.17.246.38:22000(1.31 GB) 10.17.246.39:22000(1.27 GB) 10.17.246.40:22000(1.28 GB) 10.17.246.41:22000(1.27 GB) 10.17.246.42:22000(1.22 GB) 10.17.246.44:22000(1.31 GB) 10.17.246.45:22000(1.21 GB) 10.17.246.46:22000(1.20 GB) 10.17.246.47:22000(1.27 GB) 10.17.246.48:22000(1.20 GB) 10.17.246.49:22000(1.23 GB) 10.17.246.50:22000(1.25 GB) 10.17.246.51:22000(1.23 GB) 10.17.246.52:22000(1.23 GB) - FiltersReceived: 264 (264) - FinalizationTimer: 0.000ns Averaged Fragment F11:(Total: 12m39s, non-child: 65.927ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:12m39s max:12m39s mean: 12m39s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.48 MB (1547337) - PerHostPeakMemUsage: 4.01 MB (4203155) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 44.993ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 65.227ms - ExecTreeExecTime: 1.035ms - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 31.342ms - ExecTreePrepareTime: 269.761us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 73.881ms, non-child: 73.881ms, % non-child: 100.00%) - CodegenTime: 1.205ms - CompileTime: 7.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 42 (42) - NumInstructions: 912 (912) - OptimizationTime: 35.470ms - PeakMemoryUsage: 456.00 KB (466944) - PrepareTime: 30.035ms EXCHANGE_NODE (id=28):(Total: 12m39s, non-child: 12m39s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - MergeGetNext: 922.698us - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 100 (100) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 836.05 KB (856117) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 9.491ms - NumBatchesAccepted: 129 (129) - NumBatchesRejected: 0 (0) Coordinator Fragment F11: Instance 5f429df048b5534b:41bcce1800000000 (host=foo.187.36:22000):(Total: 12m39s, non-child: 65.927ms, % non-child: 0.01%) MemoryUsage(16s000ms): 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB, 8.64 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.48 MB (1547337) - PerHostPeakMemUsage: 4.01 MB (4203155) - RowsProduced: 100 (100) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 44.993ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 65.227ms - ExecTreeExecTime: 1.035ms - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 31.342ms - ExecTreePrepareTime: 269.761us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 73.881ms, non-child: 73.881ms, % non-child: 100.00%) - CodegenTime: 1.205ms - CompileTime: 7.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 42 (42) - NumInstructions: 912 (912) - OptimizationTime: 35.470ms - PeakMemoryUsage: 456.00 KB (466944) - PrepareTime: 30.035ms EXCHANGE_NODE (id=28):(Total: 12m39s, non-child: 1.426ms, % non-child: 0.00%) ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - MergeGetNext: 922.698us - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 100 (100) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 836.05 KB (856117) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 9.491ms - NumBatchesAccepted: 129 (129) - NumBatchesRejected: 0 (0) Averaged Fragment F10:(Total: 12m38s, non-child: 13.390ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:12m37s max:12m39s mean: 12m38s stddev:655.350ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 129 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11059020) - PerHostPeakMemUsage: 1.32 GB (1415052875) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 397.943us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.844ms - TotalThreadsUserTime: 179.081ms - TotalThreadsVoluntaryContextSwitches: 95 (95) Fragment Instance Lifecycle Timings: - ExecTime: 810.233us - ExecTreeExecTime: 6.933us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 40.397ms - ExecTreePrepareTime: 440.566us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 297 (297) - BlocksRecycled: 60 (60) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1113915284) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 133.893us, non-child: 133.893us, % non-child: 100.00%) - BytesSent: 6.48 KB (6636) - OverallThroughput: 48.32 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 116.847us - UncompressedRowBatchSize: 6.48 KB (6636) CodeGen:(Total: 205.860ms, non-child: 205.860ms, % non-child: 100.00%) - CodegenTime: 22.690ms - CompileTime: 36.147ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.117ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.025ms SORT_NODE (id=16):(Total: 12m38s, non-child: 406.354us, % non-child: 0.00%) - InsertBatchTime: 93.465us - PeakMemoryUsage: 32.68 KB (33466) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.161ms, % non-child: 0.00%) - BuildTime: 304.539us - GetNewBlockTime: 305.474us - GetResultsTime: 147.850us - HTResizeTime: 5.344us - HashBuckets: 15.55K (15550) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11042047) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.088us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 12m38s, % non-child: 100.00%) - ConvertRowBatchTime: 66.830us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.39 KB (10642) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.112ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Fragment F10: Instance 5f429df048b5534b:41bcce1800000314 (host=foo.187.47:22000):(Total: 12m39s, non-child: 14.562ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.23 GB (1315490468) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 402.150us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 167.975ms - TotalThreadsVoluntaryContextSwitches: 114 (114) Fragment Instance Lifecycle Timings: - ExecTime: 770.939us - ExecTreeExecTime: 7.099us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 43.023ms - ExecTreePrepareTime: 375.271us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 68 (68) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 145.462us, non-child: 145.462us, % non-child: 100.00%) - BytesSent: 7.26 KB (7435) - OverallThroughput: 48.75 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 125.466us - UncompressedRowBatchSize: 7.26 KB (7435) CodeGen:(Total: 195.186ms, non-child: 195.186ms, % non-child: 100.00%) - CodegenTime: 24.877ms - CompileTime: 34.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 129.904ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.242ms SORT_NODE (id=16):(Total: 12m39s, non-child: 423.516us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 118.967us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.367ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 259.076us - GetNewBlockTime: 292.615us - GetResultsTime: 141.153us - HTResizeTime: 5.300us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 818.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 344.470us, % non-child: 0.00%) - ConvertRowBatchTime: 64.574us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 11.56 KB (11839) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.021ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000312 (host=foo.187.49:22000):(Total: 12m39s, non-child: 13.553ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.31 GB (1403865257) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 318.632us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 167.975ms - TotalThreadsVoluntaryContextSwitches: 98 (98) Fragment Instance Lifecycle Timings: - ExecTime: 692.790us - ExecTreeExecTime: 6.732us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 40.623ms - ExecTreePrepareTime: 733.447us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 291 (291) - BlocksRecycled: 70 (70) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141457920) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 124.918us, non-child: 124.918us, % non-child: 100.00%) - BytesSent: 5.90 KB (6046) - OverallThroughput: 46.16 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 110.375us - UncompressedRowBatchSize: 5.90 KB (6046) CodeGen:(Total: 193.265ms, non-child: 193.265ms, % non-child: 100.00%) - CodegenTime: 23.038ms - CompileTime: 33.312ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 130.396ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.057ms SORT_NODE (id=16):(Total: 12m39s, non-child: 329.648us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 44.290us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.325ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 313.609us - GetNewBlockTime: 263.494us - GetResultsTime: 159.857us - HTResizeTime: 6.733us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 822.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 304.043us, % non-child: 0.00%) - ConvertRowBatchTime: 49.806us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 9.54 KB (9768) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 1.971ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000311 (host=foo.187.41:22000):(Total: 12m39s, non-child: 11.571ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11075277) - PerHostPeakMemUsage: 1.30 GB (1397928494) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 427.696us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 91 (91) Fragment Instance Lifecycle Timings: - ExecTime: 780.998us - ExecTreeExecTime: 6.181us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 31.727ms - ExecTreePrepareTime: 239.339us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 292 (292) - BlocksRecycled: 65 (65) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 138.008us, non-child: 138.008us, % non-child: 100.00%) - BytesSent: 7.70 KB (7886) - OverallThroughput: 54.49 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 56 (56) - SerializeBatchTime: 128.525us - UncompressedRowBatchSize: 7.70 KB (7886) CodeGen:(Total: 204.011ms, non-child: 204.011ms, % non-child: 100.00%) - CodegenTime: 19.880ms - CompileTime: 41.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.230ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 21.096ms SORT_NODE (id=16):(Total: 12m39s, non-child: 357.018us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 110.352us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 56 (56) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 2.837ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 219.004us - GetNewBlockTime: 167.918us - GetResultsTime: 145.805us - HTResizeTime: 2.977us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11058304) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 718.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 148.857us, % non-child: 0.00%) - ConvertRowBatchTime: 24.623us - PeakMemoryUsage: 0 - RowsReturned: 56 (56) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 12.44 KB (12738) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 3.239ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e0 (host=foo.187.46:22000):(Total: 12m39s, non-child: 12.445ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.36 GB (1457509964) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 266.895us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 70 (70) Fragment Instance Lifecycle Timings: - ExecTime: 773.594us - ExecTreeExecTime: 7.053us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 50.541ms - ExecTreePrepareTime: 396.543us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 295 (295) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 117.582us, non-child: 117.582us, % non-child: 100.00%) - BytesSent: 6.10 KB (6248) - OverallThroughput: 50.68 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 107.451us - UncompressedRowBatchSize: 6.10 KB (6248) CodeGen:(Total: 210.861ms, non-child: 210.861ms, % non-child: 100.00%) - CodegenTime: 21.527ms - CompileTime: 32.095ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.214ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 38.850ms SORT_NODE (id=16):(Total: 12m39s, non-child: 564.336us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 194.789us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.489ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 308.412us - GetNewBlockTime: 175.094us - GetResultsTime: 156.619us - HTResizeTime: 4.989us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 746.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 446.585us, % non-child: 0.00%) - ConvertRowBatchTime: 90.040us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 9.67 KB (9902) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.553ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002da (host=foo.187.44:22000):(Total: 12m39s, non-child: 12.509ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11091661) - PerHostPeakMemUsage: 1.24 GB (1327683132) - RowsProduced: 58 (58) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 276.714us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 178.973ms - TotalThreadsVoluntaryContextSwitches: 106 (106) Fragment Instance Lifecycle Timings: - ExecTime: 648.705us - ExecTreeExecTime: 5.784us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 39.119ms - ExecTreePrepareTime: 458.998us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 144.139us, non-child: 144.139us, % non-child: 100.00%) - BytesSent: 7.56 KB (7739) - OverallThroughput: 51.20 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 58 (58) - SerializeBatchTime: 122.485us - UncompressedRowBatchSize: 7.56 KB (7739) CodeGen:(Total: 201.191ms, non-child: 201.191ms, % non-child: 100.00%) - CodegenTime: 20.777ms - CompileTime: 33.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.963ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.413ms SORT_NODE (id=16):(Total: 12m39s, non-child: 346.335us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 65.941us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 58 (58) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.832ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 420.336us - GetNewBlockTime: 190.691us - GetResultsTime: 156.927us - HTResizeTime: 6.145us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11074688) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 58 (58) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 779.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 477.218us, % non-child: 0.00%) - ConvertRowBatchTime: 95.723us - PeakMemoryUsage: 0 - RowsReturned: 58 (58) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 12.32 KB (12619) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 4.444ms - NumBatchesAccepted: 47 (47) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000299 (host=foo.187.43:22000):(Total: 12m39s, non-child: 12.484ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.31 GB (1402734431) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 440.644us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 169 (169) Fragment Instance Lifecycle Timings: - ExecTime: 814.078us - ExecTreeExecTime: 7.697us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 44.549ms - ExecTreePrepareTime: 976.227us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 156.220us, non-child: 156.220us, % non-child: 100.00%) - BytesSent: 7.45 KB (7631) - OverallThroughput: 46.58 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 138.936us - UncompressedRowBatchSize: 7.45 KB (7631) CodeGen:(Total: 194.464ms, non-child: 194.464ms, % non-child: 100.00%) - CodegenTime: 20.569ms - CompileTime: 34.082ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 126.661ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.254ms SORT_NODE (id=16):(Total: 12m39s, non-child: 527.048us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 150.450us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 5.115ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 263.099us - GetNewBlockTime: 429.523us - GetResultsTime: 159.745us - HTResizeTime: 5.923us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 815.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 473.189us, % non-child: 0.00%) - ConvertRowBatchTime: 113.256us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 11.83 KB (12109) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.142ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002be (host=foo.187.45:22000):(Total: 12m39s, non-child: 13.116ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.31 GB (1401449535) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 353.604us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 186.972ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Fragment Instance Lifecycle Timings: - ExecTime: 758.289us - ExecTreeExecTime: 6.706us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 37.027ms - ExecTreePrepareTime: 466.233us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 155.155us, non-child: 155.155us, % non-child: 100.00%) - BytesSent: 6.01 KB (6155) - OverallThroughput: 37.83 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 137.598us - UncompressedRowBatchSize: 6.01 KB (6155) CodeGen:(Total: 208.212ms, non-child: 208.212ms, % non-child: 100.00%) - CodegenTime: 21.841ms - CompileTime: 31.782ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 150.976ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.958ms SORT_NODE (id=16):(Total: 12m39s, non-child: 394.773us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 43.775us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.769ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 256.767us - GetNewBlockTime: 175.511us - GetResultsTime: 138.092us - HTResizeTime: 5.672us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 885.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 428.300us, % non-child: 0.00%) - ConvertRowBatchTime: 80.696us - PeakMemoryUsage: 0 - RowsReturned: 44 (44) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 9.67 KB (9903) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 3.833ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000303 (host=foo.187.48:22000):(Total: 12m39s, non-child: 11.697ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.30 GB (1400009380) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 386.205us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 783.991us - ExecTreeExecTime: 5.921us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 36.358ms - ExecTreePrepareTime: 333.626us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 152.164us, non-child: 152.164us, % non-child: 100.00%) - BytesSent: 6.81 KB (6972) - OverallThroughput: 43.70 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 133.781us - UncompressedRowBatchSize: 6.81 KB (6972) CodeGen:(Total: 207.431ms, non-child: 207.431ms, % non-child: 100.00%) - CodegenTime: 19.964ms - CompileTime: 48.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.173ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.500ms SORT_NODE (id=16):(Total: 12m39s, non-child: 277.710us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 58.186us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.074ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 318.598us - GetNewBlockTime: 206.221us - GetResultsTime: 121.918us - HTResizeTime: 4.756us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 855.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 159.316us, % non-child: 0.00%) - ConvertRowBatchTime: 25.118us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 10.81 KB (11074) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.199ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d0 (host=foo.187.40:22000):(Total: 12m39s, non-child: 11.847ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11042509) - PerHostPeakMemUsage: 1.23 GB (1316349865) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 352.913us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 8.999ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 157 (157) Fragment Instance Lifecycle Timings: - ExecTime: 675.549us - ExecTreeExecTime: 6.358us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 44.896ms - ExecTreePrepareTime: 376.908us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.982us, non-child: 119.982us, % non-child: 100.00%) - BytesSent: 5.26 KB (5384) - OverallThroughput: 42.79 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 40 (40) - SerializeBatchTime: 94.739us - UncompressedRowBatchSize: 5.26 KB (5384) CodeGen:(Total: 210.388ms, non-child: 210.388ms, % non-child: 100.00%) - CodegenTime: 19.969ms - CompileTime: 44.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 131.497ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.962ms SORT_NODE (id=16):(Total: 12m39s, non-child: 423.351us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 140.229us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 40 (40) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 7.105ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 259.536us - GetNewBlockTime: 781.636us - GetResultsTime: 140.973us - HTResizeTime: 6.332us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11025536) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.367us EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 306.741us, % non-child: 0.00%) - ConvertRowBatchTime: 54.602us - PeakMemoryUsage: 0 - RowsReturned: 40 (40) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 8.47 KB (8676) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.095ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e7 (host=foo.187.42:22000):(Total: 12m39s, non-child: 12.732ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.21 GB (1294039108) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 481.605us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 195.970ms - TotalThreadsVoluntaryContextSwitches: 78 (78) Fragment Instance Lifecycle Timings: - ExecTime: 868.726us - ExecTreeExecTime: 6.826us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 41.197ms - ExecTreePrepareTime: 425.823us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 275 (275) - BlocksRecycled: 81 (81) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 127.564us, non-child: 127.564us, % non-child: 100.00%) - BytesSent: 6.29 KB (6439) - OverallThroughput: 48.14 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 107.414us - UncompressedRowBatchSize: 6.29 KB (6439) CodeGen:(Total: 223.622ms, non-child: 223.622ms, % non-child: 100.00%) - CodegenTime: 21.463ms - CompileTime: 36.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 156.784ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.630ms SORT_NODE (id=16):(Total: 12m39s, non-child: 428.312us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 97.061us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.675ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 264.054us - GetNewBlockTime: 179.862us - GetResultsTime: 143.268us - HTResizeTime: 5.332us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 902.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 364.468us, % non-child: 0.00%) - ConvertRowBatchTime: 76.389us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 10.15 KB (10390) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 3.287ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ab (host=foo.187.39:22000):(Total: 12m39s, non-child: 17.718ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.31 GB (1408008825) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 373.277us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 172.973ms - TotalThreadsVoluntaryContextSwitches: 81 (81) Fragment Instance Lifecycle Timings: - ExecTime: 781.186us - ExecTreeExecTime: 6.201us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 43.080ms - ExecTreePrepareTime: 360.360us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 295 (295) - BlocksRecycled: 61 (61) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 124.497us, non-child: 124.497us, % non-child: 100.00%) - BytesSent: 6.49 KB (6642) - OverallThroughput: 50.88 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 111.881us - UncompressedRowBatchSize: 6.49 KB (6642) CodeGen:(Total: 195.443ms, non-child: 195.443ms, % non-child: 100.00%) - CodegenTime: 31.991ms - CompileTime: 34.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 134.508ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.192ms SORT_NODE (id=16):(Total: 12m39s, non-child: 548.343us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 153.443us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.723ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 270.880us - GetNewBlockTime: 194.798us - GetResultsTime: 173.036us - HTResizeTime: 5.922us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 17 (17) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 852.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 505.772us, % non-child: 0.00%) - ConvertRowBatchTime: 92.954us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m39s - TotalBytesReceived: 10.24 KB (10487) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 1.638ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030e (host=foo.187.55:22000):(Total: 12m39s, non-child: 20.994ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.31 GB (1401305784) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 240.596us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 11.998ms - TotalThreadsUserTime: 165.975ms - TotalThreadsVoluntaryContextSwitches: 78 (78) Fragment Instance Lifecycle Timings: - ExecTime: 471.099us - ExecTreeExecTime: 3.809us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 49.679ms - ExecTreePrepareTime: 540.472us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 70 (70) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 68.409us, non-child: 68.409us, % non-child: 100.00%) - BytesSent: 6.47 KB (6624) - OverallThroughput: 92.34 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 48.810us - UncompressedRowBatchSize: 6.47 KB (6624) CodeGen:(Total: 204.150ms, non-child: 204.150ms, % non-child: 100.00%) - CodegenTime: 38.146ms - CompileTime: 32.866ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.527ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.057ms SORT_NODE (id=16):(Total: 12m39s, non-child: 200.501us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 31.128us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.003ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 367.235us - GetNewBlockTime: 189.268us - GetResultsTime: 68.944us - HTResizeTime: 3.000us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 751.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 220.434us, % non-child: 0.00%) - ConvertRowBatchTime: 37.751us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.09 KB (10331) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 5.124ms - NumBatchesAccepted: 33 (33) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000307 (host=foo.221.12:22000):(Total: 12m39s, non-child: 12.273ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.39 GB (1490657978) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 558.448us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 178.972ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 982.172us - ExecTreeExecTime: 7.598us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 40.616ms - ExecTreePrepareTime: 505.169us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.741us, non-child: 139.741us, % non-child: 100.00%) - BytesSent: 6.85 KB (7015) - OverallThroughput: 47.87 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 125.032us - UncompressedRowBatchSize: 6.85 KB (7015) CodeGen:(Total: 205.390ms, non-child: 205.390ms, % non-child: 100.00%) - CodegenTime: 20.628ms - CompileTime: 36.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 138.975ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.255ms SORT_NODE (id=16):(Total: 12m39s, non-child: 490.879us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 141.385us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.281ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 419.455us - GetNewBlockTime: 184.150us - GetResultsTime: 158.564us - HTResizeTime: 5.283us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 831.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 488.571us, % non-child: 0.00%) - ConvertRowBatchTime: 98.867us - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.09 KB (11359) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.885ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a4 (host=foo.187.51:22000):(Total: 12m39s, non-child: 11.573ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.23 GB (1324771929) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 271.493us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 94 (94) Fragment Instance Lifecycle Timings: - ExecTime: 691.586us - ExecTreeExecTime: 6.134us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 36.090ms - ExecTreePrepareTime: 434.027us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 160.312us, non-child: 160.312us, % non-child: 100.00%) - BytesSent: 6.48 KB (6639) - OverallThroughput: 39.49 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 148.232us - UncompressedRowBatchSize: 6.48 KB (6639) CodeGen:(Total: 191.794ms, non-child: 191.794ms, % non-child: 100.00%) - CodegenTime: 19.647ms - CompileTime: 34.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 132.085ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.190ms SORT_NODE (id=16):(Total: 12m39s, non-child: 354.251us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 100.024us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 3.443ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 260.547us - GetNewBlockTime: 143.427us - GetResultsTime: 117.671us - HTResizeTime: 5.023us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 803.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 397.138us, % non-child: 0.00%) - ConvertRowBatchTime: 73.867us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.39 KB (10643) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 1.774ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d1 (host=foo.221.13:22000):(Total: 12m39s, non-child: 16.233ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.24 GB (1326661336) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 469.417us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 92 (92) Fragment Instance Lifecycle Timings: - ExecTime: 948.587us - ExecTreeExecTime: 6.438us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 42.710ms - ExecTreePrepareTime: 540.795us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 297 (297) - BlocksRecycled: 59 (59) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 132.563us, non-child: 132.563us, % non-child: 100.00%) - BytesSent: 5.61 KB (5747) - OverallThroughput: 41.34 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 40 (40) - SerializeBatchTime: 115.888us - UncompressedRowBatchSize: 5.61 KB (5747) CodeGen:(Total: 193.293ms, non-child: 193.293ms, % non-child: 100.00%) - CodegenTime: 27.957ms - CompileTime: 31.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.020ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.394ms SORT_NODE (id=16):(Total: 12m39s, non-child: 405.311us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 123.661us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 40 (40) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.101ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 231.632us - GetNewBlockTime: 209.565us - GetResultsTime: 124.457us - HTResizeTime: 4.980us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 20 (20) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 858.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 409.688us, % non-child: 0.00%) - ConvertRowBatchTime: 77.073us - PeakMemoryUsage: 0 - RowsReturned: 40 (40) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.78 KB (8990) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 4.970ms - NumBatchesAccepted: 34 (34) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b1 (host=foo.221.14:22000):(Total: 12m39s, non-child: 12.885ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.25 GB (1338050302) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 357.024us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 98 (98) Fragment Instance Lifecycle Timings: - ExecTime: 801.193us - ExecTreeExecTime: 8.169us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 41.844ms - ExecTreePrepareTime: 568.733us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 298 (298) - BlocksRecycled: 60 (60) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 176.380us, non-child: 176.380us, % non-child: 100.00%) - BytesSent: 6.64 KB (6804) - OverallThroughput: 36.79 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 136.815us - UncompressedRowBatchSize: 6.64 KB (6804) CodeGen:(Total: 202.617ms, non-child: 202.617ms, % non-child: 100.00%) - CodegenTime: 21.587ms - CompileTime: 33.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.476ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.509ms SORT_NODE (id=16):(Total: 12m39s, non-child: 383.929us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 76.542us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 5.337ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 480.877us - GetNewBlockTime: 182.715us - GetResultsTime: 178.326us - HTResizeTime: 6.476us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 819.000ns EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 369.997us, % non-child: 0.00%) - ConvertRowBatchTime: 66.208us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.67 KB (10926) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.014ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002aa (host=foo.187.54:22000):(Total: 12m39s, non-child: 12.449ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11095757) - PerHostPeakMemUsage: 1.23 GB (1321242967) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 468.592us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 8.998ms - TotalThreadsUserTime: 196.970ms - TotalThreadsVoluntaryContextSwitches: 104 (104) Fragment Instance Lifecycle Timings: - ExecTime: 941.020us - ExecTreeExecTime: 9.161us - OpenTime: 12m39s - ExecTreeOpenTime: 12m39s - PrepareTime: 37.249ms - ExecTreePrepareTime: 350.090us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 274 (274) - BlocksRecycled: 87 (87) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141457920) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 190.949us, non-child: 190.949us, % non-child: 100.00%) - BytesSent: 7.84 KB (8031) - OverallThroughput: 40.11 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 55 (55) - SerializeBatchTime: 172.884us - UncompressedRowBatchSize: 7.84 KB (8031) CodeGen:(Total: 225.543ms, non-child: 225.543ms, % non-child: 100.00%) - CodegenTime: 20.956ms - CompileTime: 49.553ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 149.329ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.137ms SORT_NODE (id=16):(Total: 12m39s, non-child: 515.481us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 68.142us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 55 (55) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m39s, non-child: 4.658ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 300.267us - GetNewBlockTime: 250.752us - GetResultsTime: 203.319us - HTResizeTime: 5.941us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.57 MB (11078784) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.008us EXCHANGE_NODE (id=26):(Total: 12m39s, non-child: 463.569us, % non-child: 0.00%) - ConvertRowBatchTime: 99.515us - PeakMemoryUsage: 0 - RowsReturned: 55 (55) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 12.67 KB (12975) - TotalGetBatchTime: 12m39s - DataArrivalTimer: 12m39s SenderSide: - DeserializeRowBatchTimer: 2.997ms - NumBatchesAccepted: 48 (48) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002bb (host=foo.187.52:22000):(Total: 12m39s, non-child: 12.830ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11075277) - PerHostPeakMemUsage: 1.23 GB (1316359560) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 595.613us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 184.972ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 991.133us - ExecTreeExecTime: 7.120us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.207ms - ExecTreePrepareTime: 428.766us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 141.983us, non-child: 141.983us, % non-child: 100.00%) - BytesSent: 7.11 KB (7278) - OverallThroughput: 48.89 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 53 (53) - SerializeBatchTime: 129.300us - UncompressedRowBatchSize: 7.11 KB (7278) CodeGen:(Total: 212.019ms, non-child: 212.019ms, % non-child: 100.00%) - CodegenTime: 21.482ms - CompileTime: 49.520ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.691ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.193ms SORT_NODE (id=16):(Total: 12m38s, non-child: 430.368us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 98.215us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 53 (53) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.997ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 291.753us - GetNewBlockTime: 252.117us - GetResultsTime: 147.483us - HTResizeTime: 5.851us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11058304) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 942.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 312.339us, % non-child: 0.00%) - ConvertRowBatchTime: 60.010us - PeakMemoryUsage: 0 - RowsReturned: 53 (53) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.41 KB (11685) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 9.279ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002cf (host=foo.187.56:22000):(Total: 12m39s, non-child: 12.057ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.25 GB (1340240933) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 339.568us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 160.976ms - TotalThreadsVoluntaryContextSwitches: 80 (80) Fragment Instance Lifecycle Timings: - ExecTime: 713.367us - ExecTreeExecTime: 6.602us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.901ms - ExecTreePrepareTime: 421.407us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 68 (68) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 152.768us, non-child: 152.768us, % non-child: 100.00%) - BytesSent: 6.76 KB (6926) - OverallThroughput: 43.24 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 126.541us - UncompressedRowBatchSize: 6.76 KB (6926) CodeGen:(Total: 193.074ms, non-child: 193.074ms, % non-child: 100.00%) - CodegenTime: 20.356ms - CompileTime: 32.221ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 129.841ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.311ms SORT_NODE (id=16):(Total: 12m38s, non-child: 542.649us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 90.835us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 5.271ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 333.016us - GetNewBlockTime: 165.380us - GetResultsTime: 176.311us - HTResizeTime: 5.935us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 821.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 383.965us, % non-child: 0.00%) - ConvertRowBatchTime: 74.125us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.72 KB (10981) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.095ms - NumBatchesAccepted: 40 (40) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c9 (host=foo.187.53:22000):(Total: 12m39s, non-child: 11.741ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.23 GB (1320013673) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 382.740us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 161.976ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 780.987us - ExecTreeExecTime: 54.533us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.718ms - ExecTreePrepareTime: 319.660us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 122.876us, non-child: 122.876us, % non-child: 100.00%) - BytesSent: 6.41 KB (6568) - OverallThroughput: 50.98 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 108.339us - UncompressedRowBatchSize: 6.41 KB (6568) CodeGen:(Total: 186.965ms, non-child: 186.965ms, % non-child: 100.00%) - CodegenTime: 19.740ms - CompileTime: 33.859ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 123.819ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.591ms SORT_NODE (id=16):(Total: 12m38s, non-child: 337.864us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 48.454us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.289ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 210.074us - GetNewBlockTime: 187.877us - GetResultsTime: 118.665us - HTResizeTime: 3.847us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 16 (16) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.002us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 358.302us, % non-child: 0.00%) - ConvertRowBatchTime: 70.161us - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.02 KB (10261) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.990ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ef (host=foo.221.11:22000):(Total: 12m39s, non-child: 13.996ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.39 GB (1488551165) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 471.452us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 184.972ms - TotalThreadsVoluntaryContextSwitches: 137 (137) Fragment Instance Lifecycle Timings: - ExecTime: 887.315us - ExecTreeExecTime: 7.531us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.469ms - ExecTreePrepareTime: 444.212us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 128.559us, non-child: 128.559us, % non-child: 100.00%) - BytesSent: 6.21 KB (6362) - OverallThroughput: 47.19 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 118.658us - UncompressedRowBatchSize: 6.21 KB (6362) CodeGen:(Total: 207.132ms, non-child: 207.132ms, % non-child: 100.00%) - CodegenTime: 24.023ms - CompileTime: 42.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.250ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 22.647ms SORT_NODE (id=16):(Total: 12m38s, non-child: 389.648us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 88.657us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.926ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 289.692us - GetNewBlockTime: 313.881us - GetResultsTime: 150.038us - HTResizeTime: 6.560us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 764.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 425.431us, % non-child: 0.00%) - ConvertRowBatchTime: 90.639us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.17 KB (10413) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.195ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b2 (host=foo.221.15:22000):(Total: 12m39s, non-child: 12.665ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.51 MB (11022029) - PerHostPeakMemUsage: 1.42 GB (1528716801) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 588.516us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 222 (222) Fragment Instance Lifecycle Timings: - ExecTime: 1.126ms - ExecTreeExecTime: 6.014us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.004ms - ExecTreePrepareTime: 633.853us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 311 (311) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.07 GB (1149849984) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.227us, non-child: 139.227us, % non-child: 100.00%) - BytesSent: 5.03 KB (5150) - OverallThroughput: 35.28 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 39 (39) - SerializeBatchTime: 91.735us - UncompressedRowBatchSize: 5.03 KB (5150) CodeGen:(Total: 197.155ms, non-child: 197.155ms, % non-child: 100.00%) - CodegenTime: 20.389ms - CompileTime: 34.719ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 134.230ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.778ms SORT_NODE (id=16):(Total: 12m38s, non-child: 355.077us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 93.974us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 39 (39) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 5.759ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 221.744us - GetNewBlockTime: 1.920ms - GetResultsTime: 123.957us - HTResizeTime: 4.692us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11005056) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 928.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 350.715us, % non-child: 0.00%) - ConvertRowBatchTime: 63.514us - PeakMemoryUsage: 0 - RowsReturned: 39 (39) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.02 KB (8208) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.344ms - NumBatchesAccepted: 33 (33) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000306 (host=foo.221.18:22000):(Total: 12m39s, non-child: 20.010ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.48 GB (1585855039) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 266.187us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 91 (91) Fragment Instance Lifecycle Timings: - ExecTime: 642.882us - ExecTreeExecTime: 6.151us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 45.428ms - ExecTreePrepareTime: 391.008us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.244us, non-child: 139.244us, % non-child: 100.00%) - BytesSent: 7.28 KB (7453) - OverallThroughput: 51.05 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 55 (55) - SerializeBatchTime: 122.375us - UncompressedRowBatchSize: 7.28 KB (7453) CodeGen:(Total: 208.938ms, non-child: 208.938ms, % non-child: 100.00%) - CodegenTime: 36.000ms - CompileTime: 34.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 147.800ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.241ms SORT_NODE (id=16):(Total: 12m38s, non-child: 306.454us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 50.735us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 55 (55) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.471ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 284.091us - GetNewBlockTime: 204.957us - GetResultsTime: 122.906us - HTResizeTime: 4.075us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 950.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 238.413us, % non-child: 0.00%) - ConvertRowBatchTime: 48.424us - PeakMemoryUsage: 0 - RowsReturned: 55 (55) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.79 KB (12074) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.504ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000301 (host=foo.221.25:22000):(Total: 12m39s, non-child: 11.969ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11030221) - PerHostPeakMemUsage: 1.32 GB (1416696524) - RowsProduced: 36 (36) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 379.118us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 186.971ms - TotalThreadsVoluntaryContextSwitches: 69 (69) Fragment Instance Lifecycle Timings: - ExecTime: 820.948us - ExecTreeExecTime: 6.388us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.232ms - ExecTreePrepareTime: 346.875us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091129728) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 169.500us, non-child: 169.500us, % non-child: 100.00%) - BytesSent: 5.23 KB (5354) - OverallThroughput: 30.12 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 36 (36) - SerializeBatchTime: 156.572us - UncompressedRowBatchSize: 5.23 KB (5354) CodeGen:(Total: 213.319ms, non-child: 213.319ms, % non-child: 100.00%) - CodegenTime: 20.524ms - CompileTime: 39.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 143.044ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.185ms SORT_NODE (id=16):(Total: 12m38s, non-child: 393.230us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 128.133us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 36 (36) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.745ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 374.600us - GetNewBlockTime: 212.752us - GetResultsTime: 118.677us - HTResizeTime: 5.538us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11013248) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 36 (36) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 902.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 305.845us, % non-child: 0.00%) - ConvertRowBatchTime: 53.526us - PeakMemoryUsage: 0 - RowsReturned: 36 (36) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.25 KB (8447) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.470ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f9 (host=foo.221.19:22000):(Total: 12m39s, non-child: 12.827ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11083469) - PerHostPeakMemUsage: 1.22 GB (1309530511) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 321.969us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 106 (106) Fragment Instance Lifecycle Timings: - ExecTime: 735.961us - ExecTreeExecTime: 5.312us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.541ms - ExecTreePrepareTime: 331.841us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 85 (85) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 137.821us, non-child: 137.821us, % non-child: 100.00%) - BytesSent: 7.23 KB (7399) - OverallThroughput: 51.20 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 121.352us - UncompressedRowBatchSize: 7.23 KB (7399) CodeGen:(Total: 202.988ms, non-child: 202.988ms, % non-child: 100.00%) - CodegenTime: 21.025ms - CompileTime: 33.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.940ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.532ms SORT_NODE (id=16):(Total: 12m38s, non-child: 338.252us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 64.203us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.361ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 345.814us - GetNewBlockTime: 165.474us - GetResultsTime: 127.421us - HTResizeTime: 5.503us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11066496) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 847.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 460.444us, % non-child: 0.00%) - ConvertRowBatchTime: 68.613us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.52 KB (11797) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.830ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000298 (host=foo.221.23:22000):(Total: 12m39s, non-child: 13.442ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.32 GB (1417043785) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 1.563ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 105 (105) Fragment Instance Lifecycle Timings: - ExecTime: 1.967ms - ExecTreeExecTime: 7.083us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.732ms - ExecTreePrepareTime: 380.847us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 301 (301) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 140.051us, non-child: 140.051us, % non-child: 100.00%) - BytesSent: 6.75 KB (6913) - OverallThroughput: 47.07 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 123.993us - UncompressedRowBatchSize: 6.75 KB (6913) CodeGen:(Total: 205.650ms, non-child: 205.650ms, % non-child: 100.00%) - CodegenTime: 19.974ms - CompileTime: 34.872ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 143.736ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.560ms SORT_NODE (id=16):(Total: 12m38s, non-child: 396.383us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 85.061us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.915ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 262.579us - GetNewBlockTime: 210.751us - GetResultsTime: 141.322us - HTResizeTime: 5.250us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 926.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 318.819us, % non-child: 0.00%) - ConvertRowBatchTime: 59.537us - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.81 KB (11068) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.549ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000310 (host=foo.221.26:22000):(Total: 12m39s, non-child: 12.452ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.50 MB (11013837) - PerHostPeakMemUsage: 1.21 GB (1302146071) - RowsProduced: 31 (31) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 346.591us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 176.973ms - TotalThreadsVoluntaryContextSwitches: 80 (80) Fragment Instance Lifecycle Timings: - ExecTime: 772.624us - ExecTreeExecTime: 6.288us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.477ms - ExecTreePrepareTime: 334.681us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 275 (275) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 90.486us, non-child: 90.486us, % non-child: 100.00%) - BytesSent: 4.39 KB (4498) - OverallThroughput: 47.41 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 31 (31) - SerializeBatchTime: 70.392us - UncompressedRowBatchSize: 4.39 KB (4498) CodeGen:(Total: 200.641ms, non-child: 200.641ms, % non-child: 100.00%) - CodegenTime: 20.911ms - CompileTime: 33.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 142.821ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.878ms SORT_NODE (id=16):(Total: 12m38s, non-child: 345.777us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 66.724us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 31 (31) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.609ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 265.144us - GetNewBlockTime: 162.299us - GetResultsTime: 134.795us - HTResizeTime: 5.121us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.49 MB (10996864) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 31 (31) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 805.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 320.740us, % non-child: 0.00%) - ConvertRowBatchTime: 58.306us - PeakMemoryUsage: 0 - RowsReturned: 31 (31) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 6.73 KB (6895) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.170ms - NumBatchesAccepted: 28 (28) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000304 (host=foo.221.24:22000):(Total: 12m39s, non-child: 12.232ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.29 GB (1390088687) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 345.699us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 181.972ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 740.452us - ExecTreeExecTime: 8.035us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 40.208ms - ExecTreePrepareTime: 456.725us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 302 (302) - BlocksRecycled: 58 (58) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 133.258us, non-child: 133.258us, % non-child: 100.00%) - BytesSent: 6.48 KB (6634) - OverallThroughput: 47.48 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 121.710us - UncompressedRowBatchSize: 6.48 KB (6634) CodeGen:(Total: 206.112ms, non-child: 206.112ms, % non-child: 100.00%) - CodegenTime: 20.623ms - CompileTime: 34.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.801ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.811ms SORT_NODE (id=16):(Total: 12m38s, non-child: 419.939us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 121.616us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.688ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 293.308us - GetNewBlockTime: 195.716us - GetResultsTime: 141.360us - HTResizeTime: 6.657us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 850.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 498.696us, % non-child: 0.00%) - ConvertRowBatchTime: 88.843us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.44 KB (10690) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.667ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002de (host=foo.221.21:22000):(Total: 12m39s, non-child: 13.056ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.40 GB (1500370086) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 410.333us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 98 (98) Fragment Instance Lifecycle Timings: - ExecTime: 845.195us - ExecTreeExecTime: 6.672us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 33.220ms - ExecTreePrepareTime: 410.306us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 123.822us, non-child: 123.822us, % non-child: 100.00%) - BytesSent: 5.50 KB (5633) - OverallThroughput: 43.39 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 104.995us - UncompressedRowBatchSize: 5.50 KB (5633) CodeGen:(Total: 189.874ms, non-child: 189.874ms, % non-child: 100.00%) - CodegenTime: 22.201ms - CompileTime: 34.855ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.401ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 21.069ms SORT_NODE (id=16):(Total: 12m38s, non-child: 370.233us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 77.626us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.758ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 239.494us - GetNewBlockTime: 273.415us - GetResultsTime: 124.652us - HTResizeTime: 5.334us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 908.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 312.843us, % non-child: 0.00%) - ConvertRowBatchTime: 59.279us - PeakMemoryUsage: 0 - RowsReturned: 44 (44) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.95 KB (9162) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.682ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e9 (host=foo.221.17:22000):(Total: 12m39s, non-child: 13.213ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.43 GB (1532785948) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 331.209us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 92 (92) Fragment Instance Lifecycle Timings: - ExecTime: 702.802us - ExecTreeExecTime: 5.416us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 46.785ms - ExecTreePrepareTime: 285.083us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 123.307us, non-child: 123.307us, % non-child: 100.00%) - BytesSent: 6.38 KB (6529) - OverallThroughput: 50.50 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 105.403us - UncompressedRowBatchSize: 6.38 KB (6529) CodeGen:(Total: 218.887ms, non-child: 218.887ms, % non-child: 100.00%) - CodegenTime: 21.869ms - CompileTime: 38.788ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 144.888ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.786ms SORT_NODE (id=16):(Total: 12m38s, non-child: 262.836us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 40.720us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 8.703ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 332.199us - GetNewBlockTime: 139.592us - GetResultsTime: 118.479us - HTResizeTime: 4.675us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 793.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 237.499us, % non-child: 0.00%) - ConvertRowBatchTime: 43.676us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.12 KB (10364) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.213ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c5 (host=foo.221.20:22000):(Total: 12m39s, non-child: 13.373ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.39 GB (1494618394) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 324.552us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 176.974ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 744.782us - ExecTreeExecTime: 5.680us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 42.605ms - ExecTreePrepareTime: 396.589us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.175us, non-child: 119.175us, % non-child: 100.00%) - BytesSent: 6.12 KB (6270) - OverallThroughput: 50.17 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 102.696us - UncompressedRowBatchSize: 6.12 KB (6270) CodeGen:(Total: 202.965ms, non-child: 202.965ms, % non-child: 100.00%) - CodegenTime: 23.200ms - CompileTime: 34.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.968ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.884ms SORT_NODE (id=16):(Total: 12m38s, non-child: 294.289us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 45.677us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.940ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 258.255us - GetNewBlockTime: 180.991us - GetResultsTime: 173.473us - HTResizeTime: 5.298us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 942.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 329.743us, % non-child: 0.00%) - ConvertRowBatchTime: 53.955us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.74 KB (9970) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.321ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002bd (host=foo.221.27:22000):(Total: 12m39s, non-child: 12.281ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.20 GB (1292996464) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 447.541us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 166.975ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 869.964us - ExecTreeExecTime: 7.164us - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.342ms - ExecTreePrepareTime: 857.762us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 84 (84) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 151.650us, non-child: 151.650us, % non-child: 100.00%) - BytesSent: 6.41 KB (6563) - OverallThroughput: 41.27 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 110.879us - UncompressedRowBatchSize: 6.41 KB (6563) CodeGen:(Total: 195.841ms, non-child: 195.841ms, % non-child: 100.00%) - CodegenTime: 20.098ms - CompileTime: 34.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 132.914ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.270ms SORT_NODE (id=16):(Total: 12m38s, non-child: 500.988us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 115.841us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.578ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 421.442us - GetNewBlockTime: 175.145us - GetResultsTime: 191.402us - HTResizeTime: 4.940us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 895.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 350.741us, % non-child: 0.00%) - ConvertRowBatchTime: 78.774us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.21 KB (10454) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.350ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030d (host=foo.221.29:22000):(Total: 12m39s, non-child: 12.363ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11083469) - PerHostPeakMemUsage: 1.22 GB (1307896255) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 286.546us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 191.971ms - TotalThreadsVoluntaryContextSwitches: 114 (114) Fragment Instance Lifecycle Timings: - ExecTime: 629.808us - ExecTreeExecTime: 6.492us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 38.755ms - ExecTreePrepareTime: 351.592us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 295 (295) - BlocksRecycled: 59 (59) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.01 GB (1082737664) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 131.018us, non-child: 131.018us, % non-child: 100.00%) - BytesSent: 6.45 KB (6604) - OverallThroughput: 48.07 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 119.061us - UncompressedRowBatchSize: 6.45 KB (6604) CodeGen:(Total: 215.820ms, non-child: 215.820ms, % non-child: 100.00%) - CodegenTime: 21.651ms - CompileTime: 35.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 152.830ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.049ms SORT_NODE (id=16):(Total: 12m38s, non-child: 440.118us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 109.658us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.459ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 258.861us - GetNewBlockTime: 188.928us - GetResultsTime: 151.172us - HTResizeTime: 4.783us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11066496) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 826.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 352.097us, % non-child: 0.00%) - ConvertRowBatchTime: 58.101us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.48 KB (10731) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.699ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c8 (host=foo.221.30:22000):(Total: 12m39s, non-child: 14.153ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.51 MB (11022029) - PerHostPeakMemUsage: 1.32 GB (1419515909) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 327.139us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 161.976ms - TotalThreadsVoluntaryContextSwitches: 80 (80) Fragment Instance Lifecycle Timings: - ExecTime: 672.137us - ExecTreeExecTime: 6.642us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 42.401ms - ExecTreePrepareTime: 392.842us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 120.047us, non-child: 120.047us, % non-child: 100.00%) - BytesSent: 5.50 KB (5636) - OverallThroughput: 44.77 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 39 (39) - SerializeBatchTime: 104.898us - UncompressedRowBatchSize: 5.50 KB (5636) CodeGen:(Total: 190.376ms, non-child: 190.376ms, % non-child: 100.00%) - CodegenTime: 22.511ms - CompileTime: 33.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 125.643ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.305ms SORT_NODE (id=16):(Total: 12m38s, non-child: 330.697us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 72.908us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 39 (39) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.630ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 228.143us - GetNewBlockTime: 176.324us - GetResultsTime: 104.894us - HTResizeTime: 4.970us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11005056) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 761.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 405.152us, % non-child: 0.00%) - ConvertRowBatchTime: 79.060us - PeakMemoryUsage: 0 - RowsReturned: 39 (39) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.79 KB (9002) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.025ms - NumBatchesAccepted: 33 (33) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a7 (host=foo.221.28:22000):(Total: 12m39s, non-child: 11.904ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.38 GB (1485233861) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 617.271us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 171.974ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 1.047ms - ExecTreeExecTime: 6.348us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.782ms - ExecTreePrepareTime: 616.769us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 309 (309) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133072768) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 137.565us, non-child: 137.565us, % non-child: 100.00%) - BytesSent: 6.62 KB (6783) - OverallThroughput: 47.02 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 123.863us - UncompressedRowBatchSize: 6.62 KB (6783) CodeGen:(Total: 196.073ms, non-child: 196.073ms, % non-child: 100.00%) - CodegenTime: 19.467ms - CompileTime: 34.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 135.645ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.093ms SORT_NODE (id=16):(Total: 12m38s, non-child: 406.413us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 72.083us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.498ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 468.983us - GetNewBlockTime: 221.698us - GetResultsTime: 165.117us - HTResizeTime: 5.448us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 790.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 366.115us, % non-child: 0.00%) - ConvertRowBatchTime: 58.460us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.56 KB (10812) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.004ms - NumBatchesAccepted: 40 (40) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b4 (host=foo.221.32:22000):(Total: 12m38s, non-child: 12.907ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11050701) - PerHostPeakMemUsage: 1.38 GB (1478564799) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 249.235us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 177.972ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 812.762us - ExecTreeExecTime: 7.788us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.275ms - ExecTreePrepareTime: 335.897us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 55 (55) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 123.155us, non-child: 123.155us, % non-child: 100.00%) - BytesSent: 6.41 KB (6562) - OverallThroughput: 50.81 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 115.266us - UncompressedRowBatchSize: 6.41 KB (6562) CodeGen:(Total: 199.284ms, non-child: 199.284ms, % non-child: 100.00%) - CodegenTime: 21.318ms - CompileTime: 34.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.938ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.046ms SORT_NODE (id=16):(Total: 12m38s, non-child: 576.689us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 131.420us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.196ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 308.333us - GetNewBlockTime: 220.759us - GetResultsTime: 137.905us - HTResizeTime: 6.760us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11033728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 805.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 438.025us, % non-child: 0.00%) - ConvertRowBatchTime: 76.240us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.19 KB (10439) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.378ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d7 (host=foo.221.33:22000):(Total: 12m38s, non-child: 12.680ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.40 GB (1500362839) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 390.139us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 122 (122) Fragment Instance Lifecycle Timings: - ExecTime: 735.553us - ExecTreeExecTime: 5.670us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 44.389ms - ExecTreePrepareTime: 331.543us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.278us, non-child: 139.278us, % non-child: 100.00%) - BytesSent: 7.46 KB (7642) - OverallThroughput: 52.33 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 126.918us - UncompressedRowBatchSize: 7.46 KB (7642) CodeGen:(Total: 206.955ms, non-child: 206.955ms, % non-child: 100.00%) - CodegenTime: 21.092ms - CompileTime: 35.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.568ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.509ms SORT_NODE (id=16):(Total: 12m38s, non-child: 364.557us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 114.143us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.975ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 279.233us - GetNewBlockTime: 178.878us - GetResultsTime: 126.108us - HTResizeTime: 4.396us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 782.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 393.267us, % non-child: 0.00%) - ConvertRowBatchTime: 46.229us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.76 KB (12041) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.618ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a6 (host=foo.221.35:22000):(Total: 12m38s, non-child: 17.008ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11075277) - PerHostPeakMemUsage: 1.34 GB (1442599544) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 446.472us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Fragment Instance Lifecycle Timings: - ExecTime: 911.579us - ExecTreeExecTime: 7.193us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.687ms - ExecTreePrepareTime: 545.390us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 53 (53) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 155.629us, non-child: 155.629us, % non-child: 100.00%) - BytesSent: 6.55 KB (6703) - OverallThroughput: 41.08 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 143.817us - UncompressedRowBatchSize: 6.55 KB (6703) CodeGen:(Total: 196.162ms, non-child: 196.162ms, % non-child: 100.00%) - CodegenTime: 30.037ms - CompileTime: 36.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 135.974ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.488ms SORT_NODE (id=16):(Total: 12m38s, non-child: 373.384us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 70.903us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.190ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 271.762us - GetNewBlockTime: 302.871us - GetResultsTime: 146.958us - HTResizeTime: 6.288us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11058304) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 895.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 464.165us, % non-child: 0.00%) - ConvertRowBatchTime: 88.749us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.54 KB (10792) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.215ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ba (host=foo.221.36:22000):(Total: 12m38s, non-child: 14.846ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.36 GB (1456874272) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 420.781us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 75 (75) Fragment Instance Lifecycle Timings: - ExecTime: 950.608us - ExecTreeExecTime: 6.278us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 43.604ms - ExecTreePrepareTime: 586.000us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 55 (55) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133069312) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 135.538us, non-child: 135.538us, % non-child: 100.00%) - BytesSent: 6.85 KB (7014) - OverallThroughput: 49.35 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 121.653us - UncompressedRowBatchSize: 6.85 KB (7014) CodeGen:(Total: 219.395ms, non-child: 219.395ms, % non-child: 100.00%) - CodegenTime: 25.194ms - CompileTime: 38.243ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 150.448ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.034ms SORT_NODE (id=16):(Total: 12m38s, non-child: 367.868us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 65.818us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.231ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 400.946us - GetNewBlockTime: 257.956us - GetResultsTime: 133.684us - HTResizeTime: 5.960us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 759.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 218.517us, % non-child: 0.00%) - ConvertRowBatchTime: 37.799us - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.74 KB (10995) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.331ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030a (host=foo.221.43:22000):(Total: 12m38s, non-child: 12.044ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.29 GB (1384844262) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 411.331us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 759.345us - ExecTreeExecTime: 6.231us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 38.816ms - ExecTreePrepareTime: 413.105us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 299 (299) - BlocksRecycled: 59 (59) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.996us, non-child: 119.996us, % non-child: 100.00%) - BytesSent: 6.27 KB (6424) - OverallThroughput: 51.06 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 103.528us - UncompressedRowBatchSize: 6.27 KB (6424) CodeGen:(Total: 194.976ms, non-child: 194.976ms, % non-child: 100.00%) - CodegenTime: 20.137ms - CompileTime: 33.118ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.891ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.453ms SORT_NODE (id=16):(Total: 12m38s, non-child: 347.963us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 41.142us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.626ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 266.079us - GetNewBlockTime: 193.846us - GetResultsTime: 130.152us - HTResizeTime: 5.460us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 23 (23) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 791.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 311.643us, % non-child: 0.00%) - ConvertRowBatchTime: 50.611us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.98 KB (10223) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.588ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002df (host=foo.221.42:22000):(Total: 12m38s, non-child: 12.173ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.43 GB (1539857554) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 330.695us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 174.974ms - TotalThreadsVoluntaryContextSwitches: 97 (97) Fragment Instance Lifecycle Timings: - ExecTime: 711.408us - ExecTreeExecTime: 5.950us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.219ms - ExecTreePrepareTime: 414.348us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 154.148us, non-child: 154.148us, % non-child: 100.00%) - BytesSent: 6.58 KB (6736) - OverallThroughput: 41.67 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 139.181us - UncompressedRowBatchSize: 6.58 KB (6736) CodeGen:(Total: 201.213ms, non-child: 201.213ms, % non-child: 100.00%) - CodegenTime: 20.373ms - CompileTime: 33.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.747ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.833ms SORT_NODE (id=16):(Total: 12m38s, non-child: 393.603us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 74.366us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.718ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 244.075us - GetNewBlockTime: 195.317us - GetResultsTime: 134.648us - HTResizeTime: 5.001us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 785.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 378.356us, % non-child: 0.00%) - ConvertRowBatchTime: 72.548us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.57 KB (10824) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.879ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029a (host=foo.221.34:22000):(Total: 12m38s, non-child: 12.710ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.60 MB (11112141) - PerHostPeakMemUsage: 1.40 GB (1500830944) - RowsProduced: 62 (62) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 750.041us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 96 (96) Fragment Instance Lifecycle Timings: - ExecTime: 1.134ms - ExecTreeExecTime: 6.528us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 45.320ms - ExecTreePrepareTime: 613.929us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 159.658us, non-child: 159.658us, % non-child: 100.00%) - BytesSent: 7.93 KB (8121) - OverallThroughput: 48.51 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 62 (62) - SerializeBatchTime: 135.720us - UncompressedRowBatchSize: 7.93 KB (8121) CodeGen:(Total: 195.886ms, non-child: 195.886ms, % non-child: 100.00%) - CodegenTime: 20.868ms - CompileTime: 33.328ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 128.409ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.608ms SORT_NODE (id=16):(Total: 12m38s, non-child: 400.788us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 95.110us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 62 (62) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.199ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 327.452us - GetNewBlockTime: 196.473us - GetResultsTime: 185.511us - HTResizeTime: 5.088us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.58 MB (11095168) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 62 (62) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 862.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 468.448us, % non-child: 0.00%) - ConvertRowBatchTime: 83.879us - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 13.02 KB (13335) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.584ms - NumBatchesAccepted: 52 (52) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e5 (host=foo.221.38:22000):(Total: 12m38s, non-child: 14.159ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.31 GB (1403689644) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 396.396us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 194.971ms - TotalThreadsVoluntaryContextSwitches: 89 (89) Fragment Instance Lifecycle Timings: - ExecTime: 810.023us - ExecTreeExecTime: 7.052us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.435ms - ExecTreePrepareTime: 458.710us DataStreamSender (dst_id=28):(Total: 139.922us, non-child: 139.922us, % non-child: 100.00%) - BytesSent: 6.56 KB (6721) - OverallThroughput: 45.81 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 118.937us - UncompressedRowBatchSize: 6.56 KB (6721) CodeGen:(Total: 222.459ms, non-child: 222.459ms, % non-child: 100.00%) - CodegenTime: 24.416ms - CompileTime: 47.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 146.440ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.871ms SORT_NODE (id=16):(Total: 12m38s, non-child: 350.969us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 59.399us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.867ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 340.454us - GetNewBlockTime: 194.315us - GetResultsTime: 176.032us - HTResizeTime: 5.545us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 870.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 352.704us, % non-child: 0.00%) - ConvertRowBatchTime: 63.465us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.65 KB (10903) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 6.355ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002fa (host=foo.221.37:22000):(Total: 12m38s, non-child: 13.312ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.23 GB (1323240864) - RowsProduced: 38 (38) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 329.902us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 191.970ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 684.394us - ExecTreeExecTime: 6.398us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 42.411ms - ExecTreePrepareTime: 410.877us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 293 (293) - BlocksRecycled: 65 (65) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 125.970us, non-child: 125.970us, % non-child: 100.00%) - BytesSent: 5.57 KB (5705) - OverallThroughput: 43.19 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 38 (38) - SerializeBatchTime: 112.393us - UncompressedRowBatchSize: 5.57 KB (5705) CodeGen:(Total: 219.969ms, non-child: 219.969ms, % non-child: 100.00%) - CodegenTime: 23.076ms - CompileTime: 42.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 146.996ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.878ms SORT_NODE (id=16):(Total: 12m38s, non-child: 385.962us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 81.271us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 38 (38) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.773ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 223.295us - GetNewBlockTime: 171.796us - GetResultsTime: 118.245us - HTResizeTime: 5.679us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 21 (21) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 38 (38) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 830.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 326.633us, % non-child: 0.00%) - ConvertRowBatchTime: 49.666us - PeakMemoryUsage: 0 - RowsReturned: 38 (38) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.83 KB (9037) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.417ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d5 (host=foo.221.41:22000):(Total: 12m38s, non-child: 13.101ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.43 GB (1531852975) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 303.362us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 93 (93) Fragment Instance Lifecycle Timings: - ExecTime: 685.506us - ExecTreeExecTime: 5.700us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.680ms - ExecTreePrepareTime: 516.572us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 308 (308) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124684160) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 131.387us, non-child: 131.387us, % non-child: 100.00%) - BytesSent: 6.99 KB (7161) - OverallThroughput: 51.98 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 118.050us - UncompressedRowBatchSize: 6.99 KB (7161) CodeGen:(Total: 207.334ms, non-child: 207.334ms, % non-child: 100.00%) - CodegenTime: 22.659ms - CompileTime: 35.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 144.082ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.410ms SORT_NODE (id=16):(Total: 12m38s, non-child: 374.098us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 86.324us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.833ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 256.533us - GetNewBlockTime: 218.531us - GetResultsTime: 120.948us - HTResizeTime: 4.765us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 900.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 460.639us, % non-child: 0.00%) - ConvertRowBatchTime: 91.600us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.19 KB (11459) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.005ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a8 (host=foo.221.40:22000):(Total: 12m38s, non-child: 12.841ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.23 GB (1324343334) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 598.820us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 194.970ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 952.954us - ExecTreeExecTime: 7.167us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 38.521ms - ExecTreePrepareTime: 316.271us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 145.160us, non-child: 145.160us, % non-child: 100.00%) - BytesSent: 6.84 KB (7005) - OverallThroughput: 46.02 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 120.511us - UncompressedRowBatchSize: 6.84 KB (7005) CodeGen:(Total: 219.601ms, non-child: 219.601ms, % non-child: 100.00%) - CodegenTime: 21.585ms - CompileTime: 36.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 155.971ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.850ms SORT_NODE (id=16):(Total: 12m38s, non-child: 417.544us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 123.671us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.950ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 282.423us - GetNewBlockTime: 168.967us - GetResultsTime: 173.480us - HTResizeTime: 5.844us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 880.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 378.462us, % non-child: 0.00%) - ConvertRowBatchTime: 71.309us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.03 KB (11299) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.418ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000297 (host=foo.221.39:22000):(Total: 12m38s, non-child: 13.647ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11042509) - PerHostPeakMemUsage: 1.37 GB (1474043505) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 629.092us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 188.971ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Fragment Instance Lifecycle Timings: - ExecTime: 2.018ms - ExecTreeExecTime: 6.114us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.555ms - ExecTreePrepareTime: 724.391us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099518336) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 107.013us, non-child: 107.013us, % non-child: 100.00%) - BytesSent: 6.05 KB (6196) - OverallThroughput: 55.22 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 93.642us - UncompressedRowBatchSize: 6.05 KB (6196) CodeGen:(Total: 213.817ms, non-child: 213.817ms, % non-child: 100.00%) - CodegenTime: 20.649ms - CompileTime: 33.276ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 154.089ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.955ms SORT_NODE (id=16):(Total: 12m38s, non-child: 402.539us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 102.429us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.079ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 245.896us - GetNewBlockTime: 206.501us - GetResultsTime: 146.465us - HTResizeTime: 6.302us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11025536) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 873.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 272.037us, % non-child: 0.00%) - ConvertRowBatchTime: 50.635us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.64 KB (9876) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.681ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000315 (host=foo.221.44:22000):(Total: 12m38s, non-child: 17.833ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11030221) - PerHostPeakMemUsage: 1.39 GB (1493934538) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 330.714us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 184.972ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Fragment Instance Lifecycle Timings: - ExecTime: 732.903us - ExecTreeExecTime: 7.380us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 51.377ms - ExecTreePrepareTime: 588.102us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133069312) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 117.437us, non-child: 117.437us, % non-child: 100.00%) - BytesSent: 5.68 KB (5814) - OverallThroughput: 47.21 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 41 (41) - SerializeBatchTime: 104.428us - UncompressedRowBatchSize: 5.68 KB (5814) CodeGen:(Total: 220.449ms, non-child: 220.449ms, % non-child: 100.00%) - CodegenTime: 31.722ms - CompileTime: 37.299ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 147.865ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 34.490ms SORT_NODE (id=16):(Total: 12m38s, non-child: 416.378us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 80.278us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 41 (41) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.021ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 261.488us - GetNewBlockTime: 200.446us - GetResultsTime: 142.570us - HTResizeTime: 6.762us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11013248) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 894.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 287.965us, % non-child: 0.00%) - ConvertRowBatchTime: 50.920us - PeakMemoryUsage: 0 - RowsReturned: 41 (41) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.01 KB (9223) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 7.766ms - NumBatchesAccepted: 33 (33) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000302 (host=foo.221.45:22000):(Total: 12m38s, non-child: 14.365ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.22 GB (1309290671) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 427.893us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 199.970ms - TotalThreadsVoluntaryContextSwitches: 119 (119) Fragment Instance Lifecycle Timings: - ExecTime: 792.961us - ExecTreeExecTime: 6.632us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 45.091ms - ExecTreePrepareTime: 539.168us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 294 (294) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 125.834us, non-child: 125.834us, % non-child: 100.00%) - BytesSent: 5.70 KB (5835) - OverallThroughput: 44.22 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 42 (42) - SerializeBatchTime: 103.142us - UncompressedRowBatchSize: 5.70 KB (5835) CodeGen:(Total: 231.615ms, non-child: 231.615ms, % non-child: 100.00%) - CodegenTime: 23.446ms - CompileTime: 36.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 161.360ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.716ms SORT_NODE (id=16):(Total: 12m38s, non-child: 352.550us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 81.980us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 42 (42) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.866ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 253.428us - GetNewBlockTime: 197.276us - GetResultsTime: 143.184us - HTResizeTime: 5.386us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 786.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 297.695us, % non-child: 0.00%) - ConvertRowBatchTime: 55.657us - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.94 KB (9150) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.216ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000300 (host=foo.221.47:22000):(Total: 12m38s, non-child: 12.316ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.50 MB (11005645) - PerHostPeakMemUsage: 1.42 GB (1520540796) - RowsProduced: 36 (36) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 309.665us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 186.972ms - TotalThreadsVoluntaryContextSwitches: 103 (103) Fragment Instance Lifecycle Timings: - ExecTime: 654.158us - ExecTreeExecTime: 6.735us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 38.585ms - ExecTreePrepareTime: 329.292us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 311 (311) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.07 GB (1149849984) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 125.853us, non-child: 125.853us, % non-child: 100.00%) - BytesSent: 4.91 KB (5029) - OverallThroughput: 38.11 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 36 (36) - SerializeBatchTime: 104.464us - UncompressedRowBatchSize: 4.91 KB (5029) CodeGen:(Total: 210.656ms, non-child: 210.656ms, % non-child: 100.00%) - CodegenTime: 21.215ms - CompileTime: 40.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 142.182ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.604ms SORT_NODE (id=16):(Total: 12m38s, non-child: 340.759us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 81.786us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 36 (36) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.608ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 304.298us - GetNewBlockTime: 324.275us - GetResultsTime: 116.597us - HTResizeTime: 4.516us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.48 MB (10988672) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 36 (36) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.024us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 403.082us, % non-child: 0.00%) - ConvertRowBatchTime: 75.071us - PeakMemoryUsage: 0 - RowsReturned: 36 (36) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 7.78 KB (7963) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.793ms - NumBatchesAccepted: 28 (28) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d4 (host=foo.221.46:22000):(Total: 12m38s, non-child: 11.683ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.38 GB (1481371800) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 391.239us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 179.972ms - TotalThreadsVoluntaryContextSwitches: 123 (123) Fragment Instance Lifecycle Timings: - ExecTime: 817.926us - ExecTreeExecTime: 7.721us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 34.575ms - ExecTreePrepareTime: 326.155us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 53 (53) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 142.411us, non-child: 142.411us, % non-child: 100.00%) - BytesSent: 5.89 KB (6034) - OverallThroughput: 40.41 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 129.439us - UncompressedRowBatchSize: 5.89 KB (6034) CodeGen:(Total: 206.114ms, non-child: 206.114ms, % non-child: 100.00%) - CodegenTime: 19.816ms - CompileTime: 35.624ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 146.094ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.785ms SORT_NODE (id=16):(Total: 12m38s, non-child: 491.654us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 101.269us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.170ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 283.006us - GetNewBlockTime: 193.465us - GetResultsTime: 178.681us - HTResizeTime: 4.613us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 945.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 306.316us, % non-child: 0.00%) - ConvertRowBatchTime: 51.045us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.33 KB (9553) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.729ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f1 (host=foo.221.48:22000):(Total: 12m38s, non-child: 11.679ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.32 GB (1419969646) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 346.413us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 182 (182) Fragment Instance Lifecycle Timings: - ExecTime: 732.216us - ExecTreeExecTime: 6.909us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 32.303ms - ExecTreePrepareTime: 440.623us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 53 (53) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 131.865us, non-child: 131.865us, % non-child: 100.00%) - BytesSent: 6.98 KB (7147) - OverallThroughput: 51.69 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 53 (53) - SerializeBatchTime: 119.820us - UncompressedRowBatchSize: 6.98 KB (7147) CodeGen:(Total: 190.311ms, non-child: 190.311ms, % non-child: 100.00%) - CodegenTime: 20.237ms - CompileTime: 36.226ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 132.226ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 21.168ms SORT_NODE (id=16):(Total: 12m38s, non-child: 482.048us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 80.248us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 53 (53) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 5.838ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 295.965us - GetNewBlockTime: 1.590ms - GetResultsTime: 167.514us - HTResizeTime: 4.841us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.004us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 415.067us, % non-child: 0.00%) - ConvertRowBatchTime: 86.518us - PeakMemoryUsage: 0 - RowsReturned: 53 (53) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.38 KB (11657) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.709ms - NumBatchesAccepted: 44 (44) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f5 (host=foo.232.12:22000):(Total: 12m38s, non-child: 11.972ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11030221) - PerHostPeakMemUsage: 1.39 GB (1491728620) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 295.194us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 176.973ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 693.282us - ExecTreeExecTime: 5.737us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 34.817ms - ExecTreePrepareTime: 327.599us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 97.181us, non-child: 97.181us, % non-child: 100.00%) - BytesSent: 5.87 KB (6012) - OverallThroughput: 59.00 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 42 (42) - SerializeBatchTime: 90.826us - UncompressedRowBatchSize: 5.87 KB (6012) CodeGen:(Total: 199.213ms, non-child: 199.213ms, % non-child: 100.00%) - CodegenTime: 20.526ms - CompileTime: 34.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.643ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.847ms SORT_NODE (id=16):(Total: 12m38s, non-child: 338.273us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 44.125us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 42 (42) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.962ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 409.264us - GetNewBlockTime: 405.908us - GetResultsTime: 126.788us - HTResizeTime: 4.885us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11013248) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.061us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 276.158us, % non-child: 0.00%) - ConvertRowBatchTime: 55.048us - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.25 KB (9471) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.811ms - NumBatchesAccepted: 32 (32) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ee (host=foo.221.51:22000):(Total: 12m38s, non-child: 12.086ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.51 MB (11022029) - PerHostPeakMemUsage: 1.34 GB (1434765277) - RowsProduced: 36 (36) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 346.649us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 177.972ms - TotalThreadsVoluntaryContextSwitches: 122 (122) Fragment Instance Lifecycle Timings: - ExecTime: 718.253us - ExecTreeExecTime: 5.623us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 33.650ms - ExecTreePrepareTime: 369.449us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 302 (302) - BlocksRecycled: 56 (56) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 115.037us, non-child: 115.037us, % non-child: 100.00%) - BytesSent: 5.13 KB (5255) - OverallThroughput: 43.56 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 36 (36) - SerializeBatchTime: 107.859us - UncompressedRowBatchSize: 5.13 KB (5255) CodeGen:(Total: 199.997ms, non-child: 199.997ms, % non-child: 100.00%) - CodegenTime: 20.449ms - CompileTime: 39.470ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.584ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 22.408ms SORT_NODE (id=16):(Total: 12m38s, non-child: 294.030us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 44.058us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 36 (36) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 8.655ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 224.234us - GetNewBlockTime: 927.687us - GetResultsTime: 130.113us - HTResizeTime: 4.168us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11005056) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 36 (36) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 729.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 280.314us, % non-child: 0.00%) - ConvertRowBatchTime: 61.979us - PeakMemoryUsage: 0 - RowsReturned: 36 (36) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.01 KB (8203) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.329ms - NumBatchesAccepted: 30 (30) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000305 (host=foo.232.11:22000):(Total: 12m38s, non-child: 13.067ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11091661) - PerHostPeakMemUsage: 1.40 GB (1507459617) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 291.844us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 123 (123) Fragment Instance Lifecycle Timings: - ExecTime: 671.571us - ExecTreeExecTime: 5.940us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.651ms - ExecTreePrepareTime: 398.295us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 135.416us, non-child: 135.416us, % non-child: 100.00%) - BytesSent: 7.09 KB (7260) - OverallThroughput: 51.13 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 117.032us - UncompressedRowBatchSize: 7.09 KB (7260) CodeGen:(Total: 193.214ms, non-child: 193.214ms, % non-child: 100.00%) - CodegenTime: 22.226ms - CompileTime: 34.265ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 132.949ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.347ms SORT_NODE (id=16):(Total: 12m38s, non-child: 380.789us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 87.597us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.508ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 270.136us - GetNewBlockTime: 509.067us - GetResultsTime: 124.093us - HTResizeTime: 4.422us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11074688) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 787.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 325.207us, % non-child: 0.00%) - ConvertRowBatchTime: 57.963us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.65 KB (11925) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.833ms - NumBatchesAccepted: 47 (47) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002eb (host=foo.221.52:22000):(Total: 12m38s, non-child: 12.612ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.40 GB (1498813388) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 373.322us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 135 (135) Fragment Instance Lifecycle Timings: - ExecTime: 772.160us - ExecTreeExecTime: 5.733us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.323ms - ExecTreePrepareTime: 393.058us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 113.351us, non-child: 113.351us, % non-child: 100.00%) - BytesSent: 5.90 KB (6038) - OverallThroughput: 50.80 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 95.855us - UncompressedRowBatchSize: 5.90 KB (6038) CodeGen:(Total: 198.145ms, non-child: 198.145ms, % non-child: 100.00%) - CodegenTime: 21.089ms - CompileTime: 34.771ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.116ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.823ms SORT_NODE (id=16):(Total: 12m38s, non-child: 392.847us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 90.228us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.018ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 351.398us - GetNewBlockTime: 284.939us - GetResultsTime: 156.545us - HTResizeTime: 6.735us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 841.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 308.239us, % non-child: 0.00%) - ConvertRowBatchTime: 50.848us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.63 KB (9864) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.383ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029c (host=foo.221.49:22000):(Total: 12m38s, non-child: 12.415ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.39 GB (1493206787) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 475.869us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 128 (128) Fragment Instance Lifecycle Timings: - ExecTime: 984.174us - ExecTreeExecTime: 6.773us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 34.981ms - ExecTreePrepareTime: 351.507us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 191.672us, non-child: 191.672us, % non-child: 100.00%) - BytesSent: 6.47 KB (6625) - OverallThroughput: 32.96 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 179.083us - UncompressedRowBatchSize: 6.47 KB (6625) CodeGen:(Total: 192.521ms, non-child: 192.521ms, % non-child: 100.00%) - CodegenTime: 20.870ms - CompileTime: 38.313ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 130.059ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.659ms SORT_NODE (id=16):(Total: 12m38s, non-child: 464.866us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 133.885us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.324ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 294.097us - GetNewBlockTime: 270.623us - GetResultsTime: 158.326us - HTResizeTime: 6.131us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 826.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 458.899us, % non-child: 0.00%) - ConvertRowBatchTime: 66.858us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.32 KB (10566) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.697ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002af (host=foo.221.50:22000):(Total: 12m38s, non-child: 13.584ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.35 GB (1445681303) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 434.530us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 177.973ms - TotalThreadsVoluntaryContextSwitches: 92 (92) Fragment Instance Lifecycle Timings: - ExecTime: 811.476us - ExecTreeExecTime: 7.583us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 42.389ms - ExecTreePrepareTime: 409.678us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 53 (53) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 116.282us, non-child: 116.282us, % non-child: 100.00%) - BytesSent: 5.23 KB (5358) - OverallThroughput: 43.94 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 42 (42) - SerializeBatchTime: 104.053us - UncompressedRowBatchSize: 5.23 KB (5358) CodeGen:(Total: 203.159ms, non-child: 203.159ms, % non-child: 100.00%) - CodegenTime: 23.106ms - CompileTime: 36.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.056ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.068ms SORT_NODE (id=16):(Total: 12m38s, non-child: 453.712us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 76.942us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 42 (42) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.846ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 287.874us - GetNewBlockTime: 218.957us - GetResultsTime: 136.204us - HTResizeTime: 5.533us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 904.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 368.251us, % non-child: 0.00%) - ConvertRowBatchTime: 67.148us - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 8.40 KB (8605) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.960ms - NumBatchesAccepted: 34 (34) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ae (host=foo.232.13:22000):(Total: 12m38s, non-child: 13.159ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.41 GB (1510408439) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 362.190us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 181.973ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 736.569us - ExecTreeExecTime: 5.245us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 44.647ms - ExecTreePrepareTime: 627.187us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 133.056us, non-child: 133.056us, % non-child: 100.00%) - BytesSent: 6.65 KB (6805) - OverallThroughput: 48.77 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 116.201us - UncompressedRowBatchSize: 6.65 KB (6805) CodeGen:(Total: 211.263ms, non-child: 211.263ms, % non-child: 100.00%) - CodegenTime: 22.630ms - CompileTime: 36.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 142.095ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.159ms SORT_NODE (id=16):(Total: 12m38s, non-child: 433.130us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 145.373us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.834ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 269.497us - GetNewBlockTime: 254.097us - GetResultsTime: 145.834us - HTResizeTime: 4.689us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 846.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 253.664us, % non-child: 0.00%) - ConvertRowBatchTime: 40.075us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.74 KB (11000) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.251ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002dd (host=foo.232.24:22000):(Total: 12m38s, non-child: 16.175ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.32 GB (1416421510) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 277.964us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 647.826us - ExecTreeExecTime: 6.579us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 44.505ms - ExecTreePrepareTime: 415.799us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099518336) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 110.395us, non-child: 110.395us, % non-child: 100.00%) - BytesSent: 6.12 KB (6267) - OverallThroughput: 54.14 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 98.294us - UncompressedRowBatchSize: 6.12 KB (6267) CodeGen:(Total: 219.533ms, non-child: 219.533ms, % non-child: 100.00%) - CodegenTime: 28.383ms - CompileTime: 42.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 148.023ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.975ms SORT_NODE (id=16):(Total: 12m38s, non-child: 407.699us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 94.664us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.852ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 258.615us - GetNewBlockTime: 180.395us - GetResultsTime: 157.016us - HTResizeTime: 4.451us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.028us EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 362.928us, % non-child: 0.00%) - ConvertRowBatchTime: 71.190us - PeakMemoryUsage: 0 - RowsReturned: 44 (44) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 9.71 KB (9946) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.199ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e4 (host=foo.232.22:22000):(Total: 12m38s, non-child: 11.858ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11087565) - PerHostPeakMemUsage: 1.42 GB (1527033436) - RowsProduced: 59 (59) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 411.952us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 164.975ms - TotalThreadsVoluntaryContextSwitches: 160 (160) Fragment Instance Lifecycle Timings: - ExecTime: 822.503us - ExecTreeExecTime: 6.545us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 36.232ms - ExecTreePrepareTime: 421.307us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 147.814us, non-child: 147.814us, % non-child: 100.00%) - BytesSent: 8.23 KB (8432) - OverallThroughput: 54.40 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 59 (59) - SerializeBatchTime: 126.502us - UncompressedRowBatchSize: 8.23 KB (8432) CodeGen:(Total: 188.353ms, non-child: 188.353ms, % non-child: 100.00%) - CodegenTime: 19.871ms - CompileTime: 34.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 127.968ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.657ms SORT_NODE (id=16):(Total: 12m38s, non-child: 368.868us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 55.811us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 59 (59) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.142ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 524.241us - GetNewBlockTime: 197.318us - GetResultsTime: 150.654us - HTResizeTime: 5.348us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11070592) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 59 (59) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 818.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 371.430us, % non-child: 0.00%) - ConvertRowBatchTime: 70.286us - PeakMemoryUsage: 0 - RowsReturned: 59 (59) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 13.21 KB (13526) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 6.160ms - NumBatchesAccepted: 46 (46) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a5 (host=foo.232.20:22000):(Total: 12m38s, non-child: 12.364ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.37 GB (1474452829) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 385.960us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 6.000ms - TotalThreadsUserTime: 173.974ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 866.682us - ExecTreeExecTime: 8.372us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.856ms - ExecTreePrepareTime: 392.389us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 180.303us, non-child: 180.303us, % non-child: 100.00%) - BytesSent: 6.45 KB (6604) - OverallThroughput: 34.93 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 164.786us - UncompressedRowBatchSize: 6.45 KB (6604) CodeGen:(Total: 199.086ms, non-child: 199.086ms, % non-child: 100.00%) - CodegenTime: 20.672ms - CompileTime: 37.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.465ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.559ms SORT_NODE (id=16):(Total: 12m38s, non-child: 464.769us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 89.797us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.170ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 318.290us - GetNewBlockTime: 194.327us - GetResultsTime: 168.199us - HTResizeTime: 5.386us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 19 (19) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 789.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 335.317us, % non-child: 0.00%) - ConvertRowBatchTime: 55.369us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.25 KB (10492) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.503ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d6 (host=foo.232.15:22000):(Total: 12m38s, non-child: 12.381ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.42 GB (1529109992) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 286.838us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 167.975ms - TotalThreadsVoluntaryContextSwitches: 125 (125) Fragment Instance Lifecycle Timings: - ExecTime: 920.335us - ExecTreeExecTime: 7.621us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 40.319ms - ExecTreePrepareTime: 437.724us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 309 (309) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133072768) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 220.247us, non-child: 220.247us, % non-child: 100.00%) - BytesSent: 6.65 KB (6812) - OverallThroughput: 29.50 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 196.499us - UncompressedRowBatchSize: 6.65 KB (6812) CodeGen:(Total: 192.195ms, non-child: 192.195ms, % non-child: 100.00%) - CodegenTime: 20.817ms - CompileTime: 39.566ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 123.502ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.246ms SORT_NODE (id=16):(Total: 12m38s, non-child: 415.814us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 78.260us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 5.981ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 443.494us - GetNewBlockTime: 1.203ms - GetResultsTime: 200.161us - HTResizeTime: 4.500us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 884.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 265.025us, % non-child: 0.00%) - ConvertRowBatchTime: 42.053us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.48 KB (10730) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.327ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002bf (host=foo.232.23:22000):(Total: 12m38s, non-child: 13.643ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11087565) - PerHostPeakMemUsage: 1.38 GB (1486259692) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 361.963us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 189.971ms - TotalThreadsVoluntaryContextSwitches: 97 (97) Fragment Instance Lifecycle Timings: - ExecTime: 743.598us - ExecTreeExecTime: 5.509us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 37.486ms - ExecTreePrepareTime: 267.719us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 309 (309) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133072768) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 131.567us, non-child: 131.567us, % non-child: 100.00%) - BytesSent: 7.06 KB (7232) - OverallThroughput: 52.42 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 53 (53) - SerializeBatchTime: 116.184us - UncompressedRowBatchSize: 7.06 KB (7232) CodeGen:(Total: 214.804ms, non-child: 214.804ms, % non-child: 100.00%) - CodegenTime: 22.822ms - CompileTime: 36.641ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 152.495ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.119ms SORT_NODE (id=16):(Total: 12m38s, non-child: 430.743us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 100.699us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 53 (53) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.407ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 279.529us - GetNewBlockTime: 183.424us - GetResultsTime: 144.220us - HTResizeTime: 5.203us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11070592) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 715.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 319.249us, % non-child: 0.00%) - ConvertRowBatchTime: 70.901us - PeakMemoryUsage: 0 - RowsReturned: 53 (53) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.50 KB (11776) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.549ms - NumBatchesAccepted: 46 (46) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002fe (host=foo.232.18:22000):(Total: 12m38s, non-child: 13.592ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11087565) - PerHostPeakMemUsage: 1.36 GB (1459405202) - RowsProduced: 57 (57) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 285.599us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 187.971ms - TotalThreadsVoluntaryContextSwitches: 97 (97) Fragment Instance Lifecycle Timings: - ExecTime: 679.572us - ExecTreeExecTime: 7.060us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 46.524ms - ExecTreePrepareTime: 491.154us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 151.539us, non-child: 151.539us, % non-child: 100.00%) - BytesSent: 7.83 KB (8020) - OverallThroughput: 50.47 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 57 (57) - SerializeBatchTime: 137.437us - UncompressedRowBatchSize: 7.83 KB (8020) CodeGen:(Total: 221.118ms, non-child: 221.118ms, % non-child: 100.00%) - CodegenTime: 22.584ms - CompileTime: 31.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 155.265ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 33.765ms SORT_NODE (id=16):(Total: 12m38s, non-child: 396.310us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 82.773us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 57 (57) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.812ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 313.250us - GetNewBlockTime: 177.296us - GetResultsTime: 153.265us - HTResizeTime: 5.399us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11070592) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 57 (57) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 802.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 488.831us, % non-child: 0.00%) - ConvertRowBatchTime: 103.187us - PeakMemoryUsage: 0 - RowsReturned: 57 (57) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 12.61 KB (12913) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.657ms - NumBatchesAccepted: 46 (46) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ed (host=foo.232.25:22000):(Total: 12m38s, non-child: 13.243ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.41 GB (1513013883) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 266.302us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 195.970ms - TotalThreadsVoluntaryContextSwitches: 84 (84) Fragment Instance Lifecycle Timings: - ExecTime: 632.240us - ExecTreeExecTime: 7.692us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 45.555ms - ExecTreePrepareTime: 396.638us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133069312) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 178.473us, non-child: 178.473us, % non-child: 100.00%) - BytesSent: 6.79 KB (6948) - OverallThroughput: 37.13 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 161.469us - UncompressedRowBatchSize: 6.79 KB (6948) CodeGen:(Total: 228.656ms, non-child: 228.656ms, % non-child: 100.00%) - CodegenTime: 22.926ms - CompileTime: 32.785ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 162.232ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.986ms SORT_NODE (id=16):(Total: 12m38s, non-child: 366.560us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 74.554us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.040ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 298.528us - GetNewBlockTime: 531.847us - GetResultsTime: 156.501us - HTResizeTime: 5.371us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 888.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 253.219us, % non-child: 0.00%) - ConvertRowBatchTime: 49.349us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.50 KB (10754) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.581ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a1 (host=foo.232.26:22000):(Total: 12m38s, non-child: 12.551ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11083469) - PerHostPeakMemUsage: 1.35 GB (1451386358) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 620.114us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Fragment Instance Lifecycle Timings: - ExecTime: 1.208ms - ExecTreeExecTime: 6.799us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.803ms - ExecTreePrepareTime: 393.016us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 143.635us, non-child: 143.635us, % non-child: 100.00%) - BytesSent: 6.75 KB (6908) - OverallThroughput: 45.87 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 114.103us - UncompressedRowBatchSize: 6.75 KB (6908) CodeGen:(Total: 204.909ms, non-child: 204.909ms, % non-child: 100.00%) - CodegenTime: 20.062ms - CompileTime: 33.227ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.454ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.756ms SORT_NODE (id=16):(Total: 12m38s, non-child: 351.638us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 69.044us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.971ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 408.330us - GetNewBlockTime: 174.193us - GetResultsTime: 168.640us - HTResizeTime: 4.366us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11066496) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 880.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 289.750us, % non-child: 0.00%) - ConvertRowBatchTime: 54.950us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 10.85 KB (11109) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.245ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b5 (host=foo.232.27:22000):(Total: 12m38s, non-child: 11.931ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.34 GB (1442870921) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 357.241us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 699.520us - ExecTreeExecTime: 7.781us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.837ms - ExecTreePrepareTime: 414.710us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 142.969us, non-child: 142.969us, % non-child: 100.00%) - BytesSent: 7.17 KB (7346) - OverallThroughput: 49.00 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 53 (53) - SerializeBatchTime: 124.347us - UncompressedRowBatchSize: 7.17 KB (7346) CodeGen:(Total: 193.437ms, non-child: 193.437ms, % non-child: 100.00%) - CodegenTime: 19.935ms - CompileTime: 32.272ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.051ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.624ms SORT_NODE (id=16):(Total: 12m38s, non-child: 381.517us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 88.633us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 53 (53) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.355ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 235.126us - GetNewBlockTime: 164.225us - GetResultsTime: 136.382us - HTResizeTime: 4.614us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 811.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 300.350us, % non-child: 0.00%) - ConvertRowBatchTime: 52.168us - PeakMemoryUsage: 0 - RowsReturned: 53 (53) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m38s - TotalBytesReceived: 11.40 KB (11677) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.928ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d2 (host=foo.232.14:22000):(Total: 12m38s, non-child: 12.337ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.35 GB (1446295791) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 364.731us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 789.989us - ExecTreeExecTime: 5.911us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.757ms - ExecTreePrepareTime: 486.145us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 54 (54) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.007us, non-child: 119.007us, % non-child: 100.00%) - BytesSent: 6.44 KB (6594) - OverallThroughput: 52.84 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 104.829us - UncompressedRowBatchSize: 6.44 KB (6594) CodeGen:(Total: 202.302ms, non-child: 202.302ms, % non-child: 100.00%) - CodegenTime: 20.711ms - CompileTime: 34.722ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 142.933ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.142ms SORT_NODE (id=16):(Total: 12m38s, non-child: 479.587us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 73.651us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.726ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 265.753us - GetNewBlockTime: 185.058us - GetResultsTime: 122.991us - HTResizeTime: 5.726us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 785.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 453.856us, % non-child: 0.00%) - ConvertRowBatchTime: 86.165us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.56 KB (10810) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 5.434ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030f (host=foo.232.35:22000):(Total: 12m38s, non-child: 12.505ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11087565) - PerHostPeakMemUsage: 1.30 GB (1400725701) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 377.645us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 167.975ms - TotalThreadsVoluntaryContextSwitches: 100 (100) Fragment Instance Lifecycle Timings: - ExecTime: 796.313us - ExecTreeExecTime: 6.686us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 41.812ms - ExecTreePrepareTime: 310.904us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 55 (55) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.445us, non-child: 139.445us, % non-child: 100.00%) - BytesSent: 6.67 KB (6828) - OverallThroughput: 46.70 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 122.406us - UncompressedRowBatchSize: 6.67 KB (6828) CodeGen:(Total: 194.124ms, non-child: 194.124ms, % non-child: 100.00%) - CodegenTime: 20.940ms - CompileTime: 29.351ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 134.013ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.154ms SORT_NODE (id=16):(Total: 12m38s, non-child: 425.597us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 109.229us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.424ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 275.940us - GetNewBlockTime: 150.488us - GetResultsTime: 149.395us - HTResizeTime: 5.135us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11070592) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 728.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 469.817us, % non-child: 0.00%) - ConvertRowBatchTime: 87.492us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.02 KB (11283) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.267ms - NumBatchesAccepted: 47 (47) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029e (host=foo.232.28:22000):(Total: 12m38s, non-child: 11.609ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.43 GB (1534517528) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 641.578us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 64 (64) Fragment Instance Lifecycle Timings: - ExecTime: 1.061ms - ExecTreeExecTime: 7.110us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 36.533ms - ExecTreePrepareTime: 362.063us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 312 (312) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.08 GB (1158238592) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 75.893us, non-child: 75.893us, % non-child: 100.00%) - BytesSent: 6.17 KB (6313) - OverallThroughput: 79.33 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 63.765us - UncompressedRowBatchSize: 6.17 KB (6313) CodeGen:(Total: 190.150ms, non-child: 190.150ms, % non-child: 100.00%) - CodegenTime: 18.862ms - CompileTime: 36.038ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 127.635ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.098ms SORT_NODE (id=16):(Total: 12m38s, non-child: 736.355us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 194.568us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 5.708ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 314.453us - GetNewBlockTime: 224.335us - GetResultsTime: 246.509us - HTResizeTime: 5.103us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 878.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 294.465us, % non-child: 0.00%) - ConvertRowBatchTime: 54.462us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.02 KB (10257) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.895ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f6 (host=foo.232.21:22000):(Total: 12m38s, non-child: 11.544ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11050701) - PerHostPeakMemUsage: 1.39 GB (1494598744) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 324.052us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 691.860us - ExecTreeExecTime: 5.796us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 43.003ms - ExecTreePrepareTime: 332.606us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 308 (308) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124684160) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 130.120us, non-child: 130.120us, % non-child: 100.00%) - BytesSent: 6.24 KB (6390) - OverallThroughput: 46.83 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 115.897us - UncompressedRowBatchSize: 6.24 KB (6390) CodeGen:(Total: 200.105ms, non-child: 200.105ms, % non-child: 100.00%) - CodegenTime: 19.949ms - CompileTime: 29.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.433ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.267ms SORT_NODE (id=16):(Total: 12m38s, non-child: 406.176us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 117.434us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.359ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 237.847us - GetNewBlockTime: 189.908us - GetResultsTime: 137.173us - HTResizeTime: 5.161us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11033728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 933.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 284.717us, % non-child: 0.00%) - ConvertRowBatchTime: 50.461us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.87 KB (10111) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.688ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d3 (host=foo.232.19:22000):(Total: 12m38s, non-child: 11.614ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11042509) - PerHostPeakMemUsage: 1.36 GB (1462073058) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 327.369us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 736.514us - ExecTreeExecTime: 6.561us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 35.830ms - ExecTreePrepareTime: 352.337us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099518336) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 120.839us, non-child: 120.839us, % non-child: 100.00%) - BytesSent: 6.22 KB (6368) - OverallThroughput: 50.26 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 107.833us - UncompressedRowBatchSize: 6.22 KB (6368) CodeGen:(Total: 183.566ms, non-child: 183.566ms, % non-child: 100.00%) - CodegenTime: 19.706ms - CompileTime: 29.820ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 128.393ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.874ms SORT_NODE (id=16):(Total: 12m38s, non-child: 437.470us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 141.885us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.772ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 263.271us - GetNewBlockTime: 174.375us - GetResultsTime: 147.083us - HTResizeTime: 5.614us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11025536) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 744.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 415.868us, % non-child: 0.00%) - ConvertRowBatchTime: 86.355us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.89 KB (10130) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 4.458ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b6 (host=foo.232.30:22000):(Total: 12m38s, non-child: 13.400ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.40 GB (1502874196) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 485.124us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 201.970ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 957.822us - ExecTreeExecTime: 6.372us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 38.986ms - ExecTreePrepareTime: 356.107us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 128.285us, non-child: 128.285us, % non-child: 100.00%) - BytesSent: 6.55 KB (6707) - OverallThroughput: 49.86 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 115.069us - UncompressedRowBatchSize: 6.55 KB (6707) CodeGen:(Total: 225.072ms, non-child: 225.072ms, % non-child: 100.00%) - CodegenTime: 22.667ms - CompileTime: 46.525ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 151.349ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.668ms SORT_NODE (id=16):(Total: 12m38s, non-child: 399.776us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 80.620us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.248ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 404.255us - GetNewBlockTime: 270.904us - GetResultsTime: 147.107us - HTResizeTime: 5.427us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 400.090us, % non-child: 0.00%) - ConvertRowBatchTime: 82.366us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.48 KB (10732) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.584ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c7 (host=foo.232.33:22000):(Total: 12m38s, non-child: 16.277ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.43 GB (1538772744) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 408.097us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 179.973ms - TotalThreadsVoluntaryContextSwitches: 63 (63) Fragment Instance Lifecycle Timings: - ExecTime: 831.659us - ExecTreeExecTime: 7.464us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 40.791ms - ExecTreePrepareTime: 364.971us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 308 (308) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124684160) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 141.816us, non-child: 141.816us, % non-child: 100.00%) - BytesSent: 7.04 KB (7205) - OverallThroughput: 48.45 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 127.838us - UncompressedRowBatchSize: 7.04 KB (7205) CodeGen:(Total: 202.642ms, non-child: 202.642ms, % non-child: 100.00%) - CodegenTime: 28.737ms - CompileTime: 31.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 145.070ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.478ms SORT_NODE (id=16):(Total: 12m38s, non-child: 615.572us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 86.108us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.225ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 282.661us - GetNewBlockTime: 186.239us - GetResultsTime: 191.293us - HTResizeTime: 5.526us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 823.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 404.338us, % non-child: 0.00%) - ConvertRowBatchTime: 67.231us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.20 KB (11466) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 3.835ms - NumBatchesAccepted: 40 (40) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002cb (host=foo.232.32:22000):(Total: 12m38s, non-child: 12.930ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11087565) - PerHostPeakMemUsage: 1.42 GB (1522909179) - RowsProduced: 61 (61) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 357.508us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 106 (106) Fragment Instance Lifecycle Timings: - ExecTime: 1.006ms - ExecTreeExecTime: 10.915us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.931ms - ExecTreePrepareTime: 351.949us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 311 (311) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.07 GB (1149849984) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 211.957us, non-child: 211.957us, % non-child: 100.00%) - BytesSent: 7.86 KB (8044) - OverallThroughput: 36.19 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 61 (61) - SerializeBatchTime: 190.457us - UncompressedRowBatchSize: 7.86 KB (8044) CodeGen:(Total: 197.694ms, non-child: 197.694ms, % non-child: 100.00%) - CodegenTime: 22.362ms - CompileTime: 34.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 134.606ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.990ms SORT_NODE (id=16):(Total: 12m38s, non-child: 1.230ms, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 620.418us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 61 (61) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 6.371ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 333.149us - GetNewBlockTime: 548.013us - GetResultsTime: 276.188us - HTResizeTime: 5.827us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11070592) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 61 (61) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 909.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 463.568us, % non-child: 0.00%) - ConvertRowBatchTime: 86.851us - PeakMemoryUsage: 0 - RowsReturned: 61 (61) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.72 KB (13028) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 5.258ms - NumBatchesAccepted: 47 (47) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a9 (host=foo.232.31:22000):(Total: 12m38s, non-child: 12.817ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.51 MB (11022029) - PerHostPeakMemUsage: 1.42 GB (1528772547) - RowsProduced: 38 (38) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 335.486us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 68 (68) Fragment Instance Lifecycle Timings: - ExecTime: 698.961us - ExecTreeExecTime: 5.289us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 36.800ms - ExecTreePrepareTime: 360.118us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 110.378us, non-child: 110.378us, % non-child: 100.00%) - BytesSent: 5.32 KB (5447) - OverallThroughput: 47.06 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 38 (38) - SerializeBatchTime: 95.644us - UncompressedRowBatchSize: 5.32 KB (5447) CodeGen:(Total: 215.565ms, non-child: 215.565ms, % non-child: 100.00%) - CodegenTime: 21.674ms - CompileTime: 35.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 153.894ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.484ms SORT_NODE (id=16):(Total: 12m38s, non-child: 468.162us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 105.742us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 38 (38) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.740ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 205.630us - GetNewBlockTime: 202.185us - GetResultsTime: 120.811us - HTResizeTime: 4.492us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11005056) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 38 (38) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 798.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 216.609us, % non-child: 0.00%) - ConvertRowBatchTime: 35.046us - PeakMemoryUsage: 0 - RowsReturned: 38 (38) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 8.39 KB (8593) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 1.372ms - NumBatchesAccepted: 31 (31) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a2 (host=foo.232.29:22000):(Total: 12m38s, non-child: 12.216ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.40 GB (1507296406) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 366.205us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 162.976ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 853.648us - ExecTreeExecTime: 5.983us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 42.456ms - ExecTreePrepareTime: 426.652us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 118.581us, non-child: 118.581us, % non-child: 100.00%) - BytesSent: 6.03 KB (6178) - OverallThroughput: 49.69 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 97.291us - UncompressedRowBatchSize: 6.03 KB (6178) CodeGen:(Total: 191.333ms, non-child: 191.333ms, % non-child: 100.00%) - CodegenTime: 20.296ms - CompileTime: 31.920ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 127.426ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 31.425ms SORT_NODE (id=16):(Total: 12m38s, non-child: 346.699us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 50.849us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 4.408ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 365.601us - GetNewBlockTime: 197.474us - GetResultsTime: 137.140us - HTResizeTime: 5.559us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 757.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 311.053us, % non-child: 0.00%) - ConvertRowBatchTime: 60.179us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.50 KB (9724) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.388ms - NumBatchesAccepted: 34 (34) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a0 (host=foo.232.34:22000):(Total: 12m38s, non-child: 13.002ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.59 MB (11103949) - PerHostPeakMemUsage: 1.42 GB (1529787983) - RowsProduced: 60 (60) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 594.007us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 7.999ms - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 121 (121) Fragment Instance Lifecycle Timings: - ExecTime: 988.084us - ExecTreeExecTime: 5.275us - OpenTime: 12m38s - ExecTreeOpenTime: 12m38s - PrepareTime: 39.910ms - ExecTreePrepareTime: 406.551us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 162.842us, non-child: 162.842us, % non-child: 100.00%) - BytesSent: 7.79 KB (7972) - OverallThroughput: 46.69 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 60 (60) - SerializeBatchTime: 138.449us - UncompressedRowBatchSize: 7.79 KB (7972) CodeGen:(Total: 216.630ms, non-child: 216.630ms, % non-child: 100.00%) - CodegenTime: 22.071ms - CompileTime: 42.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 144.959ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.143ms SORT_NODE (id=16):(Total: 12m38s, non-child: 314.348us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 61.026us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 60 (60) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m38s, non-child: 3.659ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 380.764us - GetNewBlockTime: 156.734us - GetResultsTime: 147.055us - HTResizeTime: 5.271us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.57 MB (11086976) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 60 (60) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 827.000ns EXCHANGE_NODE (id=26):(Total: 12m38s, non-child: 267.396us, % non-child: 0.00%) - ConvertRowBatchTime: 47.991us - PeakMemoryUsage: 0 - RowsReturned: 60 (60) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.82 KB (13124) - TotalGetBatchTime: 12m38s - DataArrivalTimer: 12m38s SenderSide: - DeserializeRowBatchTimer: 2.041ms - NumBatchesAccepted: 51 (51) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ff (host=foo.232.17:22000):(Total: 12m38s, non-child: 24.549ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.41 GB (1512670434) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 417.740us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 173.974ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 888.652us - ExecTreeExecTime: 6.802us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 54.390ms - ExecTreePrepareTime: 545.457us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 308 (308) - BlocksRecycled: 51 (51) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124684160) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 159.585us, non-child: 159.585us, % non-child: 100.00%) - BytesSent: 7.39 KB (7563) - OverallThroughput: 45.20 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 55 (55) - SerializeBatchTime: 144.075us - UncompressedRowBatchSize: 7.39 KB (7563) CodeGen:(Total: 204.420ms, non-child: 204.420ms, % non-child: 100.00%) - CodegenTime: 42.526ms - CompileTime: 33.910ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.649ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.135ms SORT_NODE (id=16):(Total: 12m37s, non-child: 383.689us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 110.108us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 55 (55) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 5.728ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 287.142us - GetNewBlockTime: 2.129ms - GetResultsTime: 151.395us - HTResizeTime: 5.253us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 924.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 438.619us, % non-child: 0.00%) - ConvertRowBatchTime: 78.703us - PeakMemoryUsage: 0 - RowsReturned: 55 (55) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.94 KB (12228) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.583ms - NumBatchesAccepted: 44 (44) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030c (host=foo.232.39:22000):(Total: 12m38s, non-child: 12.710ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11050701) - PerHostPeakMemUsage: 1.33 GB (1428372172) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 366.273us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 108 (108) Fragment Instance Lifecycle Timings: - ExecTime: 677.025us - ExecTreeExecTime: 5.683us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 38.207ms - ExecTreePrepareTime: 336.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 308 (308) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124684160) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 108.921us, non-child: 108.921us, % non-child: 100.00%) - BytesSent: 5.91 KB (6047) - OverallThroughput: 52.95 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 94.107us - UncompressedRowBatchSize: 5.91 KB (6047) CodeGen:(Total: 198.530ms, non-child: 198.530ms, % non-child: 100.00%) - CodegenTime: 21.677ms - CompileTime: 35.508ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.175ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.199ms SORT_NODE (id=16):(Total: 12m37s, non-child: 337.442us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 69.889us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.788ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 265.769us - GetNewBlockTime: 704.996us - GetResultsTime: 125.693us - HTResizeTime: 5.524us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11033728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.010us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 340.667us, % non-child: 0.00%) - ConvertRowBatchTime: 63.331us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.51 KB (9734) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.926ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f7 (host=foo.232.46:22000):(Total: 12m38s, non-child: 12.679ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.27 GB (1359098584) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 286.357us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 81 (81) Fragment Instance Lifecycle Timings: - ExecTime: 631.678us - ExecTreeExecTime: 5.994us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 38.423ms - ExecTreePrepareTime: 384.275us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 301 (301) - BlocksRecycled: 57 (57) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 127.801us, non-child: 127.801us, % non-child: 100.00%) - BytesSent: 6.75 KB (6917) - OverallThroughput: 51.62 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 115.726us - UncompressedRowBatchSize: 6.75 KB (6917) CodeGen:(Total: 194.032ms, non-child: 194.032ms, % non-child: 100.00%) - CodegenTime: 22.091ms - CompileTime: 33.745ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.303ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.451ms SORT_NODE (id=16):(Total: 12m37s, non-child: 403.182us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 108.445us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.324ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 291.384us - GetNewBlockTime: 212.103us - GetResultsTime: 151.537us - HTResizeTime: 5.338us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 935.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 345.842us, % non-child: 0.00%) - ConvertRowBatchTime: 58.531us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.84 KB (11103) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.818ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002fd (host=foo.232.48:22000):(Total: 12m38s, non-child: 11.797ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.35 GB (1451278507) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 338.892us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 170.974ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 658.235us - ExecTreeExecTime: 5.725us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 34.724ms - ExecTreePrepareTime: 408.308us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 305 (305) - BlocksRecycled: 53 (53) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 72.802us, non-child: 72.802us, % non-child: 100.00%) - BytesSent: 6.36 KB (6508) - OverallThroughput: 85.25 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 54.326us - UncompressedRowBatchSize: 6.36 KB (6508) CodeGen:(Total: 195.167ms, non-child: 195.167ms, % non-child: 100.00%) - CodegenTime: 19.649ms - CompileTime: 33.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 137.422ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.524ms SORT_NODE (id=16):(Total: 12m37s, non-child: 325.503us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 51.578us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.728ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 501.526us - GetNewBlockTime: 178.134us - GetResultsTime: 140.952us - HTResizeTime: 5.774us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 726.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 323.915us, % non-child: 0.00%) - ConvertRowBatchTime: 55.146us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.06 KB (10297) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.946ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e2 (host=foo.232.45:22000):(Total: 12m38s, non-child: 12.216ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.33 GB (1424343503) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 355.284us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 687.619us - ExecTreeExecTime: 5.983us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 37.243ms - ExecTreePrepareTime: 385.972us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 108.715us, non-child: 108.715us, % non-child: 100.00%) - BytesSent: 6.43 KB (6581) - OverallThroughput: 57.73 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 88.215us - UncompressedRowBatchSize: 6.43 KB (6581) CodeGen:(Total: 201.579ms, non-child: 201.579ms, % non-child: 100.00%) - CodegenTime: 20.896ms - CompileTime: 36.052ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.328ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.669ms SORT_NODE (id=16):(Total: 12m37s, non-child: 484.669us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 60.369us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.836ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 238.098us - GetNewBlockTime: 182.514us - GetResultsTime: 138.136us - HTResizeTime: 4.715us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 827.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 282.233us, % non-child: 0.00%) - ConvertRowBatchTime: 42.540us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.29 KB (10539) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.399ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f4 (host=foo.232.49:22000):(Total: 12m38s, non-child: 14.690ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11075277) - PerHostPeakMemUsage: 1.41 GB (1511109593) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 276.605us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 168.974ms - TotalThreadsVoluntaryContextSwitches: 187 (187) Fragment Instance Lifecycle Timings: - ExecTime: 656.490us - ExecTreeExecTime: 5.155us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 38.398ms - ExecTreePrepareTime: 457.186us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 49 (49) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 127.881us, non-child: 127.881us, % non-child: 100.00%) - BytesSent: 7.34 KB (7516) - OverallThroughput: 56.05 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 56 (56) - SerializeBatchTime: 112.783us - UncompressedRowBatchSize: 7.34 KB (7516) CodeGen:(Total: 192.071ms, non-child: 192.071ms, % non-child: 100.00%) - CodegenTime: 26.035ms - CompileTime: 33.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.705ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.842ms SORT_NODE (id=16):(Total: 12m37s, non-child: 406.147us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 54.816us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 56 (56) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.750ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 302.270us - GetNewBlockTime: 185.193us - GetResultsTime: 134.682us - HTResizeTime: 4.861us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11058304) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 735.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 266.509us, % non-child: 0.00%) - ConvertRowBatchTime: 41.100us - PeakMemoryUsage: 0 - RowsReturned: 56 (56) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.91 KB (12199) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.082ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002dc (host=foo.232.37:22000):(Total: 12m38s, non-child: 12.419ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.34 GB (1437776842) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 255.870us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 188.972ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 640.595us - ExecTreeExecTime: 5.944us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 34.755ms - ExecTreePrepareTime: 574.960us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 304 (304) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 115.834us, non-child: 115.834us, % non-child: 100.00%) - BytesSent: 5.92 KB (6061) - OverallThroughput: 49.90 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 96.165us - UncompressedRowBatchSize: 5.92 KB (6061) CodeGen:(Total: 209.986ms, non-child: 209.986ms, % non-child: 100.00%) - CodegenTime: 21.088ms - CompileTime: 34.377ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 152.142ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 22.937ms SORT_NODE (id=16):(Total: 12m37s, non-child: 390.752us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 118.654us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.533ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 245.789us - GetNewBlockTime: 243.448us - GetResultsTime: 144.022us - HTResizeTime: 17.043us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 824.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 284.691us, % non-child: 0.00%) - ConvertRowBatchTime: 50.669us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.64 KB (9870) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.574ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e1 (host=foo.232.42:22000):(Total: 12m38s, non-child: 12.134ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11030221) - PerHostPeakMemUsage: 1.22 GB (1314224634) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 317.196us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m38s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 173.974ms - TotalThreadsVoluntaryContextSwitches: 66 (66) Fragment Instance Lifecycle Timings: - ExecTime: 633.394us - ExecTreeExecTime: 6.101us - OpenTime: 12m38s - ExecTreeOpenTime: 12m37s - PrepareTime: 41.893ms - ExecTreePrepareTime: 385.524us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 297 (297) - BlocksRecycled: 61 (61) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 113.772us, non-child: 113.772us, % non-child: 100.00%) - BytesSent: 6.24 KB (6394) - OverallThroughput: 53.60 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 95.232us - UncompressedRowBatchSize: 6.24 KB (6394) CodeGen:(Total: 202.890ms, non-child: 202.890ms, % non-child: 100.00%) - CodegenTime: 20.615ms - CompileTime: 32.655ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.295ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.487ms SORT_NODE (id=16):(Total: 12m37s, non-child: 374.439us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 105.495us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.970ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 262.788us - GetNewBlockTime: 229.896us - GetResultsTime: 144.660us - HTResizeTime: 6.216us - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11013248) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 15.610us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 317.805us, % non-child: 0.00%) - ConvertRowBatchTime: 61.235us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.77 KB (10006) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.448ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b7 (host=foo.232.36:22000):(Total: 12m38s, non-child: 13.035ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.59 MB (11108045) - PerHostPeakMemUsage: 1.26 GB (1351808176) - RowsProduced: 57 (57) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 442.528us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 173.973ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 1.000ms - ExecTreeExecTime: 5.974us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 40.824ms - ExecTreePrepareTime: 343.125us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 299 (299) - BlocksRecycled: 58 (58) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 162.800us, non-child: 162.800us, % non-child: 100.00%) - BytesSent: 7.85 KB (8039) - OverallThroughput: 47.09 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 57 (57) - SerializeBatchTime: 150.284us - UncompressedRowBatchSize: 7.85 KB (8039) CodeGen:(Total: 200.658ms, non-child: 200.658ms, % non-child: 100.00%) - CodegenTime: 22.200ms - CompileTime: 32.266ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 138.916ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.051ms SORT_NODE (id=16):(Total: 12m37s, non-child: 501.126us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 51.183us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 57 (57) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.754ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 338.983us - GetNewBlockTime: 184.082us - GetResultsTime: 146.444us - HTResizeTime: 5.109us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.58 MB (11091072) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 57 (57) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 837.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 407.556us, % non-child: 0.00%) - ConvertRowBatchTime: 59.513us - PeakMemoryUsage: 0 - RowsReturned: 57 (57) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.88 KB (13194) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.539ms - NumBatchesAccepted: 51 (51) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029b (host=foo.232.44:22000):(Total: 12m38s, non-child: 12.566ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11083469) - PerHostPeakMemUsage: 1.36 GB (1459149788) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 736.089us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 168.975ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 1.135ms - ExecTreeExecTime: 7.177us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.886ms - ExecTreePrepareTime: 395.137us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 140.582us, non-child: 140.582us, % non-child: 100.00%) - BytesSent: 6.73 KB (6889) - OverallThroughput: 46.73 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 126.104us - UncompressedRowBatchSize: 6.73 KB (6889) CodeGen:(Total: 193.066ms, non-child: 193.066ms, % non-child: 100.00%) - CodegenTime: 20.386ms - CompileTime: 30.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.688ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.347ms SORT_NODE (id=16):(Total: 12m37s, non-child: 451.880us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 118.446us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.744ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 280.275us - GetNewBlockTime: 182.781us - GetResultsTime: 152.065us - HTResizeTime: 4.292us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11066496) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 769.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 525.884us, % non-child: 0.00%) - ConvertRowBatchTime: 115.910us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.96 KB (11220) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.748ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002cc (host=foo.232.40:22000):(Total: 12m38s, non-child: 18.015ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.36 GB (1459154958) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 366.339us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 157.976ms - TotalThreadsVoluntaryContextSwitches: 75 (75) Fragment Instance Lifecycle Timings: - ExecTime: 873.733us - ExecTreeExecTime: 6.912us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 44.557ms - ExecTreePrepareTime: 429.373us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 140.408us, non-child: 140.408us, % non-child: 100.00%) - BytesSent: 7.15 KB (7324) - OverallThroughput: 49.75 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 128.185us - UncompressedRowBatchSize: 7.15 KB (7324) CodeGen:(Total: 184.319ms, non-child: 184.319ms, % non-child: 100.00%) - CodegenTime: 31.767ms - CompileTime: 29.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 126.301ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.486ms SORT_NODE (id=16):(Total: 12m37s, non-child: 420.623us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 97.125us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.366ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 447.734us - GetNewBlockTime: 170.094us - GetResultsTime: 160.447us - HTResizeTime: 5.859us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 624.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 533.701us, % non-child: 0.00%) - ConvertRowBatchTime: 106.097us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.64 KB (11922) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.136ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e6 (host=foo.232.41:22000):(Total: 12m38s, non-child: 13.816ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11062989) - PerHostPeakMemUsage: 1.24 GB (1330584364) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 436.783us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 172.974ms - TotalThreadsVoluntaryContextSwitches: 73 (73) Fragment Instance Lifecycle Timings: - ExecTime: 824.331us - ExecTreeExecTime: 6.669us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 47.550ms - ExecTreePrepareTime: 444.111us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 299 (299) - BlocksRecycled: 60 (60) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 111.525us, non-child: 111.525us, % non-child: 100.00%) - BytesSent: 5.92 KB (6060) - OverallThroughput: 51.82 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 95.384us - UncompressedRowBatchSize: 5.92 KB (6060) CodeGen:(Total: 204.072ms, non-child: 204.072ms, % non-child: 100.00%) - CodegenTime: 22.796ms - CompileTime: 33.662ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 134.421ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 35.443ms SORT_NODE (id=16):(Total: 12m37s, non-child: 458.083us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 77.647us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.742ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 265.485us - GetNewBlockTime: 188.880us - GetResultsTime: 133.799us - HTResizeTime: 6.058us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11046016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 831.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 454.230us, % non-child: 0.00%) - ConvertRowBatchTime: 92.734us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.72 KB (9957) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 5.087ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002a3 (host=foo.232.43:22000):(Total: 12m37s, non-child: 12.403ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.43 GB (1530522299) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 490.593us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 197.970ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Fragment Instance Lifecycle Timings: - ExecTime: 932.651us - ExecTreeExecTime: 8.266us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 37.957ms - ExecTreePrepareTime: 334.858us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 48 (48) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 140.580us, non-child: 140.580us, % non-child: 100.00%) - BytesSent: 6.34 KB (6494) - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 115.974us - UncompressedRowBatchSize: 6.34 KB (6494) CodeGen:(Total: 225.450ms, non-child: 225.450ms, % non-child: 100.00%) - CodegenTime: 20.194ms - CompileTime: 47.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 151.051ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.464ms SORT_NODE (id=16):(Total: 12m37s, non-child: 430.943us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 68.078us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.912ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 387.526us - GetNewBlockTime: 210.603us - GetResultsTime: 160.944us - HTResizeTime: 5.034us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 762.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 324.117us, % non-child: 0.00%) - ConvertRowBatchTime: 59.146us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.25 KB (10494) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.813ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000313 (host=foo.234.36:22000):(Total: 12m37s, non-child: 11.159ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.21 GB (1300992377) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 456.563us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 200.969ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 849.741us - ExecTreeExecTime: 7.149us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 35.485ms - ExecTreePrepareTime: 375.364us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 82 (82) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 121.620us, non-child: 121.620us, % non-child: 100.00%) - BytesSent: 6.05 KB (6199) - OverallThroughput: 48.61 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 107.468us - UncompressedRowBatchSize: 6.05 KB (6199) CodeGen:(Total: 223.148ms, non-child: 223.148ms, % non-child: 100.00%) - CodegenTime: 18.817ms - CompileTime: 41.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 156.504ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.961ms SORT_NODE (id=16):(Total: 12m37s, non-child: 442.373us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 112.186us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.427ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 418.876us - GetNewBlockTime: 176.356us - GetResultsTime: 197.128us - HTResizeTime: 5.740us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 870.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 326.486us, % non-child: 0.00%) - ConvertRowBatchTime: 55.829us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.87 KB (10109) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.210ms - NumBatchesAccepted: 40 (40) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000030b (host=foo.234.42:22000):(Total: 12m37s, non-child: 12.547ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.31 GB (1403897182) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 454.840us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 173.973ms - TotalThreadsVoluntaryContextSwitches: 83 (83) Fragment Instance Lifecycle Timings: - ExecTime: 831.135us - ExecTreeExecTime: 6.168us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 41.040ms - ExecTreePrepareTime: 504.553us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 290 (290) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 127.788us, non-child: 127.788us, % non-child: 100.00%) - BytesSent: 6.78 KB (6939) - OverallThroughput: 51.79 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 53 (53) - SerializeBatchTime: 115.687us - UncompressedRowBatchSize: 6.78 KB (6939) CodeGen:(Total: 200.460ms, non-child: 200.460ms, % non-child: 100.00%) - CodegenTime: 21.310ms - CompileTime: 35.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 135.275ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.374ms SORT_NODE (id=16):(Total: 12m37s, non-child: 432.476us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 113.644us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 53 (53) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.682ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 278.202us - GetNewBlockTime: 211.043us - GetResultsTime: 148.312us - HTResizeTime: 4.983us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 857.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 427.405us, % non-child: 0.00%) - ConvertRowBatchTime: 69.249us - PeakMemoryUsage: 0 - RowsReturned: 53 (53) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.33 KB (11598) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.538ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ec (host=foo.234.40:22000):(Total: 12m37s, non-child: 12.197ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.30 GB (1393390360) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 423.399us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 189.971ms - TotalThreadsVoluntaryContextSwitches: 131 (131) Fragment Instance Lifecycle Timings: - ExecTime: 831.475us - ExecTreeExecTime: 6.856us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 39.389ms - ExecTreePrepareTime: 286.239us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 140.590us, non-child: 140.590us, % non-child: 100.00%) - BytesSent: 7.44 KB (7620) - OverallThroughput: 51.69 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 54 (54) - SerializeBatchTime: 133.219us - UncompressedRowBatchSize: 7.44 KB (7620) CodeGen:(Total: 214.257ms, non-child: 214.257ms, % non-child: 100.00%) - CodegenTime: 20.700ms - CompileTime: 45.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.398ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.172ms SORT_NODE (id=16):(Total: 12m37s, non-child: 408.913us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 128.725us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 54 (54) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 5.175ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 360.440us - GetNewBlockTime: 1.319ms - GetResultsTime: 139.517us - HTResizeTime: 6.513us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 16 (16) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.173us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 332.294us, % non-child: 0.00%) - ConvertRowBatchTime: 63.701us - PeakMemoryUsage: 0 - RowsReturned: 54 (54) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.91 KB (12196) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.905ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b3 (host=foo.234.43:22000):(Total: 12m37s, non-child: 13.451ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11042509) - PerHostPeakMemUsage: 1.31 GB (1402606304) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 549.205us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 162.975ms - TotalThreadsVoluntaryContextSwitches: 102 (102) Fragment Instance Lifecycle Timings: - ExecTime: 1.026ms - ExecTreeExecTime: 5.886us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 43.972ms - ExecTreePrepareTime: 437.619us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 290 (290) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.000us, non-child: 119.000us, % non-child: 100.00%) - BytesSent: 5.99 KB (6135) - OverallThroughput: 49.17 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 99.372us - UncompressedRowBatchSize: 5.99 KB (6135) CodeGen:(Total: 192.175ms, non-child: 192.175ms, % non-child: 100.00%) - CodegenTime: 21.982ms - CompileTime: 31.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 128.599ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.072ms SORT_NODE (id=16):(Total: 12m37s, non-child: 373.585us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 80.976us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.162ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 239.932us - GetNewBlockTime: 468.783us - GetResultsTime: 115.459us - HTResizeTime: 4.607us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11025536) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 753.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 362.752us, % non-child: 0.00%) - ConvertRowBatchTime: 66.910us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.52 KB (9749) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.840ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000309 (host=foo.234.39:22000):(Total: 12m37s, non-child: 12.736ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.30 GB (1392426219) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 275.579us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 171.973ms - TotalThreadsVoluntaryContextSwitches: 67 (67) Fragment Instance Lifecycle Timings: - ExecTime: 647.268us - ExecTreeExecTime: 6.277us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 44.001ms - ExecTreePrepareTime: 975.581us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 293 (293) - BlocksRecycled: 62 (62) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 119.164us, non-child: 119.164us, % non-child: 100.00%) - BytesSent: 5.77 KB (5905) - OverallThroughput: 47.26 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 40 (40) - SerializeBatchTime: 106.021us - UncompressedRowBatchSize: 5.77 KB (5905) CodeGen:(Total: 203.229ms, non-child: 203.229ms, % non-child: 100.00%) - CodegenTime: 21.382ms - CompileTime: 39.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 131.390ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 31.395ms SORT_NODE (id=16):(Total: 12m37s, non-child: 259.563us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 32.910us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 40 (40) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.700ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 317.696us - GetNewBlockTime: 253.043us - GetResultsTime: 115.019us - HTResizeTime: 4.235us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 792.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 269.895us, % non-child: 0.00%) - ConvertRowBatchTime: 38.903us - PeakMemoryUsage: 0 - RowsReturned: 40 (40) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.04 KB (9256) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.131ms - NumBatchesAccepted: 36 (36) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b9 (host=foo.234.37:22000):(Total: 12m37s, non-child: 15.119ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.30 GB (1398836132) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 536.418us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 169.974ms - TotalThreadsVoluntaryContextSwitches: 150 (150) Fragment Instance Lifecycle Timings: - ExecTime: 859.695us - ExecTreeExecTime: 5.105us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 48.233ms - ExecTreePrepareTime: 343.603us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 299 (299) - BlocksRecycled: 59 (59) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 108.173us, non-child: 108.173us, % non-child: 100.00%) - BytesSent: 5.63 KB (5763) - OverallThroughput: 50.81 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 41 (41) - SerializeBatchTime: 86.509us - UncompressedRowBatchSize: 5.63 KB (5763) CodeGen:(Total: 201.772ms, non-child: 201.772ms, % non-child: 100.00%) - CodegenTime: 25.786ms - CompileTime: 33.307ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.018ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 34.759ms SORT_NODE (id=16):(Total: 12m37s, non-child: 366.521us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 81.600us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 41 (41) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.682ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 212.543us - GetNewBlockTime: 1.467ms - GetResultsTime: 141.227us - HTResizeTime: 4.290us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.169us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 167.805us, % non-child: 0.00%) - ConvertRowBatchTime: 29.037us - PeakMemoryUsage: 0 - RowsReturned: 41 (41) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 8.96 KB (9174) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.523ms - NumBatchesAccepted: 38 (38) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c1 (host=foo.234.38:22000):(Total: 12m37s, non-child: 12.337ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.51 MB (11022029) - PerHostPeakMemUsage: 1.22 GB (1311282730) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 367.864us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 155.976ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Fragment Instance Lifecycle Timings: - ExecTime: 816.343us - ExecTreeExecTime: 5.546us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 41.569ms - ExecTreePrepareTime: 388.047us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 121.196us, non-child: 121.196us, % non-child: 100.00%) - BytesSent: 5.15 KB (5278) - OverallThroughput: 41.53 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 39 (39) - SerializeBatchTime: 104.223us - UncompressedRowBatchSize: 5.15 KB (5278) CodeGen:(Total: 186.452ms, non-child: 186.452ms, % non-child: 100.00%) - CodegenTime: 20.684ms - CompileTime: 30.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 125.886ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.098ms SORT_NODE (id=16):(Total: 12m37s, non-child: 318.496us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 89.432us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 39 (39) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.373ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 242.743us - GetNewBlockTime: 182.571us - GetResultsTime: 120.068us - HTResizeTime: 4.889us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 15 (15) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11005056) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 780.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 246.013us, % non-child: 0.00%) - ConvertRowBatchTime: 42.994us - PeakMemoryUsage: 0 - RowsReturned: 39 (39) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 8.13 KB (8323) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.527ms - NumBatchesAccepted: 32 (32) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c4 (host=foo.234.41:22000):(Total: 12m37s, non-child: 12.462ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.23 GB (1315807494) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 224.256us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 166.975ms - TotalThreadsVoluntaryContextSwitches: 95 (95) Fragment Instance Lifecycle Timings: - ExecTime: 715.789us - ExecTreeExecTime: 7.390us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 35.262ms - ExecTreePrepareTime: 400.631us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 68 (68) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 117.030us, non-child: 117.030us, % non-child: 100.00%) - BytesSent: 6.52 KB (6678) - OverallThroughput: 54.42 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 106.408us - UncompressedRowBatchSize: 6.52 KB (6678) CodeGen:(Total: 186.860ms, non-child: 186.860ms, % non-child: 100.00%) - CodegenTime: 20.548ms - CompileTime: 33.251ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 129.175ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.903ms SORT_NODE (id=16):(Total: 12m37s, non-child: 428.004us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 86.985us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.630ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 252.254us - GetNewBlockTime: 157.266us - GetResultsTime: 143.076us - HTResizeTime: 6.071us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 740.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 449.093us, % non-child: 0.00%) - ConvertRowBatchTime: 77.370us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.33 KB (10574) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.085ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d8 (host=foo.234.50:22000):(Total: 12m37s, non-child: 12.709ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.49 MB (11001549) - PerHostPeakMemUsage: 1.28 GB (1371316406) - RowsProduced: 33 (33) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 313.625us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 173.974ms - TotalThreadsVoluntaryContextSwitches: 64 (64) Fragment Instance Lifecycle Timings: - ExecTime: 620.769us - ExecTreeExecTime: 6.505us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 39.171ms - ExecTreePrepareTime: 430.611us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 72 (72) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 95.157us, non-child: 95.157us, % non-child: 100.00%) - BytesSent: 4.38 KB (4484) - OverallThroughput: 44.94 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 33 (33) - SerializeBatchTime: 77.344us - UncompressedRowBatchSize: 4.38 KB (4484) CodeGen:(Total: 202.754ms, non-child: 202.754ms, % non-child: 100.00%) - CodegenTime: 21.582ms - CompileTime: 36.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 138.433ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.029ms SORT_NODE (id=16):(Total: 12m37s, non-child: 428.062us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 120.197us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 33 (33) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.655ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 217.252us - GetNewBlockTime: 174.419us - GetResultsTime: 119.039us - HTResizeTime: 5.272us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 18 (18) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.48 MB (10984576) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 33 (33) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 885.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 206.431us, % non-child: 0.00%) - ConvertRowBatchTime: 40.012us - PeakMemoryUsage: 0 - RowsReturned: 33 (33) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 6.89 KB (7051) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 6.427ms - NumBatchesAccepted: 26 (26) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e3 (host=foo.234.47:22000):(Total: 12m37s, non-child: 13.649ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11091661) - PerHostPeakMemUsage: 1.31 GB (1401445567) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 300.596us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 196.970ms - TotalThreadsVoluntaryContextSwitches: 118 (118) Fragment Instance Lifecycle Timings: - ExecTime: 647.810us - ExecTreeExecTime: 6.692us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 42.543ms - ExecTreePrepareTime: 586.501us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 71 (71) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1133069312) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 138.305us, non-child: 138.305us, % non-child: 100.00%) - BytesSent: 6.88 KB (7043) - OverallThroughput: 48.56 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 55 (55) - SerializeBatchTime: 118.153us - UncompressedRowBatchSize: 6.88 KB (7043) CodeGen:(Total: 227.231ms, non-child: 227.231ms, % non-child: 100.00%) - CodegenTime: 23.531ms - CompileTime: 40.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 156.626ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.425ms SORT_NODE (id=16):(Total: 12m37s, non-child: 414.762us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 59.292us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 55 (55) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.255ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 412.440us - GetNewBlockTime: 293.178us - GetResultsTime: 165.448us - HTResizeTime: 6.062us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.56 MB (11074688) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.829us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 417.247us, % non-child: 0.00%) - ConvertRowBatchTime: 80.134us - PeakMemoryUsage: 0 - RowsReturned: 55 (55) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.48 KB (11757) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.497ms - NumBatchesAccepted: 47 (47) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c6 (host=foo.234.45:22000):(Total: 12m37s, non-child: 12.289ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.19 GB (1277946058) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 459.320us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 70 (70) Fragment Instance Lifecycle Timings: - ExecTime: 980.718us - ExecTreeExecTime: 6.616us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.560ms - ExecTreePrepareTime: 440.088us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 81 (81) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.00 GB (1074349056) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 132.801us, non-child: 132.801us, % non-child: 100.00%) - BytesSent: 6.85 KB (7010) - OverallThroughput: 50.34 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 50 (50) - SerializeBatchTime: 118.998us - UncompressedRowBatchSize: 6.85 KB (7010) CodeGen:(Total: 187.447ms, non-child: 187.447ms, % non-child: 100.00%) - CodegenTime: 20.360ms - CompileTime: 32.232ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 129.616ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.021ms SORT_NODE (id=16):(Total: 12m37s, non-child: 450.018us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 144.245us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 50 (50) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.163ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 447.033us - GetNewBlockTime: 161.529us - GetResultsTime: 148.108us - HTResizeTime: 5.710us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 886.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 449.604us, % non-child: 0.00%) - ConvertRowBatchTime: 73.135us - PeakMemoryUsage: 0 - RowsReturned: 50 (50) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.13 KB (11395) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.300ms - NumBatchesAccepted: 44 (44) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ad (host=foo.234.49:22000):(Total: 12m37s, non-child: 17.813ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.28 GB (1376628520) - RowsProduced: 58 (58) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 525.098us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 174.973ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 940.818us - ExecTreeExecTime: 6.822us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 57.412ms - ExecTreePrepareTime: 517.518us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 290 (290) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 181.512us, non-child: 181.512us, % non-child: 100.00%) - BytesSent: 7.65 KB (7833) - OverallThroughput: 41.16 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 58 (58) - SerializeBatchTime: 158.201us - UncompressedRowBatchSize: 7.65 KB (7833) CodeGen:(Total: 217.434ms, non-child: 217.434ms, % non-child: 100.00%) - CodegenTime: 31.550ms - CompileTime: 34.530ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 141.900ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 39.975ms SORT_NODE (id=16):(Total: 12m37s, non-child: 451.321us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 129.844us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 58 (58) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.979ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 310.447us - GetNewBlockTime: 168.494us - GetResultsTime: 152.960us - HTResizeTime: 5.346us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 58 (58) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 849.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 468.193us, % non-child: 0.00%) - ConvertRowBatchTime: 95.965us - PeakMemoryUsage: 0 - RowsReturned: 58 (58) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.36 KB (12661) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.550ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ea (host=foo.234.52:22000):(Total: 12m37s, non-child: 13.683ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11095757) - PerHostPeakMemUsage: 1.22 GB (1314367736) - RowsProduced: 62 (62) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 608.573us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 196.970ms - TotalThreadsVoluntaryContextSwitches: 120 (120) Fragment Instance Lifecycle Timings: - ExecTime: 1.039ms - ExecTreeExecTime: 8.159us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 40.858ms - ExecTreePrepareTime: 397.769us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 171.528us, non-child: 171.528us, % non-child: 100.00%) - BytesSent: 8.50 KB (8701) - OverallThroughput: 48.38 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 62 (62) - SerializeBatchTime: 151.820us - UncompressedRowBatchSize: 8.50 KB (8701) CodeGen:(Total: 222.716ms, non-child: 222.716ms, % non-child: 100.00%) - CodegenTime: 23.071ms - CompileTime: 38.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 154.788ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.451ms SORT_NODE (id=16):(Total: 12m37s, non-child: 369.741us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 78.234us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 62 (62) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.152ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 456.536us - GetNewBlockTime: 177.824us - GetResultsTime: 167.548us - HTResizeTime: 5.714us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.57 MB (11078784) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 62 (62) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 894.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 536.988us, % non-child: 0.00%) - ConvertRowBatchTime: 109.100us - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 13.54 KB (13862) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.371ms - NumBatchesAccepted: 48 (48) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029d (host=foo.234.48:22000):(Total: 12m37s, non-child: 16.675ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.28 GB (1370121389) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 412.910us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 836.720us - ExecTreeExecTime: 7.069us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 51.554ms - ExecTreePrepareTime: 360.547us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 145.165us, non-child: 145.165us, % non-child: 100.00%) - BytesSent: 6.74 KB (6905) - OverallThroughput: 45.36 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 121.299us - UncompressedRowBatchSize: 6.74 KB (6905) CodeGen:(Total: 214.903ms, non-child: 214.903ms, % non-child: 100.00%) - CodegenTime: 29.243ms - CompileTime: 34.816ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 143.450ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 35.997ms SORT_NODE (id=16):(Total: 12m37s, non-child: 467.221us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 118.523us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.002ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 413.866us - GetNewBlockTime: 209.061us - GetResultsTime: 150.680us - HTResizeTime: 5.481us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 998.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 340.801us, % non-child: 0.00%) - ConvertRowBatchTime: 66.832us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.82 KB (11080) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.277ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002cd (host=foo.234.51:22000):(Total: 12m37s, non-child: 14.697ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.28 GB (1377587880) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 246.306us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 184.972ms - TotalThreadsVoluntaryContextSwitches: 91 (91) Fragment Instance Lifecycle Timings: - ExecTime: 588.453us - ExecTreeExecTime: 7.187us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 51.025ms - ExecTreePrepareTime: 584.263us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 290 (290) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 131.986us, non-child: 131.986us, % non-child: 100.00%) - BytesSent: 5.72 KB (5856) - OverallThroughput: 42.31 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 110.869us - UncompressedRowBatchSize: 5.72 KB (5856) CodeGen:(Total: 221.248ms, non-child: 221.248ms, % non-child: 100.00%) - CodegenTime: 24.480ms - CompileTime: 36.473ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 147.062ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 36.714ms SORT_NODE (id=16):(Total: 12m37s, non-child: 392.502us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 92.140us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.840ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 281.812us - GetNewBlockTime: 275.594us - GetResultsTime: 137.782us - HTResizeTime: 5.778us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 882.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 392.987us, % non-child: 0.00%) - ConvertRowBatchTime: 70.723us - PeakMemoryUsage: 0 - RowsReturned: 44 (44) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.18 KB (9397) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 6.972ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f3 (host=foo.232.50:22000):(Total: 12m37s, non-child: 12.710ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.33 GB (1430724863) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 282.163us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 182.973ms - TotalThreadsVoluntaryContextSwitches: 100 (100) Fragment Instance Lifecycle Timings: - ExecTime: 647.902us - ExecTreeExecTime: 6.585us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 41.976ms - ExecTreePrepareTime: 343.692us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 307 (307) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116295552) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 125.408us, non-child: 125.408us, % non-child: 100.00%) - BytesSent: 6.76 KB (6923) - OverallThroughput: 52.65 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 48 (48) - SerializeBatchTime: 110.781us - UncompressedRowBatchSize: 6.76 KB (6923) CodeGen:(Total: 211.773ms, non-child: 211.773ms, % non-child: 100.00%) - CodegenTime: 21.925ms - CompileTime: 44.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.935ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 30.088ms SORT_NODE (id=16):(Total: 12m37s, non-child: 353.411us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 89.561us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 48 (48) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.478ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 254.148us - GetNewBlockTime: 198.527us - GetResultsTime: 142.070us - HTResizeTime: 5.052us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 918.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 388.420us, % non-child: 0.00%) - ConvertRowBatchTime: 71.269us - PeakMemoryUsage: 0 - RowsReturned: 48 (48) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.85 KB (11108) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.375ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002fb (host=foo.232.51:22000):(Total: 12m37s, non-child: 11.787ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11042509) - PerHostPeakMemUsage: 1.36 GB (1456006718) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 302.513us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 176.973ms - TotalThreadsVoluntaryContextSwitches: 108 (108) Fragment Instance Lifecycle Timings: - ExecTime: 684.488us - ExecTreeExecTime: 6.261us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.611ms - ExecTreePrepareTime: 332.457us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 306 (306) - BlocksRecycled: 52 (52) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107906944) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 113.548us, non-child: 113.548us, % non-child: 100.00%) - BytesSent: 5.66 KB (5799) - OverallThroughput: 48.71 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 41 (41) - SerializeBatchTime: 91.307us - UncompressedRowBatchSize: 5.66 KB (5799) CodeGen:(Total: 201.145ms, non-child: 201.145ms, % non-child: 100.00%) - CodegenTime: 20.443ms - CompileTime: 40.817ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 133.926ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.896ms SORT_NODE (id=16):(Total: 12m37s, non-child: 340.460us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 57.246us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 41 (41) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.584ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 215.748us - GetNewBlockTime: 327.257us - GetResultsTime: 127.310us - HTResizeTime: 5.165us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 16 (16) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11025536) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 942.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 423.811us, % non-child: 0.00%) - ConvertRowBatchTime: 79.706us - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.17 KB (9385) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.418ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000316 (host=foo.246.36:22000):(Total: 12m37s, non-child: 12.670ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.54 MB (11054797) - PerHostPeakMemUsage: 1.28 GB (1373964388) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 357.490us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 182.972ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 727.215us - ExecTreeExecTime: 6.419us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 38.586ms - ExecTreePrepareTime: 329.543us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 104.081us, non-child: 104.081us, % non-child: 100.00%) - BytesSent: 5.56 KB (5690) - OverallThroughput: 52.14 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 91.037us - UncompressedRowBatchSize: 5.56 KB (5690) CodeGen:(Total: 208.136ms, non-child: 208.136ms, % non-child: 100.00%) - CodegenTime: 21.235ms - CompileTime: 32.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 148.652ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.602ms SORT_NODE (id=16):(Total: 12m37s, non-child: 404.361us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 100.371us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.784ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 287.174us - GetNewBlockTime: 162.223us - GetResultsTime: 142.889us - HTResizeTime: 6.090us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11037824) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 863.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 434.331us, % non-child: 0.00%) - ConvertRowBatchTime: 90.795us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.08 KB (9303) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.832ms - NumBatchesAccepted: 39 (39) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002e8 (host=foo.246.38:22000):(Total: 12m37s, non-child: 12.666ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.58 MB (11095757) - PerHostPeakMemUsage: 1.31 GB (1401697212) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 447.020us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.000ms - TotalThreadsUserTime: 193.970ms - TotalThreadsVoluntaryContextSwitches: 104 (104) Fragment Instance Lifecycle Timings: - ExecTime: 887.017us - ExecTreeExecTime: 6.832us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 37.440ms - ExecTreePrepareTime: 366.718us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 68 (68) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 141.012us, non-child: 141.012us, % non-child: 100.00%) - BytesSent: 7.30 KB (7478) - OverallThroughput: 50.57 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 54 (54) - SerializeBatchTime: 126.638us - UncompressedRowBatchSize: 7.30 KB (7478) CodeGen:(Total: 221.766ms, non-child: 221.766ms, % non-child: 100.00%) - CodegenTime: 21.066ms - CompileTime: 41.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 153.525ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.978ms SORT_NODE (id=16):(Total: 12m37s, non-child: 329.460us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 60.131us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 54 (54) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.027ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 440.124us - GetNewBlockTime: 191.472us - GetResultsTime: 173.848us - HTResizeTime: 5.589us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.57 MB (11078784) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.014us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 307.805us, % non-child: 0.00%) - ConvertRowBatchTime: 67.708us - PeakMemoryUsage: 0 - RowsReturned: 54 (54) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.05 KB (12340) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.466ms - NumBatchesAccepted: 48 (48) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f2 (host=foo.232.52:22000):(Total: 12m37s, non-child: 12.971ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11026125) - PerHostPeakMemUsage: 1.41 GB (1515314840) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 293.691us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 180.972ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Fragment Instance Lifecycle Timings: - ExecTime: 681.653us - ExecTreeExecTime: 6.324us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.059ms - ExecTreePrepareTime: 340.280us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 310 (310) - BlocksRecycled: 50 (50) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.06 GB (1141461376) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 139.355us, non-child: 139.355us, % non-child: 100.00%) - BytesSent: 5.72 KB (5856) - OverallThroughput: 40.08 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 40 (40) - SerializeBatchTime: 127.607us - UncompressedRowBatchSize: 5.72 KB (5856) CodeGen:(Total: 207.367ms, non-child: 207.367ms, % non-child: 100.00%) - CodegenTime: 21.676ms - CompileTime: 34.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 148.500ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.844ms SORT_NODE (id=16):(Total: 12m37s, non-child: 375.407us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 80.697us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 40 (40) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.274ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 249.511us - GetNewBlockTime: 206.387us - GetResultsTime: 136.830us - HTResizeTime: 5.285us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11009152) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 783.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 338.058us, % non-child: 0.00%) - ConvertRowBatchTime: 74.256us - PeakMemoryUsage: 0 - RowsReturned: 40 (40) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.00 KB (9214) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.009ms - NumBatchesAccepted: 32 (32) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ca (host=foo.246.35:22000):(Total: 12m37s, non-child: 14.031ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.32 GB (1421035445) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 389.189us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 190.971ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Fragment Instance Lifecycle Timings: - ExecTime: 749.405us - ExecTreeExecTime: 7.290us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 39.652ms - ExecTreePrepareTime: 412.239us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 293 (293) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 107.921us, non-child: 107.921us, % non-child: 100.00%) - BytesSent: 5.80 KB (5937) - OverallThroughput: 52.46 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 41 (41) - SerializeBatchTime: 92.974us - UncompressedRowBatchSize: 5.80 KB (5937) CodeGen:(Total: 217.062ms, non-child: 217.062ms, % non-child: 100.00%) - CodegenTime: 24.581ms - CompileTime: 35.157ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 154.737ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.663ms SORT_NODE (id=16):(Total: 12m37s, non-child: 506.245us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 149.017us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 41 (41) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.267ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 278.210us - GetNewBlockTime: 179.961us - GetResultsTime: 199.074us - HTResizeTime: 5.090us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.010us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 325.695us, % non-child: 0.00%) - ConvertRowBatchTime: 58.662us - PeakMemoryUsage: 0 - RowsReturned: 41 (41) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.20 KB (9419) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.717ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c2 (host=foo.246.39:22000):(Total: 12m37s, non-child: 17.669ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11079373) - PerHostPeakMemUsage: 1.27 GB (1362652558) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 352.766us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 181.973ms - TotalThreadsVoluntaryContextSwitches: 74 (74) Fragment Instance Lifecycle Timings: - ExecTime: 803.032us - ExecTreeExecTime: 6.689us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 39.540ms - ExecTreePrepareTime: 357.681us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 157.270us, non-child: 157.270us, % non-child: 100.00%) - BytesSent: 7.91 KB (8098) - OverallThroughput: 49.11 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 56 (56) - SerializeBatchTime: 144.969us - UncompressedRowBatchSize: 7.91 KB (8098) CodeGen:(Total: 202.817ms, non-child: 202.817ms, % non-child: 100.00%) - CodegenTime: 31.743ms - CompileTime: 35.081ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 144.176ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.098ms SORT_NODE (id=16):(Total: 12m37s, non-child: 392.892us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 114.596us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 56 (56) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.559ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 264.647us - GetNewBlockTime: 181.404us - GetResultsTime: 159.719us - HTResizeTime: 4.526us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11062400) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 891.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 533.488us, % non-child: 0.00%) - ConvertRowBatchTime: 78.725us - PeakMemoryUsage: 0 - RowsReturned: 56 (56) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.53 KB (12832) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 5.353ms - NumBatchesAccepted: 44 (44) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ac (host=foo.246.37:22000):(Total: 12m37s, non-child: 20.242ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11046605) - PerHostPeakMemUsage: 1.30 GB (1395155466) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 356.885us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 193.971ms - TotalThreadsVoluntaryContextSwitches: 77 (77) Fragment Instance Lifecycle Timings: - ExecTime: 711.022us - ExecTreeExecTime: 5.192us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 43.835ms - ExecTreePrepareTime: 434.735us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 297 (297) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 118.597us, non-child: 118.597us, % non-child: 100.00%) - BytesSent: 5.45 KB (5581) - OverallThroughput: 44.88 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 40 (40) - SerializeBatchTime: 105.243us - UncompressedRowBatchSize: 5.45 KB (5581) CodeGen:(Total: 215.561ms, non-child: 215.561ms, % non-child: 100.00%) - CodegenTime: 35.848ms - CompileTime: 34.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 155.167ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.679ms SORT_NODE (id=16):(Total: 12m37s, non-child: 321.860us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 67.360us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 40 (40) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.087ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 282.457us - GetNewBlockTime: 185.265us - GetResultsTime: 141.369us - HTResizeTime: 4.837us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.52 MB (11029632) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 891.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 274.579us, % non-child: 0.00%) - ConvertRowBatchTime: 49.086us - PeakMemoryUsage: 0 - RowsReturned: 40 (40) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 8.62 KB (8829) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.245ms - NumBatchesAccepted: 37 (37) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f0 (host=foo.246.41:22000):(Total: 12m37s, non-child: 13.909ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.59 MB (11108045) - PerHostPeakMemUsage: 1.27 GB (1368878773) - RowsProduced: 59 (59) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 511.131us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 65 (65) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 175.974ms - TotalThreadsVoluntaryContextSwitches: 85 (85) Fragment Instance Lifecycle Timings: - ExecTime: 901.396us - ExecTreeExecTime: 5.860us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 40.080ms - ExecTreePrepareTime: 385.230us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 71 (71) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 156.503us, non-child: 156.503us, % non-child: 100.00%) - BytesSent: 7.70 KB (7888) - OverallThroughput: 48.07 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 59 (59) - SerializeBatchTime: 133.256us - UncompressedRowBatchSize: 7.70 KB (7888) CodeGen:(Total: 205.251ms, non-child: 205.251ms, % non-child: 100.00%) - CodegenTime: 23.043ms - CompileTime: 36.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 140.335ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 27.999ms SORT_NODE (id=16):(Total: 12m37s, non-child: 305.377us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 47.487us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 59 (59) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.182ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 272.786us - GetNewBlockTime: 190.865us - GetResultsTime: 132.291us - HTResizeTime: 4.734us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.58 MB (11091072) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 59 (59) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 878.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 279.937us, % non-child: 0.00%) - ConvertRowBatchTime: 46.426us - PeakMemoryUsage: 0 - RowsReturned: 59 (59) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 12.55 KB (12856) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.550ms - NumBatchesAccepted: 51 (51) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002f8 (host=foo.246.40:22000):(Total: 12m37s, non-child: 14.545ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.28 GB (1376696014) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 348.287us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 72 (72) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 185.972ms - TotalThreadsVoluntaryContextSwitches: 117 (117) Fragment Instance Lifecycle Timings: - ExecTime: 665.557us - ExecTreeExecTime: 5.432us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 50.707ms - ExecTreePrepareTime: 890.567us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 290 (290) - BlocksRecycled: 66 (66) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 116.254us, non-child: 116.254us, % non-child: 100.00%) - BytesSent: 5.80 KB (5939) - OverallThroughput: 48.72 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 45 (45) - SerializeBatchTime: 98.460us - UncompressedRowBatchSize: 5.80 KB (5939) CodeGen:(Total: 228.171ms, non-child: 228.171ms, % non-child: 100.00%) - CodegenTime: 24.586ms - CompileTime: 53.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 136.025ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 37.997ms SORT_NODE (id=16):(Total: 12m37s, non-child: 321.779us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 73.580us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 45 (45) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.807ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 233.707us - GetNewBlockTime: 343.508us - GetResultsTime: 126.199us - HTResizeTime: 4.468us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.279us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 289.045us, % non-child: 0.00%) - ConvertRowBatchTime: 55.343us - PeakMemoryUsage: 0 - RowsReturned: 45 (45) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.14 KB (9357) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.337ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002d9 (host=foo.234.44:22000):(Total: 12m37s, non-child: 12.173ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.21 GB (1304546732) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 301.054us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 175.973ms - TotalThreadsVoluntaryContextSwitches: 81 (81) Fragment Instance Lifecycle Timings: - ExecTime: 709.311us - ExecTreeExecTime: 7.501us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 33.018ms - ExecTreePrepareTime: 427.171us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 83 (83) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 130.249us, non-child: 130.249us, % non-child: 100.00%) - BytesSent: 6.64 KB (6803) - OverallThroughput: 49.81 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 49 (49) - SerializeBatchTime: 120.635us - UncompressedRowBatchSize: 6.64 KB (6803) CodeGen:(Total: 193.934ms, non-child: 193.934ms, % non-child: 100.00%) - CodegenTime: 20.663ms - CompileTime: 34.031ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 138.087ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 21.171ms SORT_NODE (id=16):(Total: 12m37s, non-child: 469.222us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 83.080us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 49 (49) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.545ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 477.035us - GetNewBlockTime: 180.373us - GetResultsTime: 174.562us - HTResizeTime: 5.595us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 746.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 523.059us, % non-child: 0.00%) - ConvertRowBatchTime: 103.070us - PeakMemoryUsage: 0 - RowsReturned: 49 (49) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.68 KB (10934) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.521ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b0 (host=foo.246.42:22000):(Total: 12m37s, non-child: 12.586ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11058893) - PerHostPeakMemUsage: 1.22 GB (1308016236) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 240.907us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.000ms - TotalThreadsUserTime: 173.973ms - TotalThreadsVoluntaryContextSwitches: 115 (115) Fragment Instance Lifecycle Timings: - ExecTime: 623.623us - ExecTreeExecTime: 7.153us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 53.271ms - ExecTreePrepareTime: 718.184us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 288 (288) - BlocksRecycled: 69 (69) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 170.848us, non-child: 170.848us, % non-child: 100.00%) - BytesSent: 7.08 KB (7251) - OverallThroughput: 40.48 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 52 (52) - SerializeBatchTime: 125.025us - UncompressedRowBatchSize: 7.08 KB (7251) CodeGen:(Total: 215.089ms, non-child: 215.089ms, % non-child: 100.00%) - CodegenTime: 21.045ms - CompileTime: 41.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 130.822ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 42.538ms SORT_NODE (id=16):(Total: 12m37s, non-child: 504.220us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 155.388us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 52 (52) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 6.491ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 314.385us - GetNewBlockTime: 237.369us - GetResultsTime: 180.204us - HTResizeTime: 5.636us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.53 MB (11041920) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 982.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 514.831us, % non-child: 0.00%) - ConvertRowBatchTime: 142.467us - PeakMemoryUsage: 0 - RowsReturned: 52 (52) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.25 KB (11521) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.882ms - NumBatchesAccepted: 40 (40) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce180000029f (host=foo.246.44:22000):(Total: 12m37s, non-child: 12.450ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.25 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.31 GB (1403306148) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 459.225us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 180.973ms - TotalThreadsVoluntaryContextSwitches: 121 (121) Fragment Instance Lifecycle Timings: - ExecTime: 910.684us - ExecTreeExecTime: 6.114us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 35.848ms - ExecTreePrepareTime: 478.827us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 293 (293) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 103.281us, non-child: 103.281us, % non-child: 100.00%) - BytesSent: 5.94 KB (6081) - OverallThroughput: 56.15 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 43 (43) - SerializeBatchTime: 93.578us - UncompressedRowBatchSize: 5.94 KB (6081) CodeGen:(Total: 203.404ms, non-child: 203.404ms, % non-child: 100.00%) - CodegenTime: 20.803ms - CompileTime: 33.341ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 145.446ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.838ms SORT_NODE (id=16):(Total: 12m37s, non-child: 359.344us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 88.794us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 43 (43) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.724ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 252.602us - GetNewBlockTime: 1.334ms - GetResultsTime: 125.413us - HTResizeTime: 5.664us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 13 (13) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.738us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 425.467us, % non-child: 0.00%) - ConvertRowBatchTime: 83.941us - PeakMemoryUsage: 0 - RowsReturned: 43 (43) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.32 KB (9543) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.122ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002fc (host=foo.246.47:22000):(Total: 12m37s, non-child: 12.159ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.27 GB (1359123751) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 293.339us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 64 (64) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 185.972ms - TotalThreadsVoluntaryContextSwitches: 135 (135) Fragment Instance Lifecycle Timings: - ExecTime: 703.132us - ExecTreeExecTime: 6.799us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.562ms - ExecTreePrepareTime: 428.539us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 154.061us, non-child: 154.061us, % non-child: 100.00%) - BytesSent: 7.27 KB (7442) - OverallThroughput: 46.07 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 54 (54) - SerializeBatchTime: 138.806us - UncompressedRowBatchSize: 7.27 KB (7442) CodeGen:(Total: 210.978ms, non-child: 210.978ms, % non-child: 100.00%) - CodegenTime: 21.073ms - CompileTime: 35.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 149.841ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.994ms SORT_NODE (id=16):(Total: 12m37s, non-child: 411.109us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 122.559us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 54 (54) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.828ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 365.347us - GetNewBlockTime: 231.778us - GetResultsTime: 146.152us - HTResizeTime: 5.358us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 4.282us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 354.521us, % non-child: 0.00%) - ConvertRowBatchTime: 62.003us - PeakMemoryUsage: 0 - RowsReturned: 54 (54) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.75 KB (12036) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.244ms - NumBatchesAccepted: 43 (43) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000308 (host=foo.246.45:22000):(Total: 12m37s, non-child: 12.894ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11034317) - PerHostPeakMemUsage: 1.21 GB (1300939375) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 305.256us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 198.970ms - TotalThreadsVoluntaryContextSwitches: 74 (74) Fragment Instance Lifecycle Timings: - ExecTime: 605.162us - ExecTreeExecTime: 5.222us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 35.390ms - ExecTreePrepareTime: 333.952us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 288 (288) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 107.033us, non-child: 107.033us, % non-child: 100.00%) - BytesSent: 5.76 KB (5902) - OverallThroughput: 52.59 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 44 (44) - SerializeBatchTime: 91.033us - UncompressedRowBatchSize: 5.76 KB (5902) CodeGen:(Total: 224.367ms, non-child: 224.367ms, % non-child: 100.00%) - CodegenTime: 21.793ms - CompileTime: 33.702ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 166.703ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.442ms SORT_NODE (id=16):(Total: 12m37s, non-child: 284.288us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 59.178us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 44 (44) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 2.965ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 213.879us - GetNewBlockTime: 170.720us - GetResultsTime: 106.270us - HTResizeTime: 4.032us - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 18 (18) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11017344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 922.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 246.947us, % non-child: 0.00%) - ConvertRowBatchTime: 53.544us - PeakMemoryUsage: 0 - RowsReturned: 44 (44) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 9.23 KB (9451) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.545ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce1800000317 (host=foo.246.50:22000):(Total: 12m37s, non-child: 13.199ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.53 MB (11038413) - PerHostPeakMemUsage: 1.25 GB (1346091482) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 366.779us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 181.972ms - TotalThreadsVoluntaryContextSwitches: 69 (69) Fragment Instance Lifecycle Timings: - ExecTime: 640.312us - ExecTreeExecTime: 5.496us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 36.507ms - ExecTreePrepareTime: 585.927us DataStreamSender (dst_id=28):(Total: 110.701us, non-child: 110.701us, % non-child: 100.00%) - BytesSent: 5.65 KB (5789) - OverallThroughput: 49.87 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 42 (42) - SerializeBatchTime: 85.103us - UncompressedRowBatchSize: 5.65 KB (5789) CodeGen:(Total: 206.671ms, non-child: 206.671ms, % non-child: 100.00%) - CodegenTime: 22.198ms - CompileTime: 34.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 148.148ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 23.681ms SORT_NODE (id=16):(Total: 12m37s, non-child: 333.438us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 64.318us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 42 (42) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.003ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 233.795us - GetNewBlockTime: 240.802us - GetResultsTime: 124.864us - HTResizeTime: 4.500us - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 19 (19) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.51 MB (11021440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 839.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 227.101us, % non-child: 0.00%) - ConvertRowBatchTime: 37.641us - PeakMemoryUsage: 0 - RowsReturned: 42 (42) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 8.83 KB (9047) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.923ms - NumBatchesAccepted: 35 (35) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002db (host=foo.246.48:22000):(Total: 12m37s, non-child: 12.604ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.20 GB (1291562661) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 298.103us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 187.972ms - TotalThreadsVoluntaryContextSwitches: 89 (89) Fragment Instance Lifecycle Timings: - ExecTime: 691.566us - ExecTreeExecTime: 5.840us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 44.281ms - ExecTreePrepareTime: 319.597us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 81 (81) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.01 GB (1082737664) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 138.632us, non-child: 138.632us, % non-child: 100.00%) - BytesSent: 6.29 KB (6439) - OverallThroughput: 44.30 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 46 (46) - SerializeBatchTime: 122.789us - UncompressedRowBatchSize: 6.29 KB (6439) CodeGen:(Total: 217.948ms, non-child: 217.948ms, % non-child: 100.00%) - CodegenTime: 21.416ms - CompileTime: 34.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 150.349ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 32.373ms SORT_NODE (id=16):(Total: 12m37s, non-child: 356.902us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 45.425us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 46 (46) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.525ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 295.814us - GetNewBlockTime: 181.230us - GetResultsTime: 174.155us - HTResizeTime: 4.366us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 880.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 314.637us, % non-child: 0.00%) - ConvertRowBatchTime: 45.645us - PeakMemoryUsage: 0 - RowsReturned: 46 (46) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 10.13 KB (10371) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.083ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c3 (host=foo.246.51:22000):(Total: 12m37s, non-child: 12.752ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.59 MB (11108045) - PerHostPeakMemUsage: 1.23 GB (1319248021) - RowsProduced: 62 (62) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 358.509us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 192.970ms - TotalThreadsVoluntaryContextSwitches: 90 (90) Fragment Instance Lifecycle Timings: - ExecTime: 718.306us - ExecTreeExecTime: 6.699us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 37.817ms - ExecTreePrepareTime: 529.482us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 86 (86) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 152.315us, non-child: 152.315us, % non-child: 100.00%) - BytesSent: 8.12 KB (8316) - OverallThroughput: 52.07 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 62 (62) - SerializeBatchTime: 138.546us - UncompressedRowBatchSize: 8.12 KB (8316) CodeGen:(Total: 217.674ms, non-child: 217.674ms, % non-child: 100.00%) - CodegenTime: 21.999ms - CompileTime: 34.425ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 156.953ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 25.808ms SORT_NODE (id=16):(Total: 12m37s, non-child: 389.010us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 57.149us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 62 (62) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 4.110ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 294.758us - GetNewBlockTime: 144.753us - GetResultsTime: 146.007us - HTResizeTime: 4.902us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.58 MB (11091072) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 62 (62) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 809.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 325.098us, % non-child: 0.00%) - ConvertRowBatchTime: 58.084us - PeakMemoryUsage: 0 - RowsReturned: 62 (62) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 13.13 KB (13447) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 3.710ms - NumBatchesAccepted: 51 (51) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002ce (host=foo.246.46:22000):(Total: 12m37s, non-child: 12.055ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.57 MB (11083469) - PerHostPeakMemUsage: 1.20 GB (1286662146) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 453.477us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 186.971ms - TotalThreadsVoluntaryContextSwitches: 70 (70) Fragment Instance Lifecycle Timings: - ExecTime: 822.804us - ExecTreeExecTime: 7.551us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 38.091ms - ExecTreePrepareTime: 400.610us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 82 (82) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 147.028us, non-child: 147.028us, % non-child: 100.00%) - BytesSent: 7.12 KB (7291) - OverallThroughput: 47.29 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 55 (55) - SerializeBatchTime: 122.345us - UncompressedRowBatchSize: 7.12 KB (7291) CodeGen:(Total: 215.187ms, non-child: 215.187ms, % non-child: 100.00%) - CodegenTime: 20.600ms - CompileTime: 34.921ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 152.919ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 26.891ms SORT_NODE (id=16):(Total: 12m37s, non-child: 346.881us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 62.054us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 55 (55) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.967ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 284.428us - GetNewBlockTime: 179.643us - GetResultsTime: 155.638us - HTResizeTime: 4.910us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.55 MB (11066496) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 8.335us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 471.310us, % non-child: 0.00%) - ConvertRowBatchTime: 89.877us - PeakMemoryUsage: 0 - RowsReturned: 55 (55) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m37s - TotalBytesReceived: 11.67 KB (11953) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 4.180ms - NumBatchesAccepted: 45 (45) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002bc (host=foo.246.49:22000):(Total: 12m37s, non-child: 15.160ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.55 MB (11067085) - PerHostPeakMemUsage: 1.23 GB (1315483351) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 327.211us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 7.999ms - TotalThreadsUserTime: 210.968ms - TotalThreadsVoluntaryContextSwitches: 124 (124) Fragment Instance Lifecycle Timings: - ExecTime: 882.482us - ExecTreeExecTime: 7.243us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 43.039ms - ExecTreePrepareTime: 842.547us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 273 (273) - BlocksRecycled: 85 (85) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.03 GB (1107903488) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 132.632us, non-child: 132.632us, % non-child: 100.00%) - BytesSent: 6.42 KB (6569) - OverallThroughput: 47.23 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 47 (47) - SerializeBatchTime: 118.533us - UncompressedRowBatchSize: 6.42 KB (6569) CodeGen:(Total: 243.616ms, non-child: 243.616ms, % non-child: 100.00%) - CodegenTime: 22.654ms - CompileTime: 34.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 178.863ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 29.469ms SORT_NODE (id=16):(Total: 12m37s, non-child: 392.102us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 88.503us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 47 (47) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 5.543ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 389.991us - GetNewBlockTime: 245.729us - GetResultsTime: 177.325us - HTResizeTime: 4.980us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 14 (14) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11050112) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.742us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 355.757us, % non-child: 0.00%) - ConvertRowBatchTime: 74.892us - PeakMemoryUsage: 0 - RowsReturned: 47 (47) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m36s - TotalBytesReceived: 10.27 KB (10516) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 1.953ms - NumBatchesAccepted: 41 (41) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002b8 (host=foo.246.52:22000):(Total: 12m37s, non-child: 13.010ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.56 MB (11071181) - PerHostPeakMemUsage: 1.23 GB (1318272346) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 320.859us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 194.971ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 720.885us - ExecTreeExecTime: 7.247us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 37.075ms - ExecTreePrepareTime: 312.580us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1091126272) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 145.255us, non-child: 145.255us, % non-child: 100.00%) - BytesSent: 6.96 KB (7122) - OverallThroughput: 46.76 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 51 (51) - SerializeBatchTime: 131.660us - UncompressedRowBatchSize: 6.96 KB (7122) CodeGen:(Total: 216.944ms, non-child: 216.944ms, % non-child: 100.00%) - CodegenTime: 22.470ms - CompileTime: 32.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 158.627ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 24.679ms SORT_NODE (id=16):(Total: 12m37s, non-child: 447.885us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 145.866us - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 51 (51) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.961ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 260.487us - GetNewBlockTime: 193.146us - GetResultsTime: 204.645us - HTResizeTime: 5.499us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.54 MB (11054208) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 841.000ns EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 489.307us, % non-child: 0.00%) - ConvertRowBatchTime: 94.787us - PeakMemoryUsage: 0 - RowsReturned: 51 (51) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m36s - TotalBytesReceived: 11.34 KB (11613) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.628ms - NumBatchesAccepted: 42 (42) - NumBatchesRejected: 0 (0) Instance 5f429df048b5534b:41bcce18000002c0 (host=foo.234.46:22000):(Total: 12m37s, non-child: 13.114ms, % non-child: 0.00%) MemoryUsage(16s000ms): 10.29 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.52 MB (11030221) - PerHostPeakMemUsage: 1.30 GB (1394424713) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 459.057us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 7.999ms - TotalThreadsUserTime: 183.972ms - TotalThreadsVoluntaryContextSwitches: 105 (105) Fragment Instance Lifecycle Timings: - ExecTime: 765.645us - ExecTreeExecTime: 4.133us - OpenTime: 12m37s - ExecTreeOpenTime: 12m37s - PrepareTime: 40.596ms - ExecTreePrepareTime: 417.562us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 70 (70) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.05 GB (1124680704) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=28):(Total: 73.343us, non-child: 73.343us, % non-child: 100.00%) - BytesSent: 5.25 KB (5374) - OverallThroughput: 69.88 MB/sec - PeakMemoryUsage: 1.05 KB (1072) - RowsReturned: 39 (39) - SerializeBatchTime: 60.917us - UncompressedRowBatchSize: 5.25 KB (5374) CodeGen:(Total: 217.137ms, non-child: 217.137ms, % non-child: 100.00%) - CodegenTime: 21.514ms - CompileTime: 48.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 88 (88) - NumInstructions: 2.13K (2127) - OptimizationTime: 139.858ms - PeakMemoryUsage: 1.04 MB (1089024) - PrepareTime: 28.772ms SORT_NODE (id=16):(Total: 12m37s, non-child: 228.302us, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 24.846us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 39 (39) - RowsReturnedRate: 0 AGGREGATION_NODE (id=27):(Total: 12m37s, non-child: 3.585ms, % non-child: 0.00%) ExecOption: Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - BuildTime: 195.286us - GetNewBlockTime: 259.607us - GetResultsTime: 94.562us - HTResizeTime: 2.911us - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 12 (12) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.50 MB (11013248) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.328us EXCHANGE_NODE (id=26):(Total: 12m37s, non-child: 210.467us, % non-child: 0.00%) - ConvertRowBatchTime: 34.703us - PeakMemoryUsage: 0 - RowsReturned: 39 (39) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 12m36s - TotalBytesReceived: 8.37 KB (8573) - TotalGetBatchTime: 12m37s - DataArrivalTimer: 12m37s SenderSide: - DeserializeRowBatchTimer: 2.266ms - NumBatchesAccepted: 32 (32) - NumBatchesRejected: 0 (0) Averaged Fragment F07:(Total: 12m38s, non-child: 99.739ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:12m37s max:12m39s mean: 12m38s stddev:653.688ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 129 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194685) - PeakMemoryUsage: 642.63 MB (673848812) - PerHostPeakMemUsage: 1.32 GB (1415052875) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 27.314ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.76K (3764) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s218ms - TotalThreadsUserTime: 9s376ms - TotalThreadsVoluntaryContextSwitches: 63.96K (63956) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 53.078ms - ExecTreePrepareTime: 859.002us DataStreamSender (dst_id=26):(Total: 588.401us, non-child: 588.401us, % non-child: 100.00%) - BytesSent: 10.39 KB (10642) - OverallThroughput: 17.83 MB/sec - PeakMemoryUsage: 244.04 KB (249892) - RowsReturned: 47 (47) - SerializeBatchTime: 435.891us - UncompressedRowBatchSize: 10.39 KB (10642) CodeGen:(Total: 674.276ms, non-child: 674.276ms, % non-child: 100.00%) - CodegenTime: 17.442ms - CompileTime: 220.288ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 424.744ms - PeakMemoryUsage: 3.51 MB (3677648) - PrepareTime: 28.649ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 637.367ms, % non-child: 0.08%) - GetNewBlockTime: 105.916us - GetResultsTime: 135.583us - HTResizeTime: 23.079us - HashBuckets: 16.29K (16288) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.65 MB (10123867) - PinTime: 0.000ns - ReductionFactorEstimate: 1006561.29 - ReductionFactorThresholdToExpand: 0.05 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 624.016ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.211ms, % non-child: 0.00%) - BuildRows: 1.70K (1704) - BuildTime: 1.076ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.36 MB (9813527) - ProbeRows: 338 (338) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 211.742us - RowsReturned: 332 (332) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 170.894us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 559.104us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 176.152us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s486ms, non-child: 1s486ms, % non-child: 100.00%) - ConvertRowBatchTime: 48.415us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.38 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 5.151ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s486ms - DataArrivalTimer: 1s486ms SenderSide: - DeserializeRowBatchTimer: 226.323us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 10.162ms, % non-child: 0.00%) - BuildRows: 274 (274) - BuildTime: 701.702us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566124) - ProbeRows: 338 (338) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 236.854us - RowsReturned: 338 (338) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): - BuildRowsPartitionTime: 41.181us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 407.287us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.604us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 510.493ms, non-child: 510.493ms, % non-child: 100.00%) - ConvertRowBatchTime: 9.117us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 5.68 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 2.630ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 510.477ms - DataArrivalTimer: 510.474ms SenderSide: - DeserializeRowBatchTimer: 85.475us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s593ms, % non-child: 0.87%) - BuildRows: 1.43M (1432883) - BuildTime: 1s762ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 617.46 MB (647456469) - ProbeRows: 37.06M (37059272) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s612ms - RowsReturned: 338 (338) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): - BuildRowsPartitionTime: 1s460ms - BuildRowsPartitioned: 1.43M (1432883) - GetNewBlockTime: 3.404ms - HashBuckets: 3.39M (3394663) - HashCollisions: 3.79K (3787) - HashTablesBuildTime: 289.518ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 617.39 MB (647384533) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 10m34s, % non-child: 100.00%) - ConvertRowBatchTime: 95.316ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1432883) - RowsReturnedRate: 2.26 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 253.56 MB (265872011) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s868ms - NumBatchesAccepted: 12.86K (12857) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1m58s, % non-child: 100.00%) - ConvertRowBatchTime: 1s053ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37059272) - RowsReturnedRate: 311.92 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 3s285ms - TotalBytesReceived: 665.03 MB (697336517) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s290ms - NumBatchesAccepted: 56.64K (56643) - NumBatchesRejected: 62 (62) BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 301 (301) - BlocksRecycled: 57 (57) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F07: Instance 5f429df048b5534b:41bcce1800000293 (host=foo.187.47:22000):(Total: 12m39s, non-child: 66.624ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.29 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.32 MB, 156.17 MB, 162.39 MB, 211.42 MB, 290.41 MB, 298.15 MB, 328.42 MB, 352.41 MB, 377.92 MB, 386.42 MB, 391.90 MB, 394.41 MB, 402.91 MB, 413.66 MB, 418.41 MB, 418.43 MB, 418.41 MB, 418.40 MB, 422.17 MB, 426.92 MB, 434.42 MB, 438.17 MB, 442.42 MB, 442.40 MB, 442.41 MB, 443.65 MB, 450.41 MB, 450.41 MB, 450.43 MB, 450.40 MB, 450.45 MB, 450.41 MB, 450.37 MB, 450.45 MB, 455.86 MB, 625.52 MB, 625.97 MB, 625.94 MB, 626.22 MB, 626.11 MB, 625.70 MB, 626.11 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 639.30 MB (670358198) - PerHostPeakMemUsage: 1.23 GB (1315490468) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 10.782ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.09K (4091) - TotalThreadsTotalWallClockTime: 23m21s - TotalThreadsSysTime: 1s239ms - TotalThreadsUserTime: 9s508ms - TotalThreadsVoluntaryContextSwitches: 63.02K (63018) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 55.124ms - ExecTreePrepareTime: 803.407us DataStreamSender (dst_id=26):(Total: 520.865us, non-child: 520.865us, % non-child: 100.00%) - BytesSent: 10.77 KB (11029) - OverallThroughput: 20.19 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 46 (46) - SerializeBatchTime: 271.944us - UncompressedRowBatchSize: 10.77 KB (11029) CodeGen:(Total: 655.470ms, non-child: 655.470ms, % non-child: 100.00%) - CodegenTime: 19.860ms - CompileTime: 216.059ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 410.007ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.727ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 639.963ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 54.843us - GetResultsTime: 135.891us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 628.125ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.504ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 537.956us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 708 (708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 451.719us - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 139.571us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 123.816us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 180.157us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s593ms, non-child: 67.979us, % non-child: 0.00%) - ConvertRowBatchTime: 44.329us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.07 K/sec RecvrSide: BytesReceived(16s000ms): 21.51 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 98.852ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s593ms - DataArrivalTimer: 1s593ms SenderSide: - DeserializeRowBatchTimer: 137.871us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 2.640ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 412.877us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 708 (708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 534.816us - RowsReturned: 708 (708) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.693us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 165.972us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 95.638us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s548ms, non-child: 14.432us, % non-child: 0.00%) - ConvertRowBatchTime: 7.472us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 177.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 59.854ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s547ms - DataArrivalTimer: 1s547ms SenderSide: - DeserializeRowBatchTimer: 15.010us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s652ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1417764) - BuildTime: 1s733ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 614.13 MB (643961088) - ProbeRows: 37.05M (37048165) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s703ms - RowsReturned: 708 (708) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s437ms - BuildRowsPartitioned: 1.42M (1417764) - GetNewBlockTime: 3.543ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.93K (2929) - HashTablesBuildTime: 280.923ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 614.06 MB (643889280) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 208.445ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.725ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1417764) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 470.37 KB, 18.31 MB, 51.19 MB, 89.64 MB, 127.41 MB, 154.74 MB, 170.92 MB, 180.42 MB, 187.97 MB, 194.59 MB, 200.34 MB, 205.28 MB, 210.45 MB, 215.92 MB, 220.45 MB, 224.00 MB, 226.82 MB, 229.44 MB, 232.00 MB, 234.28 MB, 236.34 MB, 238.32 MB, 239.96 MB, 241.46 MB, 242.77 MB, 244.17 MB, 245.21 MB, 246.09 MB, 246.70 MB, 247.20 MB, 247.58 MB, 247.85 MB, 248.08 MB, 248.15 MB, 248.63 MB, 249.60 MB, 249.60 MB, 249.60 MB, 249.60 MB, 249.60 MB, 249.60 MB, 249.60 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 249.60 MB (261726461) - TotalGetBatchTime: 10m37s - DataArrivalTimer: 10m37s SenderSide: - DeserializeRowBatchTimer: 1s917ms - NumBatchesAccepted: 12.73K (12728) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s432ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s073ms - PeakMemoryUsage: 0 - RowsReturned: 37.05M (37048165) - RowsReturnedRate: 312.23 K/sec RecvrSide: BytesReceived(16s000ms): 5.57 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.16 MB, 108.10 MB, 369.25 MB, 499.05 MB, 563.88 MB, 611.70 MB, 643.18 MB, 659.76 MB - FirstBatchArrivalWaitTime: 4s384ms - TotalBytesReceived: 664.79 MB (697078140) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s217ms - NumBatchesAccepted: 56.62K (56624) - NumBatchesRejected: 82 (82) Instance 5f429df048b5534b:41bcce1800000291 (host=foo.187.49:22000):(Total: 12m39s, non-child: 65.164ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.88 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 23.66 MB, 161.42 MB, 162.43 MB, 235.93 MB, 290.44 MB, 318.40 MB, 354.42 MB, 394.45 MB, 406.69 MB, 410.42 MB, 416.41 MB, 418.39 MB, 418.88 MB, 426.44 MB, 426.43 MB, 426.43 MB, 440.92 MB, 449.68 MB, 450.43 MB, 450.40 MB, 456.42 MB, 458.43 MB, 458.66 MB, 466.43 MB, 466.41 MB, 466.44 MB, 466.41 MB, 466.42 MB, 466.43 MB, 471.69 MB, 482.44 MB, 482.39 MB, 482.42 MB, 482.41 MB, 494.20 MB, 665.72 MB, 666.09 MB, 665.56 MB, 666.18 MB, 666.07 MB, 665.79 MB, 665.60 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 679.31 MB (712309558) - PerHostPeakMemUsage: 1.31 GB (1403865257) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 12.091ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.93K (3934) - TotalThreadsTotalWallClockTime: 23m23s - TotalThreadsSysTime: 1s217ms - TotalThreadsUserTime: 9s435ms - TotalThreadsVoluntaryContextSwitches: 63.45K (63452) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 49.815ms - ExecTreePrepareTime: 1.055ms DataStreamSender (dst_id=26):(Total: 596.408us, non-child: 596.408us, % non-child: 100.00%) - BytesSent: 9.95 KB (10187) - OverallThroughput: 16.29 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 44 (44) - SerializeBatchTime: 367.424us - UncompressedRowBatchSize: 9.95 KB (10187) CodeGen:(Total: 654.964ms, non-child: 654.964ms, % non-child: 100.00%) - CodegenTime: 15.914ms - CompileTime: 222.008ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 405.800ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.566ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 590.464ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 435.390us - GetResultsTime: 100.957us - HTResizeTime: 0.000ns - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9910244) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 578.276ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.029ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.015ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 106.040us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 429.827us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 140.494us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 176.653us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s279ms, non-child: 73.433us, % non-child: 0.00%) - ConvertRowBatchTime: 50.044us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 519.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 98.927ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s279ms - DataArrivalTimer: 3s279ms SenderSide: - DeserializeRowBatchTimer: 434.097us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 9.823ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 319.243us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 115.191us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.753us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 108.877us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.249us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s446ms, non-child: 18.739us, % non-child: 0.00%) - ConvertRowBatchTime: 8.283us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 189.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 58.060ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s446ms - DataArrivalTimer: 1s446ms SenderSide: - DeserializeRowBatchTimer: 34.503us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s663ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.52M (1517940) - BuildTime: 1s844ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 654.13 MB (685904318) - ProbeRows: 37.00M (36998648) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s610ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s535ms - BuildRowsPartitioned: 1.52M (1517940) - GetNewBlockTime: 3.468ms - HashBuckets: 3.93M (3932160) - HashCollisions: 4.48K (4476) - HashTablesBuildTime: 294.707ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 654.06 MB (685832320) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 215.799ms, % non-child: 0.03%) - ConvertRowBatchTime: 104.415ms - PeakMemoryUsage: 0 - RowsReturned: 1.52M (1517940) - RowsReturnedRate: 2.38 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 647.93 KB, 20.51 MB, 56.25 MB, 97.62 MB, 137.40 MB, 166.52 MB, 184.02 MB, 194.14 MB, 202.21 MB, 209.41 MB, 215.59 MB, 220.93 MB, 226.47 MB, 232.34 MB, 237.33 MB, 241.30 MB, 244.40 MB, 247.24 MB, 249.91 MB, 252.31 MB, 254.51 MB, 256.60 MB, 258.31 MB, 259.75 MB, 261.24 MB, 262.56 MB, 263.74 MB, 264.62 MB, 265.15 MB, 265.64 MB, 266.00 MB, 266.33 MB, 266.59 MB, 266.70 MB, 267.13 MB, 268.04 MB, 268.04 MB, 268.04 MB, 268.04 MB, 268.04 MB, 268.04 MB, 268.04 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 268.04 MB (281058246) - TotalGetBatchTime: 10m37s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s999ms - NumBatchesAccepted: 13.62K (13620) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s400ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s046ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (36998648) - RowsReturnedRate: 311.48 K/sec RecvrSide: BytesReceived(16s000ms): 5.79 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.29 MB, 112.06 MB, 374.48 MB, 500.17 MB, 564.52 MB, 611.78 MB, 642.98 MB, 659.13 MB - FirstBatchArrivalWaitTime: 4s380ms - TotalBytesReceived: 663.98 MB (696238397) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 3s844ms - NumBatchesAccepted: 56.55K (56553) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce1800000290 (host=foo.187.41:22000):(Total: 12m39s, non-child: 69.225ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.98 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.73 MB, 161.42 MB, 162.41 MB, 221.66 MB, 290.39 MB, 298.90 MB, 341.91 MB, 362.41 MB, 377.17 MB, 400.15 MB, 408.40 MB, 418.41 MB, 418.40 MB, 418.41 MB, 418.91 MB, 426.42 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.41 MB, 426.41 MB, 428.67 MB, 445.90 MB, 450.40 MB, 450.40 MB, 450.42 MB, 450.41 MB, 450.41 MB, 450.38 MB, 450.39 MB, 450.40 MB, 450.41 MB, 450.35 MB, 450.40 MB, 461.65 MB, 627.95 MB, 627.53 MB, 627.87 MB, 628.34 MB, 628.05 MB, 628.53 MB, 628.71 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.30 MB (672455350) - PerHostPeakMemUsage: 1.30 GB (1397928494) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 14.981ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.61K (3611) - TotalThreadsTotalWallClockTime: 23m22s - TotalThreadsSysTime: 1s166ms - TotalThreadsUserTime: 9s403ms - TotalThreadsVoluntaryContextSwitches: 63.80K (63804) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 49.634ms - ExecTreePrepareTime: 708.439us DataStreamSender (dst_id=26):(Total: 550.462us, non-child: 550.462us, % non-child: 100.00%) - BytesSent: 11.70 KB (11982) - OverallThroughput: 20.76 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 55 (55) - SerializeBatchTime: 397.227us - UncompressedRowBatchSize: 11.70 KB (11982) CodeGen:(Total: 654.591ms, non-child: 654.591ms, % non-child: 100.00%) - CodegenTime: 17.798ms - CompileTime: 214.861ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 414.871ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.363ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 617.174ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.439us - GetResultsTime: 139.623us - HTResizeTime: 287.260us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.71 MB (17525386) - PinTime: 0.000ns - ReductionFactorEstimate: 86698601.00 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - StreamingTime: 605.751ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.155ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 704.129us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 16.23 MB (17016586) - ProbeRows: 2.13K (2127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 388.279us - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 174.315us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 130.890us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 190.511us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s046ms, non-child: 75.155us, % non-child: 0.00%) - ConvertRowBatchTime: 57.761us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 832.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 70.260ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s046ms - DataArrivalTimer: 2s046ms SenderSide: - DeserializeRowBatchTimer: 243.544us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 2.299ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 629.527us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565337) - ProbeRows: 2.13K (2127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 299.877us - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.244us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 235.700us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.108us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s514ms, non-child: 18.867us, % non-child: 0.00%) - ConvertRowBatchTime: 8.132us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 180.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 30.490ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s514ms - DataArrivalTimer: 1s514ms SenderSide: - DeserializeRowBatchTimer: 104.053us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s623ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1449470) - BuildTime: 1s823ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.09M (37092671) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s587ms - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s498ms - BuildRowsPartitioned: 1.45M (1449470) - GetNewBlockTime: 2.844ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.87K (3873) - HashTablesBuildTime: 310.335ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 208.820ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.998ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1449470) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 645.46 KB, 19.65 MB, 53.65 MB, 92.84 MB, 130.78 MB, 158.24 MB, 174.79 MB, 184.48 MB, 192.16 MB, 199.03 MB, 204.87 MB, 209.98 MB, 215.33 MB, 221.00 MB, 225.79 MB, 229.57 MB, 232.53 MB, 235.29 MB, 237.92 MB, 240.22 MB, 242.32 MB, 244.33 MB, 245.96 MB, 247.28 MB, 248.65 MB, 249.91 MB, 251.03 MB, 251.71 MB, 252.39 MB, 252.86 MB, 253.18 MB, 253.58 MB, 253.80 MB, 253.87 MB, 254.39 MB, 255.32 MB, 255.32 MB, 255.32 MB, 255.32 MB, 255.32 MB, 255.32 MB, 255.32 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 255.32 MB (267725158) - TotalGetBatchTime: 10m37s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 2s145ms - NumBatchesAccepted: 13.01K (13006) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s402ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s050ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37092671) - RowsReturnedRate: 312.38 K/sec RecvrSide: BytesReceived(16s000ms): 5.84 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.39 MB, 113.58 MB, 376.86 MB, 501.69 MB, 566.11 MB, 613.44 MB, 644.67 MB, 660.72 MB - FirstBatchArrivalWaitTime: 4s354ms - TotalBytesReceived: 665.56 MB (697885511) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s152ms - NumBatchesAccepted: 56.69K (56691) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce1800000218 (host=foo.187.43:22000):(Total: 12m39s, non-child: 112.867ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.51 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 23.30 MB, 158.38 MB, 162.40 MB, 221.15 MB, 290.39 MB, 295.38 MB, 340.40 MB, 367.40 MB, 378.88 MB, 401.40 MB, 413.15 MB, 418.38 MB, 418.42 MB, 418.39 MB, 418.40 MB, 418.39 MB, 418.40 MB, 418.39 MB, 424.65 MB, 426.40 MB, 426.40 MB, 431.65 MB, 434.40 MB, 448.64 MB, 458.39 MB, 458.41 MB, 458.38 MB, 458.41 MB, 458.38 MB, 458.39 MB, 458.39 MB, 458.42 MB, 458.42 MB, 458.49 MB, 503.21 MB, 636.55 MB, 635.89 MB, 635.74 MB, 636.31 MB, 635.70 MB, 636.20 MB, 636.12 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.28 MB (680822343) - PerHostPeakMemUsage: 1.31 GB (1402734431) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 41.928ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.97K (3971) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s250ms - TotalThreadsUserTime: 9s368ms - TotalThreadsVoluntaryContextSwitches: 64.15K (64152) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m41s - ExecTreeOpenTime: 10m40s - PrepareTime: 54.999ms - ExecTreePrepareTime: 1.090ms DataStreamSender (dst_id=26):(Total: 672.269us, non-child: 672.269us, % non-child: 100.00%) - BytesSent: 11.50 KB (11772) - OverallThroughput: 16.70 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 50 (50) - SerializeBatchTime: 553.774us - UncompressedRowBatchSize: 11.50 KB (11772) CodeGen:(Total: 641.488ms, non-child: 641.488ms, % non-child: 100.00%) - CodegenTime: 16.651ms - CompileTime: 209.701ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 399.868ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.257ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 614.739ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 56.236us - GetResultsTime: 159.988us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 601.756ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 1.987ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 745.520us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621557) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 153.666us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 218.191us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 128.465us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 215.694us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s803ms, non-child: 96.439us, % non-child: 0.01%) - ConvertRowBatchTime: 69.553us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 944.00 /sec RecvrSide: BytesReceived(16s000ms): 21.51 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 109.958ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s803ms - DataArrivalTimer: 1s803ms SenderSide: - DeserializeRowBatchTimer: 156.423us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 16.270ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 444.471us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565237) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 134.467us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.498us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 201.263us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.230us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s473ms, non-child: 22.848us, % non-child: 0.00%) - ConvertRowBatchTime: 8.988us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 185.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 70.995ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s473ms - DataArrivalTimer: 1s473ms SenderSide: - DeserializeRowBatchTimer: 44.963us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s541ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1439507) - BuildTime: 1s763ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654446848) - ProbeRows: 37.06M (37055626) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s563ms - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s475ms - BuildRowsPartitioned: 1.44M (1439507) - GetNewBlockTime: 4.112ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.49K (4491) - HashTablesBuildTime: 274.339ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 208.628ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.851ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1439507) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 549.94 KB, 19.05 MB, 52.97 MB, 92.37 MB, 130.69 MB, 158.23 MB, 174.76 MB, 184.45 MB, 192.20 MB, 199.07 MB, 204.96 MB, 210.06 MB, 215.35 MB, 220.90 MB, 225.60 MB, 229.35 MB, 232.30 MB, 235.09 MB, 237.72 MB, 239.98 MB, 242.03 MB, 244.03 MB, 245.68 MB, 246.93 MB, 248.39 MB, 249.55 MB, 250.76 MB, 251.48 MB, 252.06 MB, 252.71 MB, 253.07 MB, 253.40 MB, 253.55 MB, 253.60 MB, 254.02 MB, 254.96 MB, 254.96 MB, 254.96 MB, 254.96 MB, 254.96 MB, 254.96 MB, 254.96 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 254.96 MB (267347103) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s005ms - NumBatchesAccepted: 12.91K (12913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s444ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s060ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37055626) - RowsReturnedRate: 303.84 K/sec RecvrSide: BytesReceived(16s000ms): 5.64 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.36 MB, 109.85 MB, 371.83 MB, 499.85 MB, 564.54 MB, 612.18 MB, 643.58 MB, 659.99 MB - FirstBatchArrivalWaitTime: 4s395ms - TotalBytesReceived: 664.95 MB (697249331) - TotalGetBatchTime: 2m - DataArrivalTimer: 2m SenderSide: - DeserializeRowBatchTimer: 4s340ms - NumBatchesAccepted: 56.64K (56638) - NumBatchesRejected: 26 (26) Instance 5f429df048b5534b:41bcce180000025f (host=foo.187.46:22000):(Total: 12m39s, non-child: 71.459ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.82 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.72 MB, 158.92 MB, 162.42 MB, 219.67 MB, 290.43 MB, 303.92 MB, 339.41 MB, 357.43 MB, 369.90 MB, 393.42 MB, 407.91 MB, 412.90 MB, 418.43 MB, 418.42 MB, 423.91 MB, 426.43 MB, 426.41 MB, 426.40 MB, 426.41 MB, 433.42 MB, 434.43 MB, 440.91 MB, 442.40 MB, 442.90 MB, 450.41 MB, 450.41 MB, 453.90 MB, 458.40 MB, 458.41 MB, 458.40 MB, 458.44 MB, 458.37 MB, 458.43 MB, 458.40 MB, 477.64 MB, 631.89 MB, 632.13 MB, 631.94 MB, 631.76 MB, 631.88 MB, 631.85 MB, 631.86 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.36 GB (1457509964) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 13.132ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.02K (4019) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s202ms - TotalThreadsUserTime: 9s433ms - TotalThreadsVoluntaryContextSwitches: 63.96K (63959) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 53.403ms - ExecTreePrepareTime: 687.696us DataStreamSender (dst_id=26):(Total: 479.317us, non-child: 479.317us, % non-child: 100.00%) - BytesSent: 9.49 KB (9714) - OverallThroughput: 19.33 MB/sec - PeakMemoryUsage: 224.66 KB (230048) - RowsReturned: 43 (43) - SerializeBatchTime: 368.529us - UncompressedRowBatchSize: 9.49 KB (9714) CodeGen:(Total: 662.067ms, non-child: 662.067ms, % non-child: 100.00%) - CodegenTime: 16.268ms - CompileTime: 218.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 412.081ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.315ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 613.915ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 291.120us - GetResultsTime: 137.504us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927420) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 597.737ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.027ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 589.531us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623420) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.808us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 143.919us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 147.270us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 127.992us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s568ms, non-child: 60.639us, % non-child: 0.00%) - ConvertRowBatchTime: 42.456us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.09 K/sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 74.256ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s568ms - DataArrivalTimer: 1s568ms SenderSide: - DeserializeRowBatchTimer: 159.873us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 1.975ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 775.133us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567100) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.372us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35.298us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 489.824us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.595us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s431ms, non-child: 26.769us, % non-child: 0.00%) - ConvertRowBatchTime: 13.328us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 191.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 35.648ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s431ms - DataArrivalTimer: 1s431ms SenderSide: - DeserializeRowBatchTimer: 120.772us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s584ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1441165) - BuildTime: 1s750ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 37.19M (37188915) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s617ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s482ms - BuildRowsPartitioned: 1.44M (1441165) - GetNewBlockTime: 3.102ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.94K (2937) - HashTablesBuildTime: 256.489ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 208.529ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.144ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1441165) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 584.27 KB, 19.09 MB, 53.20 MB, 92.48 MB, 130.50 MB, 158.03 MB, 174.65 MB, 184.29 MB, 191.92 MB, 198.71 MB, 204.53 MB, 209.61 MB, 214.83 MB, 220.32 MB, 224.99 MB, 228.66 MB, 231.49 MB, 234.16 MB, 236.73 MB, 238.99 MB, 241.04 MB, 243.02 MB, 244.73 MB, 246.08 MB, 247.55 MB, 248.88 MB, 250.02 MB, 250.80 MB, 251.60 MB, 252.12 MB, 252.41 MB, 252.76 MB, 253.02 MB, 253.12 MB, 253.64 MB, 254.56 MB, 254.56 MB, 254.56 MB, 254.56 MB, 254.56 MB, 254.56 MB, 254.56 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 254.56 MB (266921668) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s986ms - NumBatchesAccepted: 12.93K (12930) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s424ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s065ms - PeakMemoryUsage: 0 - RowsReturned: 37.19M (37188915) - RowsReturnedRate: 311.13 K/sec RecvrSide: BytesReceived(16s000ms): 5.75 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.36 MB, 111.98 MB, 375.38 MB, 502.39 MB, 567.07 MB, 614.68 MB, 646.07 MB, 662.37 MB - FirstBatchArrivalWaitTime: 4s364ms - TotalBytesReceived: 667.29 MB (699700132) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s327ms - NumBatchesAccepted: 56.84K (56838) - NumBatchesRejected: 69 (69) Instance 5f429df048b5534b:41bcce1800000259 (host=foo.187.44:22000):(Total: 12m39s, non-child: 63.668ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.93 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.15 MB, 160.16 MB, 162.93 MB, 223.67 MB, 293.40 MB, 307.17 MB, 340.68 MB, 359.16 MB, 377.18 MB, 388.41 MB, 417.67 MB, 426.42 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.42 MB, 431.65 MB, 434.44 MB, 441.18 MB, 442.40 MB, 442.43 MB, 442.44 MB, 446.67 MB, 450.40 MB, 450.41 MB, 455.66 MB, 458.40 MB, 458.41 MB, 458.39 MB, 458.39 MB, 458.41 MB, 458.40 MB, 458.40 MB, 458.38 MB, 479.14 MB, 633.29 MB, 633.13 MB, 634.11 MB, 633.93 MB, 633.93 MB, 633.98 MB, 634.56 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.30 MB (678746806) - PerHostPeakMemUsage: 1.24 GB (1327683132) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m39s - TotalNetworkSendTime: 12.653ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.63K (3631) - TotalThreadsTotalWallClockTime: 23m22s - TotalThreadsSysTime: 1s259ms - TotalThreadsUserTime: 9s436ms - TotalThreadsVoluntaryContextSwitches: 63.72K (63717) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m41s - ExecTreeOpenTime: 10m41s - PrepareTime: 54.887ms - ExecTreePrepareTime: 633.739us DataStreamSender (dst_id=26):(Total: 478.361us, non-child: 478.361us, % non-child: 100.00%) - BytesSent: 11.10 KB (11364) - OverallThroughput: 22.66 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 50 (50) - SerializeBatchTime: 379.627us - UncompressedRowBatchSize: 11.10 KB (11364) CodeGen:(Total: 639.001ms, non-child: 639.001ms, % non-child: 100.00%) - CodegenTime: 15.213ms - CompileTime: 204.426ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 400.513ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.583ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 611.446ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 46.830us - GetResultsTime: 133.319us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 598.839ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.242ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 604.241us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 164.610us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 159.881us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 150.861us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 175.747us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s423ms, non-child: 67.671us, % non-child: 0.00%) - ConvertRowBatchTime: 44.603us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 497.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 98.033ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s423ms - DataArrivalTimer: 3s423ms SenderSide: - DeserializeRowBatchTimer: 209.787us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 27.966ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 458.280us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 165.428us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.080us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 105.606us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.243us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s549ms, non-child: 19.288us, % non-child: 0.00%) - ConvertRowBatchTime: 8.176us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 176.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 58.433ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s549ms - DataArrivalTimer: 1s549ms SenderSide: - DeserializeRowBatchTimer: 107.682us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s752ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1459078) - BuildTime: 1s827ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 37.12M (37121035) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s704ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s476ms - BuildRowsPartitioned: 1.46M (1459078) - GetNewBlockTime: 3.175ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.94K (3941) - HashTablesBuildTime: 336.586ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 209.504ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.100ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1459078) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 635.93 KB, 19.81 MB, 54.23 MB, 94.07 MB, 132.60 MB, 160.49 MB, 176.92 MB, 186.71 MB, 194.53 MB, 201.43 MB, 207.41 MB, 212.58 MB, 217.99 MB, 223.66 MB, 228.50 MB, 232.31 MB, 235.34 MB, 238.21 MB, 240.89 MB, 243.19 MB, 245.26 MB, 247.37 MB, 249.03 MB, 250.51 MB, 251.87 MB, 253.19 MB, 254.29 MB, 255.12 MB, 255.78 MB, 256.17 MB, 256.48 MB, 256.84 MB, 257.08 MB, 257.16 MB, 257.64 MB, 258.60 MB, 258.60 MB, 258.60 MB, 258.60 MB, 258.60 MB, 258.60 MB, 258.60 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 258.60 MB (271164855) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s780ms - NumBatchesAccepted: 13.09K (13089) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s424ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s063ms - PeakMemoryUsage: 0 - RowsReturned: 37.12M (37121035) - RowsReturnedRate: 310.97 K/sec RecvrSide: BytesReceived(16s000ms): 5.82 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.40 MB, 113.06 MB, 376.52 MB, 501.98 MB, 566.46 MB, 613.81 MB, 645.08 MB, 661.24 MB - FirstBatchArrivalWaitTime: 4s399ms - TotalBytesReceived: 666.09 MB (698444319) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s334ms - NumBatchesAccepted: 56.74K (56740) - NumBatchesRejected: 75 (75) Instance 5f429df048b5534b:41bcce180000023d (host=foo.187.45:22000):(Total: 12m39s, non-child: 75.553ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.57 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.47 MB, 157.91 MB, 162.42 MB, 209.40 MB, 290.40 MB, 290.43 MB, 311.16 MB, 341.90 MB, 361.15 MB, 394.91 MB, 410.41 MB, 410.40 MB, 416.68 MB, 418.42 MB, 418.40 MB, 418.42 MB, 418.43 MB, 418.40 MB, 418.41 MB, 418.40 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.41 MB, 418.43 MB, 418.42 MB, 418.41 MB, 418.41 MB, 424.17 MB, 426.41 MB, 426.39 MB, 427.66 MB, 434.46 MB, 434.35 MB, 461.92 MB, 608.82 MB, 608.65 MB, 608.06 MB, 607.92 MB, 607.95 MB, 607.81 MB, 607.82 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 621.30 MB (651483830) - PerHostPeakMemUsage: 1.31 GB (1401449535) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 16.884ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.94K (3938) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s236ms - TotalThreadsUserTime: 9s503ms - TotalThreadsVoluntaryContextSwitches: 63.51K (63510) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 44.925ms - ExecTreePrepareTime: 769.520us DataStreamSender (dst_id=26):(Total: 604.659us, non-child: 604.659us, % non-child: 100.00%) - BytesSent: 11.50 KB (11772) - OverallThroughput: 18.57 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 52 (52) - SerializeBatchTime: 445.826us - UncompressedRowBatchSize: 11.50 KB (11772) CodeGen:(Total: 726.724ms, non-child: 726.724ms, % non-child: 100.00%) - CodegenTime: 15.399ms - CompileTime: 236.516ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 465.903ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.809ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 625.969ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 186.340us - GetResultsTime: 124.100us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923657) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - StreamingTime: 612.955ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.363ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 567.876us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623753) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.336us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 147.777us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 126.529us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 174.401us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s847ms, non-child: 66.702us, % non-child: 0.00%) - ConvertRowBatchTime: 45.060us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 598.00 /sec RecvrSide: BytesReceived(16s000ms): 21.51 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 838.233us - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s847ms - DataArrivalTimer: 2s847ms SenderSide: - DeserializeRowBatchTimer: 234.787us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 8.256ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 681.188us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567433) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.243us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.171us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 375.548us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.803us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s342ms, non-child: 22.318us, % non-child: 0.00%) - ConvertRowBatchTime: 11.707us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 204.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s341ms - DataArrivalTimer: 1s341ms SenderSide: - DeserializeRowBatchTimer: 85.541us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s646ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1405389) - BuildTime: 1s735ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 596.13 MB (625086720) - ProbeRows: 37.21M (37206126) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s691ms - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s433ms - BuildRowsPartitioned: 1.41M (1405389) - GetNewBlockTime: 3.136ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.94K (2936) - HashTablesBuildTime: 288.630ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 596.06 MB (625014912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 195.757ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.574ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1405389) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 541.35 KB, 18.33 MB, 50.84 MB, 88.81 MB, 125.66 MB, 152.31 MB, 168.22 MB, 177.64 MB, 185.15 MB, 191.72 MB, 197.36 MB, 202.27 MB, 207.45 MB, 212.87 MB, 217.59 MB, 221.22 MB, 224.12 MB, 226.88 MB, 229.44 MB, 231.67 MB, 233.65 MB, 235.55 MB, 237.05 MB, 238.54 MB, 239.79 MB, 241.10 MB, 242.07 MB, 242.88 MB, 243.53 MB, 243.93 MB, 244.26 MB, 244.51 MB, 244.80 MB, 244.87 MB, 245.33 MB, 246.29 MB, 246.29 MB, 246.29 MB, 246.29 MB, 246.29 MB, 246.29 MB, 246.29 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 246.29 MB (258258318) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s649ms - NumBatchesAccepted: 12.61K (12610) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s426ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s066ms - PeakMemoryUsage: 0 - RowsReturned: 37.21M (37206126) - RowsReturnedRate: 309.55 K/sec RecvrSide: BytesReceived(16s000ms): 5.67 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.35 MB, 110.42 MB, 373.53 MB, 501.96 MB, 566.88 MB, 614.67 MB, 646.16 MB, 662.64 MB - FirstBatchArrivalWaitTime: 4s287ms - TotalBytesReceived: 667.63 MB (700055727) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s238ms - NumBatchesAccepted: 56.86K (56864) - NumBatchesRejected: 57 (57) Instance 5f429df048b5534b:41bcce1800000282 (host=foo.187.48:22000):(Total: 12m39s, non-child: 62.303ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.95 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 24.20 MB, 160.90 MB, 162.42 MB, 221.13 MB, 290.39 MB, 300.90 MB, 338.65 MB, 363.91 MB, 374.13 MB, 390.61 MB, 403.39 MB, 410.39 MB, 414.88 MB, 418.39 MB, 418.37 MB, 423.89 MB, 426.39 MB, 426.38 MB, 434.14 MB, 434.38 MB, 434.39 MB, 434.41 MB, 440.63 MB, 448.39 MB, 450.37 MB, 450.39 MB, 450.40 MB, 450.43 MB, 451.14 MB, 458.40 MB, 458.39 MB, 458.42 MB, 458.41 MB, 458.32 MB, 469.14 MB, 633.21 MB, 634.00 MB, 634.06 MB, 633.90 MB, 633.81 MB, 633.62 MB, 633.26 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.28 MB (678725191) - PerHostPeakMemUsage: 1.30 GB (1400009380) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 12.821ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.75K (3753) - TotalThreadsTotalWallClockTime: 23m21s - TotalThreadsSysTime: 1s186ms - TotalThreadsUserTime: 9s331ms - TotalThreadsVoluntaryContextSwitches: 63.14K (63139) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 46.236ms - ExecTreePrepareTime: 819.528us DataStreamSender (dst_id=26):(Total: 468.116us, non-child: 468.116us, % non-child: 100.00%) - BytesSent: 11.00 KB (11261) - OverallThroughput: 22.94 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 48 (48) - SerializeBatchTime: 367.668us - UncompressedRowBatchSize: 11.00 KB (11261) CodeGen:(Total: 627.265ms, non-child: 627.265ms, % non-child: 100.00%) - CodegenTime: 15.462ms - CompileTime: 200.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 401.286ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.832ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 588.171ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 57.517us - GetResultsTime: 97.961us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9922211) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 576.157ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.217ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 978.323us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619211) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.692us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 243.034us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 161.456us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 164.989us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s038ms, non-child: 101.247us, % non-child: 0.00%) - ConvertRowBatchTime: 61.301us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 835.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 66.098ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s038ms - DataArrivalTimer: 2s038ms SenderSide: - DeserializeRowBatchTimer: 134.147us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 7.970ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 702.759us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562891) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.529us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.286us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 279.712us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.571us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s419ms, non-child: 22.593us, % non-child: 0.00%) - ConvertRowBatchTime: 10.558us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 192.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 25.911ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s419ms - DataArrivalTimer: 1s419ms SenderSide: - DeserializeRowBatchTimer: 58.658us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s583ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1436828) - BuildTime: 1s735ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 36.92M (36919435) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s638ms - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s451ms - BuildRowsPartitioned: 1.44M (1436828) - GetNewBlockTime: 2.797ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.25K (3246) - HashTablesBuildTime: 271.063ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 202.226ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.897ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1436828) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 647.47 KB, 19.60 MB, 53.56 MB, 92.89 MB, 131.22 MB, 158.48 MB, 174.58 MB, 184.24 MB, 192.08 MB, 198.98 MB, 204.84 MB, 209.97 MB, 215.29 MB, 220.84 MB, 225.53 MB, 229.27 MB, 232.22 MB, 234.99 MB, 237.61 MB, 239.93 MB, 241.89 MB, 243.75 MB, 245.30 MB, 246.64 MB, 248.02 MB, 249.17 MB, 250.32 MB, 251.06 MB, 251.60 MB, 252.07 MB, 252.41 MB, 252.72 MB, 252.96 MB, 253.05 MB, 253.45 MB, 254.38 MB, 254.38 MB, 254.38 MB, 254.38 MB, 254.38 MB, 254.38 MB, 254.38 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 254.38 MB (266738921) - TotalGetBatchTime: 10m37s - DataArrivalTimer: 10m37s SenderSide: - DeserializeRowBatchTimer: 1s689ms - NumBatchesAccepted: 12.89K (12894) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s404ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 36.92M (36919435) - RowsReturnedRate: 311.17 K/sec RecvrSide: BytesReceived(16s000ms): 5.83 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.38 MB, 113.02 MB, 375.19 MB, 499.46 MB, 563.61 MB, 610.71 MB, 641.78 MB, 657.79 MB - FirstBatchArrivalWaitTime: 4s350ms - TotalBytesReceived: 662.60 MB (694788888) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s063ms - NumBatchesAccepted: 56.43K (56426) - NumBatchesRejected: 79 (79) Instance 5f429df048b5534b:41bcce1800000266 (host=foo.187.42:22000):(Total: 12m39s, non-child: 71.633ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.88 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.47 MB, 157.17 MB, 162.41 MB, 209.17 MB, 286.90 MB, 290.92 MB, 319.17 MB, 339.66 MB, 365.93 MB, 386.44 MB, 386.41 MB, 394.17 MB, 406.41 MB, 410.44 MB, 410.40 MB, 410.40 MB, 410.43 MB, 410.40 MB, 410.42 MB, 413.66 MB, 418.41 MB, 418.40 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.43 MB, 418.42 MB, 418.42 MB, 423.65 MB, 426.41 MB, 441.92 MB, 442.40 MB, 442.47 MB, 442.44 MB, 462.23 MB, 609.10 MB, 609.94 MB, 609.95 MB, 609.85 MB, 609.77 MB, 610.45 MB, 610.13 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 623.30 MB (653580982) - PerHostPeakMemUsage: 1.21 GB (1294039108) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 14.695ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.92K (3918) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s222ms - TotalThreadsUserTime: 9s340ms - TotalThreadsVoluntaryContextSwitches: 63.30K (63303) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 46.418ms - ExecTreePrepareTime: 678.359us DataStreamSender (dst_id=26):(Total: 706.791us, non-child: 706.791us, % non-child: 100.00%) - BytesSent: 10.46 KB (10710) - OverallThroughput: 14.45 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 47 (47) - SerializeBatchTime: 579.626us - UncompressedRowBatchSize: 10.46 KB (10710) CodeGen:(Total: 671.254ms, non-child: 671.254ms, % non-child: 100.00%) - CodegenTime: 15.729ms - CompileTime: 225.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 422.251ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.034ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 621.733ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.822us - GetResultsTime: 148.293us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924728) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 606.857ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.182ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 487.454us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 146.572us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 155.038us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 128.149us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.247us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s997ms, non-child: 80.497us, % non-child: 0.00%) - ConvertRowBatchTime: 60.215us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 853.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 19.428ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s997ms - DataArrivalTimer: 1s997ms SenderSide: - DeserializeRowBatchTimer: 175.949us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 16.048ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 653.245us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.185us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54.740us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 191.914us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 135.178us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s369ms, non-child: 14.313us, % non-child: 0.00%) - ConvertRowBatchTime: 7.247us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 200.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s369ms - DataArrivalTimer: 1s369ms SenderSide: - DeserializeRowBatchTimer: 31.582us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s487ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.36M (1358569) - BuildTime: 1s642ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 37.15M (37146980) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s626ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s374ms - BuildRowsPartitioned: 1.36M (1358569) - GetNewBlockTime: 2.655ms - HashBuckets: 2.88M (2883584) - HashCollisions: 3.24K (3237) - HashTablesBuildTime: 254.572ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 195.332ms, % non-child: 0.03%) - ConvertRowBatchTime: 90.556ms - PeakMemoryUsage: 0 - RowsReturned: 1.36M (1358569) - RowsReturnedRate: 2.13 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 575.42 KB, 18.47 MB, 50.75 MB, 88.03 MB, 124.20 MB, 150.26 MB, 166.16 MB, 175.35 MB, 182.62 MB, 189.11 MB, 194.63 MB, 199.38 MB, 204.29 MB, 209.44 MB, 213.92 MB, 217.45 MB, 220.29 MB, 222.98 MB, 225.51 MB, 227.65 MB, 229.61 MB, 231.50 MB, 233.07 MB, 234.44 MB, 235.80 MB, 237.06 MB, 238.08 MB, 238.84 MB, 239.40 MB, 239.82 MB, 240.11 MB, 240.44 MB, 240.63 MB, 240.67 MB, 241.14 MB, 242.05 MB, 242.05 MB, 242.05 MB, 242.05 MB, 242.05 MB, 242.05 MB, 242.05 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 242.05 MB (253812271) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s603ms - NumBatchesAccepted: 12.20K (12196) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s428ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.15M (37146980) - RowsReturnedRate: 311.01 K/sec RecvrSide: BytesReceived(16s000ms): 5.79 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.37 MB, 112.53 MB, 376.00 MB, 502.07 MB, 566.61 MB, 614.10 MB, 645.45 MB, 661.67 MB - FirstBatchArrivalWaitTime: 4s306ms - TotalBytesReceived: 666.56 MB (698936652) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s371ms - NumBatchesAccepted: 56.77K (56775) - NumBatchesRejected: 68 (68) Instance 5f429df048b5534b:41bcce180000024f (host=foo.187.40:22000):(Total: 12m39s, non-child: 69.372ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.64 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.57 MB, 156.18 MB, 162.43 MB, 203.68 MB, 288.42 MB, 291.16 MB, 317.93 MB, 341.18 MB, 354.41 MB, 365.39 MB, 386.92 MB, 394.40 MB, 401.67 MB, 410.43 MB, 417.90 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.41 MB, 418.42 MB, 418.42 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.43 MB, 418.40 MB, 418.41 MB, 423.40 MB, 426.41 MB, 426.41 MB, 430.18 MB, 434.40 MB, 434.44 MB, 434.39 MB, 458.95 MB, 612.63 MB, 612.47 MB, 611.96 MB, 611.60 MB, 611.79 MB, 612.43 MB, 612.19 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 625.30 MB (655678134) - PerHostPeakMemUsage: 1.23 GB (1316349865) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 13.990ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.11K (4109) - TotalThreadsTotalWallClockTime: 23m21s - TotalThreadsSysTime: 1s232ms - TotalThreadsUserTime: 9s532ms - TotalThreadsVoluntaryContextSwitches: 62.55K (62551) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 46.931ms - ExecTreePrepareTime: 708.458us DataStreamSender (dst_id=26):(Total: 515.980us, non-child: 515.980us, % non-child: 100.00%) - BytesSent: 9.55 KB (9781) - OverallThroughput: 18.08 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 44 (44) - SerializeBatchTime: 375.952us - UncompressedRowBatchSize: 9.55 KB (9781) CodeGen:(Total: 679.513ms, non-child: 679.513ms, % non-child: 100.00%) - CodegenTime: 15.414ms - CompileTime: 222.950ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 430.401ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.630ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 653.016ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 63.035us - GetResultsTime: 144.152us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924132) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 639.633ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.884ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 598.215us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620132) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.528us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 120.132us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 161.883us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 143.116us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s317ms, non-child: 75.186us, % non-child: 0.00%) - ConvertRowBatchTime: 53.994us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 513.00 /sec RecvrSide: BytesReceived(16s000ms): 21.51 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 27.862ms - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s317ms - DataArrivalTimer: 3s317ms SenderSide: - DeserializeRowBatchTimer: 240.277us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.245ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 412.318us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563812) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.557us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.546us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 100.314us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.344us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s375ms, non-child: 15.486us, % non-child: 0.00%) - ConvertRowBatchTime: 7.841us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 199.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s375ms - DataArrivalTimer: 1s375ms SenderSide: - DeserializeRowBatchTimer: 81.304us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s655ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.37M (1365268) - BuildTime: 1s685ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 600.13 MB (629281239) - ProbeRows: 37.07M (37069252) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s752ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s406ms - BuildRowsPartitioned: 1.37M (1365268) - GetNewBlockTime: 3.200ms - HashBuckets: 3.01M (3014656) - HashCollisions: 4.16K (4159) - HashTablesBuildTime: 265.075ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 600.06 MB (629209216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 201.983ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.977ms - PeakMemoryUsage: 0 - RowsReturned: 1.37M (1365268) - RowsReturnedRate: 2.15 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 519.78 KB, 17.90 MB, 50.04 MB, 87.29 MB, 123.60 MB, 149.60 MB, 165.40 MB, 174.50 MB, 181.85 MB, 188.35 MB, 193.88 MB, 198.62 MB, 203.61 MB, 208.87 MB, 213.33 MB, 216.85 MB, 219.66 MB, 222.29 MB, 224.80 MB, 226.98 MB, 228.98 MB, 230.86 MB, 232.41 MB, 233.76 MB, 235.04 MB, 236.27 MB, 237.35 MB, 238.15 MB, 238.71 MB, 239.12 MB, 239.43 MB, 239.75 MB, 239.89 MB, 239.94 MB, 240.42 MB, 241.41 MB, 241.41 MB, 241.41 MB, 241.41 MB, 241.41 MB, 241.41 MB, 241.41 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 241.41 MB (253137074) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s581ms - NumBatchesAccepted: 12.26K (12255) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s456ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s070ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37069252) - RowsReturnedRate: 310.14 K/sec RecvrSide: BytesReceived(16s000ms): 5.71 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.32 MB, 110.84 MB, 373.20 MB, 500.54 MB, 565.09 MB, 612.59 MB, 643.92 MB, 660.22 MB - FirstBatchArrivalWaitTime: 4s309ms - TotalBytesReceived: 665.14 MB (697454192) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s235ms - NumBatchesAccepted: 56.66K (56656) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce180000022a (host=foo.187.39:22000):(Total: 12m39s, non-child: 93.768ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.99 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.20 MB, 160.17 MB, 162.41 MB, 221.66 MB, 291.66 MB, 298.40 MB, 333.90 MB, 364.16 MB, 382.41 MB, 394.41 MB, 402.41 MB, 418.93 MB, 426.42 MB, 426.41 MB, 426.40 MB, 426.39 MB, 426.41 MB, 426.44 MB, 426.40 MB, 426.43 MB, 426.44 MB, 426.44 MB, 426.41 MB, 426.43 MB, 426.40 MB, 426.40 MB, 426.45 MB, 426.38 MB, 426.42 MB, 426.37 MB, 426.45 MB, 427.39 MB, 434.45 MB, 434.45 MB, 481.17 MB, 617.48 MB, 617.48 MB, 617.98 MB, 617.75 MB, 617.65 MB, 617.94 MB, 618.66 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.31 GB (1408008825) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 28.617ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.81K (3806) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s225ms - TotalThreadsUserTime: 9s781ms - TotalThreadsVoluntaryContextSwitches: 63.64K (63640) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 48.304ms - ExecTreePrepareTime: 607.218us DataStreamSender (dst_id=26):(Total: 580.006us, non-child: 580.006us, % non-child: 100.00%) - BytesSent: 10.10 KB (10345) - OverallThroughput: 17.01 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 47 (47) - SerializeBatchTime: 400.246us - UncompressedRowBatchSize: 10.10 KB (10345) CodeGen:(Total: 722.039ms, non-child: 722.039ms, % non-child: 100.00%) - CodegenTime: 15.855ms - CompileTime: 247.918ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 447.698ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.881ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 656.926ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 142.675us - GetResultsTime: 115.378us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9922232) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 643.717ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.751ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 878.459us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622328) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 121.313us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 186.369us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 342.682us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 164.342us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s966ms, non-child: 77.241us, % non-child: 0.00%) - ConvertRowBatchTime: 57.673us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 866.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s966ms - DataArrivalTimer: 1s966ms SenderSide: - DeserializeRowBatchTimer: 192.627us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 4.218ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 609.623us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566008) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.729us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.580us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 283.557us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.252us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s430ms, non-child: 13.101us, % non-child: 0.00%) - ConvertRowBatchTime: 4.559us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 191.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s430ms - DataArrivalTimer: 1s430ms SenderSide: - DeserializeRowBatchTimer: 17.793us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s900ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1422542) - BuildTime: 1s808ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635572480) - ProbeRows: 37.10M (37102668) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s862ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s488ms - BuildRowsPartitioned: 1.42M (1422542) - GetNewBlockTime: 3.691ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.84K (3839) - HashTablesBuildTime: 306.286ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 204.581ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.886ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1422542) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 632.79 KB, 19.52 MB, 53.61 MB, 93.03 MB, 131.24 MB, 158.65 MB, 174.58 MB, 184.08 MB, 191.53 MB, 198.14 MB, 203.90 MB, 208.92 MB, 214.13 MB, 219.53 MB, 224.15 MB, 227.82 MB, 230.63 MB, 233.29 MB, 235.72 MB, 237.91 MB, 239.91 MB, 241.86 MB, 243.46 MB, 244.82 MB, 246.18 MB, 247.45 MB, 248.52 MB, 249.27 MB, 249.87 MB, 250.40 MB, 250.57 MB, 250.85 MB, 251.07 MB, 251.15 MB, 251.66 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB, 252.54 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 252.54 MB (264807929) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s916ms - NumBatchesAccepted: 12.77K (12767) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s468ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s088ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37102668) - RowsReturnedRate: 306.49 K/sec RecvrSide: BytesReceived(16s000ms): 5.85 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.52 MB, 113.77 MB, 377.15 MB, 501.88 MB, 566.36 MB, 613.64 MB, 644.88 MB, 660.95 MB - FirstBatchArrivalWaitTime: 4s275ms - TotalBytesReceived: 665.77 MB (698109949) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s385ms - NumBatchesAccepted: 56.71K (56711) - NumBatchesRejected: 40 (40) Instance 5f429df048b5534b:41bcce180000028d (host=foo.187.55:22000):(Total: 12m39s, non-child: 71.545ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.96 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.98 MB, 159.19 MB, 162.43 MB, 215.66 MB, 289.65 MB, 308.14 MB, 338.13 MB, 347.14 MB, 369.40 MB, 382.69 MB, 393.39 MB, 394.43 MB, 401.18 MB, 416.66 MB, 418.41 MB, 423.16 MB, 426.41 MB, 430.91 MB, 434.42 MB, 442.41 MB, 444.17 MB, 450.43 MB, 457.66 MB, 466.43 MB, 466.42 MB, 466.43 MB, 466.41 MB, 466.39 MB, 466.42 MB, 466.41 MB, 466.44 MB, 466.39 MB, 466.40 MB, 466.45 MB, 477.14 MB, 637.39 MB, 637.58 MB, 638.07 MB, 637.92 MB, 637.76 MB, 638.35 MB, 638.40 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.30 MB (682941110) - PerHostPeakMemUsage: 1.31 GB (1401305784) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 11.528ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.90K (3896) - TotalThreadsTotalWallClockTime: 23m22s - TotalThreadsSysTime: 1s227ms - TotalThreadsUserTime: 9s321ms - TotalThreadsVoluntaryContextSwitches: 63.24K (63242) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 51.689ms - ExecTreePrepareTime: 816.829us DataStreamSender (dst_id=26):(Total: 618.718us, non-child: 618.718us, % non-child: 100.00%) - BytesSent: 9.85 KB (10089) - OverallThroughput: 15.55 MB/sec - PeakMemoryUsage: 228.66 KB (234144) - RowsReturned: 46 (46) - SerializeBatchTime: 482.469us - UncompressedRowBatchSize: 9.85 KB (10089) CodeGen:(Total: 621.100ms, non-child: 621.100ms, % non-child: 100.00%) - CodegenTime: 24.566ms - CompileTime: 201.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 396.157ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.307ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 603.232ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 45.377us - GetResultsTime: 135.630us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 591.062ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m38s, non-child: 2.470ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.052ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.660us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 160.755us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 369.271us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 116.297us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s771ms, non-child: 63.630us, % non-child: 0.00%) - ConvertRowBatchTime: 43.101us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 614.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s771ms - DataArrivalTimer: 2s771ms SenderSide: - DeserializeRowBatchTimer: 232.359us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m38s, non-child: 16.037ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 757.708us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.770us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 58.789us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 331.815us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 153.370us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s281ms, non-child: 17.487us, % non-child: 0.00%) - ConvertRowBatchTime: 7.163us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 213.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s281ms - DataArrivalTimer: 1s281ms SenderSide: - DeserializeRowBatchTimer: 99.049us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m38s, non-child: 6s563ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1415302) - BuildTime: 1s770ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 37.14M (37140887) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s581ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s448ms - BuildRowsPartitioned: 1.42M (1415302) - GetNewBlockTime: 3.028ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.85K (3855) - HashTablesBuildTime: 308.816ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 197.794ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.241ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1415302) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 622.04 KB, 19.35 MB, 52.66 MB, 91.26 MB, 129.01 MB, 156.30 MB, 172.58 MB, 182.17 MB, 189.82 MB, 196.57 MB, 202.41 MB, 207.47 MB, 212.80 MB, 218.33 MB, 223.04 MB, 226.76 MB, 229.72 MB, 232.43 MB, 235.05 MB, 237.32 MB, 239.37 MB, 241.24 MB, 242.73 MB, 244.12 MB, 245.38 MB, 246.70 MB, 247.74 MB, 248.57 MB, 249.25 MB, 249.63 MB, 249.88 MB, 250.15 MB, 250.41 MB, 250.51 MB, 250.96 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB, 251.93 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 251.93 MB (264172854) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s751ms - NumBatchesAccepted: 12.70K (12699) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s411ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s054ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37140887) - RowsReturnedRate: 313.14 K/sec RecvrSide: BytesReceived(16s000ms): 5.84 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.34 MB, 113.31 MB, 376.85 MB, 502.15 MB, 566.66 MB, 614.10 MB, 645.37 MB, 661.51 MB - FirstBatchArrivalWaitTime: 4s205ms - TotalBytesReceived: 666.37 MB (698734989) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s178ms - NumBatchesAccepted: 56.77K (56765) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce1800000230 (host=foo.221.14:22000):(Total: 12m39s, non-child: 200.067ms, % non-child: 0.03%) MemoryUsage(16s000ms): 13.58 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.48 MB, 158.91 MB, 162.43 MB, 220.16 MB, 290.42 MB, 293.67 MB, 333.93 MB, 364.67 MB, 387.67 MB, 409.65 MB, 416.91 MB, 418.42 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.43 MB, 418.41 MB, 418.42 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.41 MB, 418.40 MB, 418.44 MB, 421.68 MB, 426.40 MB, 432.66 MB, 441.14 MB, 442.43 MB, 442.44 MB, 442.91 MB, 450.39 MB, 457.59 MB, 458.44 MB, 498.35 MB, 640.12 MB, 639.90 MB, 639.81 MB, 639.42 MB, 639.76 MB, 640.24 MB, 640.06 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 653.30 MB (685038262) - PerHostPeakMemUsage: 1.25 GB (1338050302) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 140.035ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.62K (3625) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s219ms - TotalThreadsUserTime: 9s312ms - TotalThreadsVoluntaryContextSwitches: 64.12K (64125) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 60.140ms - ExecTreePrepareTime: 827.768us DataStreamSender (dst_id=26):(Total: 473.717us, non-child: 473.717us, % non-child: 100.00%) - BytesSent: 12.56 KB (12862) - OverallThroughput: 25.89 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 56 (56) - SerializeBatchTime: 335.911us - UncompressedRowBatchSize: 12.56 KB (12862) CodeGen:(Total: 652.808ms, non-child: 652.808ms, % non-child: 100.00%) - CodegenTime: 16.983ms - CompileTime: 210.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 405.423ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 36.450ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 600.428ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 249.092us - GetResultsTime: 91.642us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925757) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 586.782ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.104ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 2.169ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621757) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 151.084us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 207.031us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.431ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 171.284us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s798ms, non-child: 77.188us, % non-child: 0.00%) - ConvertRowBatchTime: 47.786us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 947.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s797ms - DataArrivalTimer: 1s797ms SenderSide: - DeserializeRowBatchTimer: 176.914us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 14.778ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.629ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565437) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 139.858us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.018us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.262ms - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.247us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s178ms, non-child: 20.414us, % non-child: 0.00%) - ConvertRowBatchTime: 9.802us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 232.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s178ms - DataArrivalTimer: 1s178ms SenderSide: - DeserializeRowBatchTimer: 54.910us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s602ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1448471) - BuildTime: 1s721ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 628.13 MB (658641152) - ProbeRows: 37.18M (37179199) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s659ms - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s387ms - BuildRowsPartitioned: 1.45M (1448471) - GetNewBlockTime: 2.480ms - HashBuckets: 3.80M (3801088) - HashCollisions: 3.52K (3523) - HashTablesBuildTime: 320.031ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 628.06 MB (658569344) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 193.263ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.045ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1448471) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 770.89 KB, 20.15 MB, 54.14 MB, 93.60 MB, 131.68 MB, 158.91 MB, 174.61 MB, 184.01 MB, 191.66 MB, 198.52 MB, 204.37 MB, 209.52 MB, 214.89 MB, 220.43 MB, 225.14 MB, 228.92 MB, 231.93 MB, 234.66 MB, 237.20 MB, 239.38 MB, 241.34 MB, 243.27 MB, 244.68 MB, 246.13 MB, 247.43 MB, 248.79 MB, 249.95 MB, 250.80 MB, 251.32 MB, 251.82 MB, 252.23 MB, 252.66 MB, 252.91 MB, 253.00 MB, 253.48 MB, 254.32 MB, 254.32 MB, 254.32 MB, 254.32 MB, 254.32 MB, 254.32 MB, 254.32 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 254.32 MB (266671731) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s724ms - NumBatchesAccepted: 13.00K (13001) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s440ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s071ms - PeakMemoryUsage: 0 - RowsReturned: 37.18M (37179199) - RowsReturnedRate: 307.59 K/sec RecvrSide: BytesReceived(16s000ms): 6.06 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.88 MB, 117.88 MB, 382.75 MB, 504.41 MB, 568.63 MB, 615.62 MB, 646.70 MB, 662.42 MB - FirstBatchArrivalWaitTime: 4s105ms - TotalBytesReceived: 667.12 MB (699525997) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s467ms - NumBatchesAccepted: 56.83K (56825) - NumBatchesRejected: 56 (56) Instance 5f429df048b5534b:41bcce1800000286 (host=foo.221.12:22000):(Total: 12m39s, non-child: 66.933ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.14 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 24.22 MB, 160.43 MB, 162.42 MB, 213.92 MB, 289.63 MB, 302.18 MB, 334.42 MB, 347.19 MB, 366.91 MB, 370.39 MB, 382.15 MB, 397.18 MB, 402.44 MB, 407.65 MB, 418.43 MB, 421.42 MB, 426.40 MB, 426.42 MB, 429.68 MB, 434.41 MB, 440.91 MB, 442.41 MB, 442.43 MB, 442.42 MB, 453.66 MB, 458.41 MB, 458.43 MB, 458.41 MB, 458.42 MB, 458.41 MB, 458.41 MB, 458.43 MB, 458.39 MB, 458.39 MB, 470.93 MB, 631.97 MB, 631.81 MB, 631.94 MB, 631.78 MB, 632.31 MB, 631.73 MB, 631.10 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 645.31 MB (676658006) - PerHostPeakMemUsage: 1.39 GB (1490657978) - RowsProduced: 37 (37) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 12.171ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3911) - TotalThreadsTotalWallClockTime: 23m21s - TotalThreadsSysTime: 1s250ms - TotalThreadsUserTime: 9s277ms - TotalThreadsVoluntaryContextSwitches: 63.08K (63082) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 45.927ms - ExecTreePrepareTime: 773.832us DataStreamSender (dst_id=26):(Total: 414.067us, non-child: 414.067us, % non-child: 100.00%) - BytesSent: 8.55 KB (8756) - OverallThroughput: 20.17 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 37 (37) - SerializeBatchTime: 274.348us - UncompressedRowBatchSize: 8.55 KB (8756) CodeGen:(Total: 633.629ms, non-child: 633.629ms, % non-child: 100.00%) - CodegenTime: 15.142ms - CompileTime: 214.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 119 (119) - NumInstructions: 7.22K (7221) - OptimizationTime: 394.447ms - PeakMemoryUsage: 3.53 MB (3697152) - PrepareTime: 24.602ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 642.390ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.187us - GetResultsTime: 100.343us - HTResizeTime: 0.000ns - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 10 (10) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9913865) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 0 - StreamingTime: 628.428ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.232ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.056ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622153) - ProbeRows: 74 (74) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 115.851us - RowsReturned: 74 (74) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 154.840us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 490.044us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 167.145us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s875ms, non-child: 74.403us, % non-child: 0.00%) - ConvertRowBatchTime: 52.488us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 908.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s875ms - DataArrivalTimer: 1s875ms SenderSide: - DeserializeRowBatchTimer: 222.525us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 15.405ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 685.515us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565833) - ProbeRows: 74 (74) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 106.759us - RowsReturned: 74 (74) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 77.713us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 279.867us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.389us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s259ms, non-child: 14.445us, % non-child: 0.00%) - ConvertRowBatchTime: 4.845us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 217.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s259ms - DataArrivalTimer: 1s259ms SenderSide: - DeserializeRowBatchTimer: 192.043us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s501ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1398370) - BuildTime: 1s702ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 36.94M (36936305) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s576ms - RowsReturned: 74 (74) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s429ms - BuildRowsPartitioned: 1.40M (1398370) - GetNewBlockTime: 2.992ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.47K (3474) - HashTablesBuildTime: 261.587ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m37s, non-child: 203.411ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.410ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1398370) - RowsReturnedRate: 2.19 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 662.97 KB, 19.20 MB, 52.24 MB, 90.53 MB, 127.34 MB, 154.29 MB, 170.33 MB, 179.67 MB, 187.25 MB, 193.91 MB, 199.66 MB, 204.68 MB, 209.94 MB, 215.43 MB, 220.10 MB, 223.69 MB, 226.58 MB, 229.21 MB, 231.70 MB, 233.97 MB, 235.98 MB, 237.90 MB, 239.50 MB, 240.83 MB, 242.15 MB, 243.42 MB, 244.53 MB, 245.25 MB, 246.04 MB, 246.67 MB, 246.95 MB, 247.19 MB, 247.46 MB, 247.57 MB, 248.05 MB, 249.05 MB, 249.05 MB, 249.05 MB, 249.05 MB, 249.05 MB, 249.05 MB, 249.05 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 249.05 MB (261143826) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s766ms - NumBatchesAccepted: 12.54K (12541) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s419ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 36.94M (36936305) - RowsReturnedRate: 311.74 K/sec RecvrSide: BytesReceived(16s000ms): 5.93 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.58 MB, 115.28 MB, 378.21 MB, 500.58 MB, 564.53 MB, 611.37 MB, 642.33 MB, 658.15 MB - FirstBatchArrivalWaitTime: 4s185ms - TotalBytesReceived: 662.89 MB (695088111) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s223ms - NumBatchesAccepted: 56.46K (56457) - NumBatchesRejected: 79 (79) Instance 5f429df048b5534b:41bcce180000024e (host=foo.187.56:22000):(Total: 12m39s, non-child: 203.109ms, % non-child: 0.03%) MemoryUsage(16s000ms): 14.11 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.38 MB, 159.92 MB, 162.40 MB, 212.17 MB, 290.42 MB, 297.43 MB, 323.66 MB, 332.67 MB, 342.43 MB, 375.64 MB, 396.92 MB, 416.67 MB, 418.41 MB, 418.40 MB, 418.41 MB, 418.41 MB, 418.42 MB, 418.40 MB, 418.42 MB, 422.41 MB, 426.40 MB, 429.67 MB, 437.17 MB, 442.41 MB, 442.43 MB, 444.92 MB, 450.42 MB, 450.42 MB, 450.41 MB, 450.43 MB, 450.43 MB, 450.40 MB, 450.43 MB, 450.42 MB, 474.76 MB, 617.82 MB, 617.66 MB, 618.23 MB, 617.94 MB, 617.74 MB, 617.80 MB, 618.03 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.25 GB (1340240933) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 14.579ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.03K (4028) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s208ms - TotalThreadsUserTime: 9s670ms - TotalThreadsVoluntaryContextSwitches: 63.66K (63664) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 50.220ms - ExecTreePrepareTime: 654.656us DataStreamSender (dst_id=26):(Total: 834.255us, non-child: 834.255us, % non-child: 100.00%) - BytesSent: 11.97 KB (12256) - OverallThroughput: 14.01 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 51 (51) - SerializeBatchTime: 657.842us - UncompressedRowBatchSize: 11.97 KB (12256) CodeGen:(Total: 670.201ms, non-child: 670.201ms, % non-child: 100.00%) - CodegenTime: 15.646ms - CompileTime: 205.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 436.630ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.438ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 675.543ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 63.994us - GetResultsTime: 123.170us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927278) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 659.677ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.273ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 949.532us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.296us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 168.408us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 503.033us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 173.724us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s230ms, non-child: 83.359us, % non-child: 0.01%) - ConvertRowBatchTime: 58.465us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.38 K/sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s230ms - DataArrivalTimer: 1s230ms SenderSide: - DeserializeRowBatchTimer: 282.752us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 6.202ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 656.482us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.225us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55.892us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 341.588us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.527us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s187ms, non-child: 21.569us, % non-child: 0.00%) - ConvertRowBatchTime: 9.018us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 230.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s187ms - DataArrivalTimer: 1s187ms SenderSide: - DeserializeRowBatchTimer: 66.900us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s706ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1402790) - BuildTime: 1s725ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635574016) - ProbeRows: 37.05M (37046281) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s760ms - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s445ms - BuildRowsPartitioned: 1.40M (1402790) - GetNewBlockTime: 3.074ms - HashBuckets: 2.88M (2883584) - HashCollisions: 2.78K (2784) - HashTablesBuildTime: 267.195ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 205.221ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.658ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1402790) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 651.56 KB, 19.25 MB, 52.11 MB, 90.20 MB, 126.89 MB, 152.99 MB, 168.35 MB, 177.68 MB, 185.14 MB, 191.72 MB, 197.37 MB, 202.31 MB, 207.42 MB, 212.79 MB, 217.41 MB, 221.05 MB, 223.98 MB, 226.70 MB, 229.27 MB, 231.51 MB, 233.55 MB, 235.52 MB, 237.15 MB, 238.45 MB, 239.85 MB, 241.09 MB, 242.24 MB, 242.86 MB, 243.58 MB, 244.12 MB, 244.46 MB, 244.70 MB, 244.85 MB, 244.92 MB, 245.40 MB, 246.40 MB, 246.40 MB, 246.40 MB, 246.40 MB, 246.40 MB, 246.40 MB, 246.40 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 246.40 MB (258374014) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 2s062ms - NumBatchesAccepted: 12.58K (12583) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s438ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.05M (37046281) - RowsReturnedRate: 310.79 K/sec RecvrSide: BytesReceived(16s000ms): 5.92 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.64 MB, 114.98 MB, 378.49 MB, 501.81 MB, 566.01 MB, 613.04 MB, 644.12 MB, 660.03 MB - FirstBatchArrivalWaitTime: 4s025ms - TotalBytesReceived: 664.82 MB (697112251) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s486ms - NumBatchesAccepted: 56.62K (56624) - NumBatchesRejected: 56 (56) Instance 5f429df048b5534b:41bcce1800000223 (host=foo.187.51:22000):(Total: 12m39s, non-child: 107.365ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.98 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.65 MB, 160.16 MB, 162.41 MB, 217.16 MB, 290.42 MB, 297.43 MB, 328.89 MB, 351.90 MB, 387.14 MB, 401.66 MB, 409.16 MB, 410.43 MB, 416.89 MB, 418.40 MB, 418.41 MB, 418.41 MB, 418.40 MB, 418.42 MB, 423.41 MB, 428.42 MB, 434.41 MB, 434.42 MB, 434.42 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.40 MB, 434.40 MB, 434.44 MB, 434.40 MB, 434.37 MB, 434.40 MB, 434.44 MB, 434.51 MB, 477.78 MB, 605.14 MB, 606.00 MB, 605.93 MB, 606.10 MB, 606.22 MB, 605.95 MB, 606.18 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 619.30 MB (649386678) - PerHostPeakMemUsage: 1.23 GB (1324771929) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 41.399ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3914) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s202ms - TotalThreadsUserTime: 9s292ms - TotalThreadsVoluntaryContextSwitches: 63.77K (63775) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 52.498ms - ExecTreePrepareTime: 606.123us DataStreamSender (dst_id=26):(Total: 600.179us, non-child: 600.179us, % non-child: 100.00%) - BytesSent: 10.26 KB (10505) - OverallThroughput: 16.69 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 48 (48) - SerializeBatchTime: 451.627us - UncompressedRowBatchSize: 10.26 KB (10505) CodeGen:(Total: 665.878ms, non-child: 665.878ms, % non-child: 100.00%) - CodegenTime: 15.138ms - CompileTime: 215.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 420.581ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.736ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 619.572ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 58.278us - GetResultsTime: 82.100us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916940) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 605.414ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.065ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.034ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621132) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.083us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 206.272us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 542.565us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 191.385us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s456ms, non-child: 71.278us, % non-child: 0.00%) - ConvertRowBatchTime: 48.435us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 693.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s456ms - DataArrivalTimer: 2s456ms SenderSide: - DeserializeRowBatchTimer: 183.075us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 11.869ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 834.409us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564812) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.487us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.871us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 435.242us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.827us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s209ms, non-child: 18.920us, % non-child: 0.00%) - ConvertRowBatchTime: 8.279us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 226.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s209ms - DataArrivalTimer: 1s209ms SenderSide: - DeserializeRowBatchTimer: 29.364us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s471ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1421256) - BuildTime: 1s704ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 594.13 MB (622989568) - ProbeRows: 37.06M (37058191) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s560ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s426ms - BuildRowsPartitioned: 1.42M (1421256) - GetNewBlockTime: 2.851ms - HashBuckets: 3.15M (3145728) - HashCollisions: 2.92K (2916) - HashTablesBuildTime: 265.583ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 594.06 MB (622917760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 201.643ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.854ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1421256) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 623.12 KB, 19.19 MB, 52.71 MB, 91.46 MB, 129.07 MB, 156.58 MB, 172.94 MB, 182.23 MB, 189.64 MB, 196.17 MB, 201.70 MB, 206.54 MB, 211.62 MB, 216.92 MB, 221.47 MB, 225.20 MB, 228.10 MB, 230.82 MB, 233.35 MB, 235.62 MB, 237.71 MB, 239.69 MB, 241.26 MB, 242.63 MB, 244.02 MB, 245.25 MB, 246.45 MB, 247.17 MB, 247.75 MB, 248.25 MB, 248.55 MB, 248.90 MB, 249.04 MB, 249.09 MB, 249.55 MB, 250.47 MB, 250.47 MB, 250.47 MB, 250.47 MB, 250.47 MB, 250.47 MB, 250.47 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 250.47 MB (262634082) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s827ms - NumBatchesAccepted: 12.75K (12754) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s414ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s056ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37058191) - RowsReturnedRate: 305.48 K/sec RecvrSide: BytesReceived(16s000ms): 5.85 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.51 MB, 113.34 MB, 376.47 MB, 501.32 MB, 565.70 MB, 612.95 MB, 644.14 MB, 660.22 MB - FirstBatchArrivalWaitTime: 4s128ms - TotalBytesReceived: 665.05 MB (697356879) - TotalGetBatchTime: 2m - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s132ms - NumBatchesAccepted: 56.64K (56640) - NumBatchesRejected: 41 (41) Instance 5f429df048b5534b:41bcce1800000250 (host=foo.221.13:22000):(Total: 12m39s, non-child: 71.158ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.15 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.22 MB, 160.40 MB, 162.43 MB, 213.41 MB, 287.92 MB, 298.66 MB, 314.93 MB, 339.65 MB, 363.66 MB, 388.16 MB, 406.65 MB, 410.38 MB, 410.41 MB, 417.67 MB, 418.41 MB, 418.42 MB, 418.40 MB, 423.67 MB, 426.41 MB, 426.41 MB, 426.40 MB, 426.42 MB, 426.41 MB, 428.91 MB, 434.40 MB, 434.40 MB, 434.41 MB, 434.40 MB, 434.41 MB, 434.36 MB, 440.19 MB, 442.40 MB, 442.46 MB, 442.42 MB, 468.18 MB, 612.40 MB, 612.41 MB, 611.68 MB, 611.50 MB, 612.20 MB, 611.99 MB, 612.39 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 625.30 MB (655678134) - PerHostPeakMemUsage: 1.24 GB (1326661336) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 16.313ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.65K (3646) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s193ms - TotalThreadsUserTime: 9s444ms - TotalThreadsVoluntaryContextSwitches: 64.30K (64301) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.550ms - ExecTreePrepareTime: 903.640us DataStreamSender (dst_id=26):(Total: 669.709us, non-child: 669.709us, % non-child: 100.00%) - BytesSent: 11.83 KB (12114) - OverallThroughput: 17.25 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 56 (56) - SerializeBatchTime: 560.260us - UncompressedRowBatchSize: 11.83 KB (12114) CodeGen:(Total: 673.120ms, non-child: 673.120ms, % non-child: 100.00%) - CodegenTime: 16.440ms - CompileTime: 227.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 419.551ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.665ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 658.132ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 83.926us - GetResultsTime: 136.405us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921057) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 644.580ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.843ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 659.913us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619261) - ProbeRows: 1.35K (1346) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 687.700us - RowsReturned: 1.35K (1346) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 128.096us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 252.363us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 197.457us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s423ms, non-child: 51.799us, % non-child: 0.00%) - ConvertRowBatchTime: 31.952us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 703.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s423ms - DataArrivalTimer: 2s423ms SenderSide: - DeserializeRowBatchTimer: 287.527us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 3.202ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 469.377us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562941) - ProbeRows: 1.35K (1346) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 800.277us - RowsReturned: 1.35K (1346) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 52.485us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 253.578us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.951us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s160ms, non-child: 20.778us, % non-child: 0.00%) - ConvertRowBatchTime: 8.924us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 236.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s160ms - DataArrivalTimer: 1s160ms SenderSide: - DeserializeRowBatchTimer: 57.556us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s580ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1386234) - BuildTime: 1s677ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 600.13 MB (629281024) - ProbeRows: 37.10M (37099576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s681ms - RowsReturned: 1.35K (1346) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s377ms - BuildRowsPartitioned: 1.39M (1386234) - GetNewBlockTime: 2.730ms - HashBuckets: 3.01M (3014656) - HashCollisions: 5.40K (5400) - HashTablesBuildTime: 287.113ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 600.06 MB (629209216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 188.344ms, % non-child: 0.03%) - ConvertRowBatchTime: 86.194ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1386234) - RowsReturnedRate: 2.18 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 652.23 KB, 19.15 MB, 52.04 MB, 90.06 MB, 126.59 MB, 153.12 MB, 169.08 MB, 178.46 MB, 185.84 MB, 192.35 MB, 197.89 MB, 202.73 MB, 207.86 MB, 213.14 MB, 217.55 MB, 221.09 MB, 223.90 MB, 226.54 MB, 229.06 MB, 231.34 MB, 233.35 MB, 235.17 MB, 236.72 MB, 238.04 MB, 239.31 MB, 240.50 MB, 241.52 MB, 242.18 MB, 242.80 MB, 243.23 MB, 243.59 MB, 243.91 MB, 244.08 MB, 244.15 MB, 244.67 MB, 245.63 MB, 245.63 MB, 245.63 MB, 245.63 MB, 245.63 MB, 245.63 MB, 245.63 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 245.63 MB (257557580) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s499ms - NumBatchesAccepted: 12.44K (12439) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s421ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s059ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37099576) - RowsReturnedRate: 310.89 K/sec RecvrSide: BytesReceived(16s000ms): 5.94 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.66 MB, 115.78 MB, 379.77 MB, 502.65 MB, 566.94 MB, 614.05 MB, 645.10 MB, 660.93 MB - FirstBatchArrivalWaitTime: 4s079ms - TotalBytesReceived: 665.67 MB (698010498) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s701ms - NumBatchesAccepted: 56.70K (56699) - NumBatchesRejected: 57 (57) Instance 5f429df048b5534b:41bcce1800000229 (host=foo.187.54:22000):(Total: 12m39s, non-child: 91.983ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.24 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.39 MB, 162.42 MB, 162.66 MB, 232.16 MB, 292.65 MB, 306.17 MB, 356.40 MB, 388.68 MB, 398.42 MB, 409.67 MB, 411.17 MB, 424.40 MB, 426.42 MB, 426.42 MB, 426.40 MB, 426.40 MB, 426.42 MB, 431.14 MB, 434.42 MB, 435.65 MB, 442.42 MB, 448.91 MB, 450.42 MB, 450.40 MB, 450.43 MB, 455.94 MB, 464.90 MB, 466.40 MB, 467.67 MB, 474.41 MB, 474.44 MB, 481.45 MB, 482.34 MB, 482.41 MB, 528.75 MB, 662.79 MB, 662.10 MB, 661.54 MB, 661.85 MB, 661.71 MB, 662.19 MB, 662.13 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 675.30 MB (708106934) - PerHostPeakMemUsage: 1.23 GB (1321242967) - RowsProduced: 58 (58) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 33.295ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.99K (3986) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s340ms - TotalThreadsUserTime: 9s721ms - TotalThreadsVoluntaryContextSwitches: 64.27K (64265) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 50.328ms - ExecTreePrepareTime: 602.794us DataStreamSender (dst_id=26):(Total: 824.714us, non-child: 824.714us, % non-child: 100.00%) - BytesSent: 12.73 KB (13034) - OverallThroughput: 15.07 MB/sec - PeakMemoryUsage: 280.66 KB (287392) - RowsReturned: 58 (58) - SerializeBatchTime: 674.495us - UncompressedRowBatchSize: 12.73 KB (13034) CodeGen:(Total: 723.215ms, non-child: 723.215ms, % non-child: 100.00%) - CodegenTime: 15.890ms - CompileTime: 213.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 481.407ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.734ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 647.152ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 92.915us - GetResultsTime: 135.203us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919836) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 58 (58) - RowsReturnedRate: 0 - StreamingTime: 633.901ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.150ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.087ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619932) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 153.730us - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 228.910us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 562.385us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 183.470us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s441ms, non-child: 68.319us, % non-child: 0.00%) - ConvertRowBatchTime: 47.108us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.18 K/sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s441ms - DataArrivalTimer: 1s441ms SenderSide: - DeserializeRowBatchTimer: 270.837us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.264ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 697.790us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563612) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 163.906us - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.211us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 438.679us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.395us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s094ms, non-child: 18.665us, % non-child: 0.00%) - ConvertRowBatchTime: 8.119us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 250.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s094ms - DataArrivalTimer: 1s094ms SenderSide: - DeserializeRowBatchTimer: 87.214us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s931ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.48M (1482211) - BuildTime: 1s932ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 650.13 MB (681710089) - ProbeRows: 37.04M (37042221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s767ms - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s561ms - BuildRowsPartitioned: 1.48M (1482211) - GetNewBlockTime: 3.072ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.14K (4138) - HashTablesBuildTime: 356.231ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 650.06 MB (681638016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 217.031ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.571ms - PeakMemoryUsage: 0 - RowsReturned: 1.48M (1482211) - RowsReturnedRate: 2.34 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 782.02 KB, 20.64 MB, 55.40 MB, 96.32 MB, 136.03 MB, 164.66 MB, 181.47 MB, 191.35 MB, 199.33 MB, 206.43 MB, 212.43 MB, 217.67 MB, 223.17 MB, 228.90 MB, 233.75 MB, 237.61 MB, 240.71 MB, 243.57 MB, 246.29 MB, 248.59 MB, 250.73 MB, 252.75 MB, 254.43 MB, 255.89 MB, 257.25 MB, 258.55 MB, 259.69 MB, 260.50 MB, 261.11 MB, 261.50 MB, 261.86 MB, 262.16 MB, 262.36 MB, 262.45 MB, 263.04 MB, 263.94 MB, 263.94 MB, 263.94 MB, 263.94 MB, 263.94 MB, 263.94 MB, 263.94 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 263.94 MB (276761213) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s817ms - NumBatchesAccepted: 13.30K (13300) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s433ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37042221) - RowsReturnedRate: 306.45 K/sec RecvrSide: BytesReceived(16s000ms): 6.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.77 MB, 116.65 MB, 380.44 MB, 502.29 MB, 566.40 MB, 613.26 MB, 644.27 MB, 659.97 MB - FirstBatchArrivalWaitTime: 4s037ms - TotalBytesReceived: 664.69 MB (696973388) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s474ms - NumBatchesAccepted: 56.62K (56617) - NumBatchesRejected: 36 (36) Instance 5f429df048b5534b:41bcce180000028f (host=foo.221.26:22000):(Total: 12m39s, non-child: 81.155ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.45 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.63 MB, 161.67 MB, 162.41 MB, 215.44 MB, 287.67 MB, 306.41 MB, 320.66 MB, 340.17 MB, 369.15 MB, 385.17 MB, 390.40 MB, 400.17 MB, 404.41 MB, 412.68 MB, 418.42 MB, 425.90 MB, 426.41 MB, 426.41 MB, 426.42 MB, 426.42 MB, 426.40 MB, 426.39 MB, 426.39 MB, 426.44 MB, 426.41 MB, 426.42 MB, 426.42 MB, 426.42 MB, 433.67 MB, 434.43 MB, 434.38 MB, 434.43 MB, 434.29 MB, 434.35 MB, 450.26 MB, 601.60 MB, 602.32 MB, 602.31 MB, 602.06 MB, 601.88 MB, 602.07 MB, 602.13 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 615.30 MB (645192374) - PerHostPeakMemUsage: 1.21 GB (1302146071) - RowsProduced: 57 (57) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 17.671ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.86K (3863) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s230ms - TotalThreadsUserTime: 9s467ms - TotalThreadsVoluntaryContextSwitches: 64.11K (64107) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 61.221ms - ExecTreePrepareTime: 733.236us DataStreamSender (dst_id=26):(Total: 930.925us, non-child: 930.925us, % non-child: 100.00%) - BytesSent: 12.36 KB (12658) - OverallThroughput: 12.97 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 57 (57) - SerializeBatchTime: 705.457us - UncompressedRowBatchSize: 12.36 KB (12658) CodeGen:(Total: 690.637ms, non-child: 690.637ms, % non-child: 100.00%) - CodegenTime: 23.712ms - CompileTime: 233.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 425.369ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.053ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 656.854ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 75.222us - GetResultsTime: 167.768us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916936) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 57 (57) - RowsReturnedRate: 0 - StreamingTime: 642.978ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.611ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.191ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9626724) - ProbeRows: 728 (728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 463.623us - RowsReturned: 728 (728) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 224.359us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 551.137us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 244.965us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s014ms, non-child: 70.289us, % non-child: 0.01%) - ConvertRowBatchTime: 56.042us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.68 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s014ms - DataArrivalTimer: 1s014ms SenderSide: - DeserializeRowBatchTimer: 180.113us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.945ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 814.631us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9570404) - ProbeRows: 728 (728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 552.042us - RowsReturned: 728 (728) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60.577us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 424.229us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.626us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 934.347ms, non-child: 19.689us, % non-child: 0.00%) - ConvertRowBatchTime: 8.379us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 293.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 934.332ms - DataArrivalTimer: 934.328ms SenderSide: - DeserializeRowBatchTimer: 58.398us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s558ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1387939) - BuildTime: 1s677ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 590.13 MB (618795264) - ProbeRows: 37.13M (37126725) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s664ms - RowsReturned: 728 (728) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s396ms - BuildRowsPartitioned: 1.39M (1387939) - GetNewBlockTime: 2.816ms - HashBuckets: 2.88M (2883584) - HashCollisions: 4.50K (4500) - HashTablesBuildTime: 268.118ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 590.06 MB (618723456) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 196.849ms, % non-child: 0.03%) - ConvertRowBatchTime: 88.845ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1387939) - RowsReturnedRate: 2.18 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 777.54 KB, 19.79 MB, 52.70 MB, 90.97 MB, 127.62 MB, 153.60 MB, 169.29 MB, 178.55 MB, 185.93 MB, 192.46 MB, 198.04 MB, 202.90 MB, 208.01 MB, 213.18 MB, 217.58 MB, 221.00 MB, 223.78 MB, 226.33 MB, 228.78 MB, 230.97 MB, 232.81 MB, 234.71 MB, 236.26 MB, 237.65 MB, 238.95 MB, 240.24 MB, 241.28 MB, 242.02 MB, 242.77 MB, 243.23 MB, 243.52 MB, 243.77 MB, 243.91 MB, 243.95 MB, 244.49 MB, 245.49 MB, 245.49 MB, 245.49 MB, 245.49 MB, 245.49 MB, 245.49 MB, 245.49 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 245.49 MB (257418580) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s695ms - NumBatchesAccepted: 12.45K (12449) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s449ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s070ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37126725) - RowsReturnedRate: 314.18 K/sec RecvrSide: BytesReceived(16s000ms): 6.11 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.76 MB, 118.43 MB, 383.28 MB, 504.09 MB, 568.15 MB, 615.00 MB, 646.00 MB, 661.60 MB - FirstBatchArrivalWaitTime: 3s858ms - TotalBytesReceived: 666.27 MB (698635597) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s436ms - NumBatchesAccepted: 56.75K (56750) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce180000023a (host=foo.187.52:22000):(Total: 12m39s, non-child: 75.995ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.98 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.22 MB, 161.67 MB, 162.43 MB, 221.91 MB, 290.41 MB, 300.44 MB, 337.40 MB, 364.42 MB, 384.44 MB, 390.19 MB, 395.40 MB, 408.41 MB, 417.64 MB, 418.39 MB, 418.40 MB, 418.43 MB, 418.43 MB, 424.42 MB, 426.39 MB, 426.39 MB, 426.42 MB, 438.67 MB, 450.15 MB, 458.18 MB, 458.41 MB, 458.41 MB, 458.42 MB, 458.41 MB, 458.41 MB, 458.42 MB, 458.39 MB, 458.42 MB, 458.40 MB, 458.40 MB, 492.66 MB, 637.90 MB, 637.60 MB, 638.09 MB, 638.16 MB, 637.65 MB, 638.05 MB, 638.60 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.30 MB (682941110) - PerHostPeakMemUsage: 1.23 GB (1316359560) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 18.144ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.89K (3891) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s270ms - TotalThreadsUserTime: 9s372ms - TotalThreadsVoluntaryContextSwitches: 63.55K (63555) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 51.415ms - ExecTreePrepareTime: 685.150us DataStreamSender (dst_id=26):(Total: 761.670us, non-child: 761.670us, % non-child: 100.00%) - BytesSent: 9.47 KB (9693) - OverallThroughput: 12.14 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 44 (44) - SerializeBatchTime: 626.040us - UncompressedRowBatchSize: 9.47 KB (9693) CodeGen:(Total: 710.512ms, non-child: 710.512ms, % non-child: 100.00%) - CodegenTime: 15.930ms - CompileTime: 263.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 416.983ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.199ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 626.051ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 141.904us - GetResultsTime: 154.533us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9922574) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 611.280ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.817ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 961.775us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622670) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.073us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 149.998us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 509.889us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.729us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s559ms, non-child: 67.158us, % non-child: 0.00%) - ConvertRowBatchTime: 45.203us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 665.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s559ms - DataArrivalTimer: 2s559ms SenderSide: - DeserializeRowBatchTimer: 212.587us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 5.852ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 761.050us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566350) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.377us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.446us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 455.397us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.069us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s157ms, non-child: 16.300us, % non-child: 0.00%) - ConvertRowBatchTime: 7.407us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 236.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s157ms - DataArrivalTimer: 1s157ms SenderSide: - DeserializeRowBatchTimer: 42.374us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s522ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1450612) - BuildTime: 1s769ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544015) - ProbeRows: 37.08M (37080297) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s535ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s515ms - BuildRowsPartitioned: 1.45M (1450612) - GetNewBlockTime: 3.192ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.55K (3552) - HashTablesBuildTime: 241.860ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 212.245ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.179ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1450612) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 665.21 KB, 20.00 MB, 54.03 MB, 93.07 MB, 130.92 MB, 158.15 MB, 174.41 MB, 184.00 MB, 191.74 MB, 198.65 MB, 204.58 MB, 209.69 MB, 214.99 MB, 220.51 MB, 225.27 MB, 228.97 MB, 231.93 MB, 234.79 MB, 237.49 MB, 239.87 MB, 242.01 MB, 244.01 MB, 245.63 MB, 247.04 MB, 248.34 MB, 249.69 MB, 250.78 MB, 251.63 MB, 252.31 MB, 252.76 MB, 253.13 MB, 253.43 MB, 253.60 MB, 253.65 MB, 254.15 MB, 255.06 MB, 255.06 MB, 255.06 MB, 255.06 MB, 255.06 MB, 255.06 MB, 255.06 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 255.06 MB (267447453) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s971ms - NumBatchesAccepted: 13.02K (13015) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s413ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s058ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37080297) - RowsReturnedRate: 308.71 K/sec RecvrSide: BytesReceived(16s000ms): 5.90 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.66 MB, 114.67 MB, 378.23 MB, 502.04 MB, 566.35 MB, 613.52 MB, 644.67 MB, 660.62 MB - FirstBatchArrivalWaitTime: 3s996ms - TotalBytesReceived: 665.41 MB (697737841) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s211ms - NumBatchesAccepted: 56.68K (56677) - NumBatchesRejected: 55 (55) Instance 5f429df048b5534b:41bcce1800000248 (host=foo.187.53:22000):(Total: 12m39s, non-child: 73.996ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.38 MB, 162.42 MB, 162.41 MB, 228.65 MB, 290.41 MB, 301.65 MB, 342.17 MB, 363.42 MB, 391.90 MB, 418.18 MB, 418.40 MB, 418.43 MB, 418.40 MB, 418.42 MB, 418.41 MB, 420.43 MB, 426.44 MB, 426.44 MB, 426.41 MB, 431.42 MB, 434.41 MB, 434.41 MB, 434.42 MB, 434.42 MB, 434.42 MB, 436.16 MB, 442.41 MB, 442.41 MB, 447.43 MB, 450.68 MB, 458.43 MB, 458.43 MB, 458.43 MB, 458.42 MB, 490.35 MB, 635.10 MB, 634.14 MB, 633.45 MB, 634.00 MB, 633.67 MB, 634.14 MB, 634.17 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.30 MB (678746806) - PerHostPeakMemUsage: 1.23 GB (1320013673) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m38s - TotalNetworkSendTime: 19.440ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.77K (3766) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s182ms - TotalThreadsUserTime: 9s308ms - TotalThreadsVoluntaryContextSwitches: 64.32K (64318) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.734ms - ExecTreePrepareTime: 481.894us DataStreamSender (dst_id=26):(Total: 381.120us, non-child: 381.120us, % non-child: 100.00%) - BytesSent: 9.09 KB (9313) - OverallThroughput: 23.30 MB/sec - PeakMemoryUsage: 224.66 KB (230048) - RowsReturned: 43 (43) - SerializeBatchTime: 272.088us - UncompressedRowBatchSize: 9.09 KB (9313) CodeGen:(Total: 663.172ms, non-child: 663.172ms, % non-child: 100.00%) - CodegenTime: 16.965ms - CompileTime: 201.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 436.223ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.035ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 633.761ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 74.924us - GetResultsTime: 133.245us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924328) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 620.460ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.337ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 863.036us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624424) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 445.325us - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 142.698us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 467.819us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 155.182us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s033ms, non-child: 73.187us, % non-child: 0.00%) - ConvertRowBatchTime: 50.192us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 561.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s033ms - DataArrivalTimer: 3s033ms SenderSide: - DeserializeRowBatchTimer: 202.273us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.527ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 580.103us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9568104) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 525.692us - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.692us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 326.397us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 109.025us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s092ms, non-child: 18.810us, % non-child: 0.00%) - ConvertRowBatchTime: 7.597us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 250.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s092ms - DataArrivalTimer: 1s092ms SenderSide: - DeserializeRowBatchTimer: 29.972us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s533ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1452927) - BuildTime: 1s735ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 37.04M (37044122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s592ms - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s452ms - BuildRowsPartitioned: 1.45M (1452927) - GetNewBlockTime: 2.807ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.22K (3223) - HashTablesBuildTime: 270.326ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 198.582ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.880ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1452927) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 744.52 KB, 20.19 MB, 54.75 MB, 95.08 MB, 133.84 MB, 161.34 MB, 177.24 MB, 186.85 MB, 194.63 MB, 201.51 MB, 207.41 MB, 212.61 MB, 217.98 MB, 223.50 MB, 228.15 MB, 231.96 MB, 235.00 MB, 237.74 MB, 240.36 MB, 242.65 MB, 244.75 MB, 246.61 MB, 248.22 MB, 249.49 MB, 250.93 MB, 252.06 MB, 253.22 MB, 253.86 MB, 254.33 MB, 254.94 MB, 255.31 MB, 255.69 MB, 255.89 MB, 255.96 MB, 256.43 MB, 257.32 MB, 257.32 MB, 257.32 MB, 257.32 MB, 257.32 MB, 257.32 MB, 257.32 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 257.32 MB (269818508) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s828ms - NumBatchesAccepted: 13.04K (13039) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s390ms, % non-child: 1.16%) - ConvertRowBatchTime: 1s043ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37044122) - RowsReturnedRate: 309.17 K/sec RecvrSide: BytesReceived(16s000ms): 6.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.71 MB, 116.51 MB, 380.31 MB, 502.27 MB, 566.36 MB, 613.28 MB, 644.30 MB, 660.04 MB - FirstBatchArrivalWaitTime: 4s026ms - TotalBytesReceived: 664.76 MB (697052948) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s430ms - NumBatchesAccepted: 56.62K (56622) - NumBatchesRejected: 50 (50) Instance 5f429df048b5534b:41bcce1800000278 (host=foo.221.19:22000):(Total: 12m39s, non-child: 160.285ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.08 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.23 MB, 161.65 MB, 162.40 MB, 214.68 MB, 290.43 MB, 298.14 MB, 326.92 MB, 346.43 MB, 353.14 MB, 374.17 MB, 395.67 MB, 408.66 MB, 410.38 MB, 416.93 MB, 418.40 MB, 418.43 MB, 418.42 MB, 418.41 MB, 423.92 MB, 434.40 MB, 434.43 MB, 434.41 MB, 434.42 MB, 434.41 MB, 437.64 MB, 442.42 MB, 442.41 MB, 442.42 MB, 442.41 MB, 442.39 MB, 442.39 MB, 447.14 MB, 450.46 MB, 450.40 MB, 469.07 MB, 632.19 MB, 632.25 MB, 631.72 MB, 632.05 MB, 631.98 MB, 632.12 MB, 632.08 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.22 GB (1309530511) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 105.635ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3906) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s207ms - TotalThreadsUserTime: 9s596ms - TotalThreadsVoluntaryContextSwitches: 63.03K (63033) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 52.660ms - ExecTreePrepareTime: 728.844us DataStreamSender (dst_id=26):(Total: 611.379us, non-child: 611.379us, % non-child: 100.00%) - BytesSent: 11.11 KB (11381) - OverallThroughput: 17.75 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 51 (51) - SerializeBatchTime: 429.653us - UncompressedRowBatchSize: 11.11 KB (11381) CodeGen:(Total: 696.484ms, non-child: 696.484ms, % non-child: 100.00%) - CodegenTime: 17.844ms - CompileTime: 233.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 435.263ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.001ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 611.282ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 57.785us - GetResultsTime: 201.231us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927278) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 597.618ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.792ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.261ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.310us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 251.200us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 614.623us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 279.670us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s875ms, non-child: 80.593us, % non-child: 0.00%) - ConvertRowBatchTime: 58.240us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 592.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s875ms - DataArrivalTimer: 2s875ms SenderSide: - DeserializeRowBatchTimer: 149.588us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.312ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 541.346us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 137.693us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.414us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 313.298us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.026us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 942.164ms, non-child: 18.161us, % non-child: 0.00%) - ConvertRowBatchTime: 8.379us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 290.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 942.149ms - DataArrivalTimer: 942.146ms SenderSide: - DeserializeRowBatchTimer: 46.684us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s771ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1403803) - BuildTime: 1s744ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650253159) - ProbeRows: 37.16M (37161775) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s792ms - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s427ms - BuildRowsPartitioned: 1.40M (1403803) - GetNewBlockTime: 2.402ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.56K (3562) - HashTablesBuildTime: 305.171ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 204.234ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.255ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1403803) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 691.80 KB, 19.22 MB, 52.10 MB, 90.50 MB, 127.69 MB, 154.30 MB, 169.81 MB, 179.04 MB, 186.41 MB, 192.97 MB, 198.56 MB, 203.37 MB, 208.38 MB, 213.65 MB, 218.17 MB, 221.69 MB, 224.53 MB, 227.15 MB, 229.59 MB, 231.80 MB, 233.86 MB, 235.89 MB, 237.53 MB, 238.96 MB, 240.33 MB, 241.67 MB, 242.81 MB, 243.64 MB, 244.27 MB, 244.59 MB, 244.90 MB, 245.35 MB, 245.60 MB, 245.69 MB, 246.19 MB, 247.11 MB, 247.11 MB, 247.11 MB, 247.11 MB, 247.11 MB, 247.11 MB, 247.11 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 247.11 MB (259112566) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s927ms - NumBatchesAccepted: 12.60K (12598) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s432ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 37.16M (37161775) - RowsReturnedRate: 314.10 K/sec RecvrSide: BytesReceived(16s000ms): 5.96 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.62 MB, 115.81 MB, 380.35 MB, 503.54 MB, 567.83 MB, 614.98 MB, 646.13 MB, 662.03 MB - FirstBatchArrivalWaitTime: 3s866ms - TotalBytesReceived: 666.80 MB (699192465) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s242ms - NumBatchesAccepted: 56.80K (56798) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce180000026e (host=foo.221.11:22000):(Total: 12m39s, non-child: 76.026ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.99 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 23.95 MB, 161.89 MB, 162.39 MB, 219.64 MB, 290.13 MB, 295.13 MB, 329.65 MB, 380.40 MB, 386.36 MB, 393.39 MB, 400.65 MB, 405.89 MB, 411.16 MB, 418.42 MB, 418.41 MB, 418.38 MB, 419.64 MB, 426.41 MB, 426.42 MB, 432.89 MB, 434.38 MB, 434.41 MB, 434.38 MB, 434.40 MB, 434.40 MB, 437.38 MB, 442.39 MB, 442.40 MB, 442.38 MB, 442.41 MB, 442.37 MB, 442.38 MB, 442.42 MB, 442.33 MB, 464.21 MB, 619.90 MB, 619.87 MB, 619.51 MB, 619.32 MB, 620.05 MB, 619.97 MB, 620.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 633.28 MB (664045127) - PerHostPeakMemUsage: 1.39 GB (1488551165) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 15.154ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.51K (3509) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s235ms - TotalThreadsUserTime: 9s256ms - TotalThreadsVoluntaryContextSwitches: 64.44K (64443) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 58.572ms - ExecTreePrepareTime: 746.751us DataStreamSender (dst_id=26):(Total: 549.797us, non-child: 549.797us, % non-child: 100.00%) - BytesSent: 10.67 KB (10931) - OverallThroughput: 18.96 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 50 (50) - SerializeBatchTime: 339.221us - UncompressedRowBatchSize: 10.67 KB (10931) CodeGen:(Total: 699.446ms, non-child: 699.446ms, % non-child: 100.00%) - CodegenTime: 22.837ms - CompileTime: 232.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 434.873ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.759ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 643.489ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 269.816us - GetResultsTime: 146.342us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919140) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 630.319ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.321ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.791ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623332) - ProbeRows: 716 (716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 399.750us - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 188.007us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.138ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.422us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s481ms, non-child: 74.435us, % non-child: 0.00%) - ConvertRowBatchTime: 54.701us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 686.00 /sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s481ms - DataArrivalTimer: 2s481ms SenderSide: - DeserializeRowBatchTimer: 729.570us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.554ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.534ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567012) - ProbeRows: 716 (716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 528.781us - RowsReturned: 716 (716) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 52.431us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.071ms - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.700us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 987.297ms, non-child: 23.669us, % non-child: 0.00%) - ConvertRowBatchTime: 13.999us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 277.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 987.276ms - DataArrivalTimer: 987.274ms SenderSide: - DeserializeRowBatchTimer: 132.610us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s522ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1449173) - BuildTime: 1s756ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 608.13 MB (637670547) - ProbeRows: 37.10M (37102083) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s547ms - RowsReturned: 716 (716) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s482ms - BuildRowsPartitioned: 1.45M (1449173) - GetNewBlockTime: 2.996ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.50K (4495) - HashTablesBuildTime: 260.654ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 608.06 MB (637597824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 201.361ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.672ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1449173) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 690.57 KB, 19.73 MB, 53.30 MB, 92.30 MB, 129.66 MB, 157.01 MB, 173.41 MB, 183.24 MB, 191.06 MB, 197.93 MB, 203.89 MB, 209.09 MB, 214.44 MB, 220.08 MB, 224.97 MB, 228.83 MB, 231.82 MB, 234.59 MB, 237.20 MB, 239.45 MB, 241.59 MB, 243.56 MB, 245.19 MB, 246.65 MB, 248.07 MB, 249.34 MB, 250.44 MB, 251.29 MB, 251.91 MB, 252.35 MB, 252.68 MB, 253.05 MB, 253.27 MB, 253.33 MB, 253.81 MB, 254.71 MB, 254.71 MB, 254.71 MB, 254.71 MB, 254.71 MB, 254.71 MB, 254.71 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 254.71 MB (267084472) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s943ms - NumBatchesAccepted: 13.01K (13006) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s404ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s054ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37102083) - RowsReturnedRate: 311.96 K/sec RecvrSide: BytesReceived(16s000ms): 5.91 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.60 MB, 115.05 MB, 378.99 MB, 502.51 MB, 566.82 MB, 613.97 MB, 645.11 MB, 661.04 MB - FirstBatchArrivalWaitTime: 3s917ms - TotalBytesReceived: 665.82 MB (698158347) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s316ms - NumBatchesAccepted: 56.71K (56709) - NumBatchesRejected: 77 (77) Instance 5f429df048b5534b:41bcce180000028c (host=foo.221.29:22000):(Total: 12m39s, non-child: 65.634ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.49 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.88 MB, 161.41 MB, 162.42 MB, 204.18 MB, 286.42 MB, 291.92 MB, 315.93 MB, 342.40 MB, 354.43 MB, 360.91 MB, 375.15 MB, 378.40 MB, 388.17 MB, 394.42 MB, 397.91 MB, 415.92 MB, 418.42 MB, 418.42 MB, 418.41 MB, 418.43 MB, 423.17 MB, 426.40 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.41 MB, 426.41 MB, 426.41 MB, 426.40 MB, 426.44 MB, 426.43 MB, 426.42 MB, 426.45 MB, 426.40 MB, 442.21 MB, 595.73 MB, 595.74 MB, 596.05 MB, 595.97 MB, 596.10 MB, 595.75 MB, 595.39 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 609.30 MB (638900918) - PerHostPeakMemUsage: 1.22 GB (1307896255) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 13.861ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.82K (3818) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s166ms - TotalThreadsUserTime: 9s415ms - TotalThreadsVoluntaryContextSwitches: 63.16K (63164) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 47.439ms - ExecTreePrepareTime: 782.421us DataStreamSender (dst_id=26):(Total: 502.224us, non-child: 502.224us, % non-child: 100.00%) - BytesSent: 10.03 KB (10271) - OverallThroughput: 19.50 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 45 (45) - SerializeBatchTime: 364.693us - UncompressedRowBatchSize: 10.03 KB (10271) CodeGen:(Total: 667.632ms, non-child: 667.632ms, % non-child: 100.00%) - CodegenTime: 16.111ms - CompileTime: 221.448ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 419.867ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.719ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 671.373ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 77.994us - GetResultsTime: 143.586us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925103) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 657.066ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.861ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.122ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9629295) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.481us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 133.946us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 701.836us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 168.869us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s151ms, non-child: 53.641us, % non-child: 0.00%) - ConvertRowBatchTime: 33.268us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 792.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s151ms - DataArrivalTimer: 2s151ms SenderSide: - DeserializeRowBatchTimer: 101.365us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.470ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 714.722us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9572975) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 140.404us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.049us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 459.918us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.169us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 892.247ms, non-child: 16.904us, % non-child: 0.00%) - ConvertRowBatchTime: 8.032us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 307.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 892.233ms - DataArrivalTimer: 892.231ms SenderSide: - DeserializeRowBatchTimer: 19.575us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s635ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35M (1348406) - BuildTime: 1s615ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 584.13 MB (612503808) - ProbeRows: 36.95M (36946640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s790ms - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s321ms - BuildRowsPartitioned: 1.35M (1348406) - GetNewBlockTime: 2.259ms - HashBuckets: 3.01M (3014656) - HashCollisions: 3.80K (3797) - HashTablesBuildTime: 280.402ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 584.06 MB (612432000) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 182.692ms, % non-child: 0.03%) - ConvertRowBatchTime: 84.711ms - PeakMemoryUsage: 0 - RowsReturned: 1.35M (1348406) - RowsReturnedRate: 2.12 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 721.80 KB, 18.74 MB, 50.32 MB, 87.22 MB, 122.72 MB, 148.55 MB, 163.87 MB, 172.73 MB, 179.79 MB, 186.09 MB, 191.44 MB, 196.09 MB, 200.96 MB, 205.99 MB, 210.27 MB, 213.69 MB, 216.37 MB, 218.89 MB, 221.24 MB, 223.39 MB, 225.36 MB, 227.11 MB, 228.62 MB, 229.93 MB, 231.18 MB, 232.42 MB, 233.41 MB, 234.13 MB, 234.80 MB, 235.25 MB, 235.53 MB, 235.84 MB, 235.97 MB, 236.08 MB, 236.57 MB, 237.49 MB, 237.49 MB, 237.49 MB, 237.49 MB, 237.49 MB, 237.49 MB, 237.49 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 237.49 MB (249022245) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s482ms - NumBatchesAccepted: 12.10K (12100) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s419ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s055ms - PeakMemoryUsage: 0 - RowsReturned: 36.95M (36946640) - RowsReturnedRate: 313.15 K/sec RecvrSide: BytesReceived(16s000ms): 6.14 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.86 MB, 118.91 MB, 382.68 MB, 502.02 MB, 565.65 MB, 612.17 MB, 642.93 MB, 658.41 MB - FirstBatchArrivalWaitTime: 3s833ms - TotalBytesReceived: 663.02 MB (695229636) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s455ms - NumBatchesAccepted: 56.47K (56472) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce1800000231 (host=foo.221.15:22000):(Total: 12m38s, non-child: 85.618ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.35 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.13 MB, 161.46 MB, 162.41 MB, 228.69 MB, 291.18 MB, 311.64 MB, 343.94 MB, 371.67 MB, 384.16 MB, 398.41 MB, 402.41 MB, 403.93 MB, 414.16 MB, 419.93 MB, 429.16 MB, 434.42 MB, 434.41 MB, 434.41 MB, 440.91 MB, 442.43 MB, 442.40 MB, 448.16 MB, 450.43 MB, 450.39 MB, 450.41 MB, 450.41 MB, 450.42 MB, 452.66 MB, 458.40 MB, 458.44 MB, 461.93 MB, 466.42 MB, 466.44 MB, 466.49 MB, 510.50 MB, 641.57 MB, 642.04 MB, 642.01 MB, 641.91 MB, 641.81 MB, 642.04 MB, 642.19 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 655.30 MB (687135414) - PerHostPeakMemUsage: 1.42 GB (1528716801) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 23.520ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.27K (3271) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s193ms - TotalThreadsUserTime: 9s224ms - TotalThreadsVoluntaryContextSwitches: 64.90K (64901) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 56.086ms - ExecTreePrepareTime: 1.092ms DataStreamSender (dst_id=26):(Total: 690.405us, non-child: 690.405us, % non-child: 100.00%) - BytesSent: 12.26 KB (12557) - OverallThroughput: 17.35 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 56 (56) - SerializeBatchTime: 505.610us - UncompressedRowBatchSize: 12.26 KB (12557) CodeGen:(Total: 720.187ms, non-child: 720.187ms, % non-child: 100.00%) - CodegenTime: 17.098ms - CompileTime: 239.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 448.587ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.380ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 670.342ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 65.513us - GetResultsTime: 169.481us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927499) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 658.734ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.749ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.133ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9627595) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 153.265us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 110.409us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 724.862us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 163.780us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s816ms, non-child: 60.437us, % non-child: 0.00%) - ConvertRowBatchTime: 24.710us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 605.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s815ms - DataArrivalTimer: 2s815ms SenderSide: - DeserializeRowBatchTimer: 237.884us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 4.523ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 895.613us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9571275) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.204us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.845us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 467.270us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 90.305us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 987.410ms, non-child: 17.416us, % non-child: 0.00%) - ConvertRowBatchTime: 7.935us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 277.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 987.396ms - DataArrivalTimer: 987.393ms SenderSide: - DeserializeRowBatchTimer: 20.028us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s539ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1470299) - BuildTime: 1s806ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 630.13 MB (660738304) - ProbeRows: 37.16M (37161203) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s522ms - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s518ms - BuildRowsPartitioned: 1.47M (1470299) - GetNewBlockTime: 3.871ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.79K (3786) - HashTablesBuildTime: 275.011ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 630.06 MB (660666496) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 211.000ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.313ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1470299) - RowsReturnedRate: 2.32 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 789.30 KB, 20.59 MB, 55.29 MB, 95.49 MB, 133.94 MB, 161.00 MB, 177.14 MB, 186.91 MB, 194.79 MB, 201.88 MB, 208.03 MB, 213.38 MB, 218.97 MB, 224.73 MB, 229.75 MB, 233.71 MB, 236.88 MB, 239.79 MB, 242.50 MB, 244.95 MB, 247.15 MB, 249.21 MB, 250.90 MB, 252.39 MB, 253.81 MB, 255.21 MB, 256.18 MB, 257.03 MB, 257.90 MB, 258.25 MB, 258.52 MB, 258.80 MB, 258.95 MB, 258.98 MB, 259.57 MB, 260.54 MB, 260.54 MB, 260.54 MB, 260.54 MB, 260.54 MB, 260.54 MB, 260.54 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 260.54 MB (273198684) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s850ms - NumBatchesAccepted: 13.19K (13186) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s380ms, % non-child: 1.14%) - ConvertRowBatchTime: 1s030ms - PeakMemoryUsage: 0 - RowsReturned: 37.16M (37161203) - RowsReturnedRate: 307.60 K/sec RecvrSide: BytesReceived(16s000ms): 6.06 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.90 MB, 118.19 MB, 383.06 MB, 504.37 MB, 568.52 MB, 615.43 MB, 646.47 MB, 662.13 MB - FirstBatchArrivalWaitTime: 3s901ms - TotalBytesReceived: 666.82 MB (699214386) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s087ms - NumBatchesAccepted: 56.80K (56795) - NumBatchesRejected: 52 (52) Instance 5f429df048b5534b:41bcce1800000285 (host=foo.221.18:22000):(Total: 12m38s, non-child: 76.444ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.46 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.13 MB, 162.43 MB, 162.40 MB, 217.67 MB, 289.65 MB, 295.18 MB, 329.15 MB, 357.41 MB, 366.65 MB, 375.67 MB, 384.67 MB, 403.14 MB, 410.67 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.41 MB, 418.40 MB, 418.41 MB, 418.42 MB, 422.91 MB, 426.40 MB, 426.43 MB, 426.40 MB, 426.42 MB, 426.42 MB, 426.42 MB, 426.43 MB, 426.43 MB, 426.43 MB, 426.39 MB, 426.42 MB, 426.42 MB, 427.47 MB, 461.41 MB, 623.25 MB, 624.04 MB, 623.68 MB, 623.91 MB, 624.23 MB, 624.02 MB, 624.22 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 637.30 MB (668261046) - PerHostPeakMemUsage: 1.48 GB (1585855039) - RowsProduced: 59 (59) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 16.362ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.49K (3490) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s140ms - TotalThreadsUserTime: 8s708ms - TotalThreadsVoluntaryContextSwitches: 64.34K (64340) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 60.525ms - ExecTreePrepareTime: 815.614us DataStreamSender (dst_id=26):(Total: 653.237us, non-child: 653.237us, % non-child: 100.00%) - BytesSent: 12.73 KB (13036) - OverallThroughput: 19.03 MB/sec - PeakMemoryUsage: 272.66 KB (279200) - RowsReturned: 59 (59) - SerializeBatchTime: 510.358us - UncompressedRowBatchSize: 12.73 KB (13036) CodeGen:(Total: 684.604ms, non-child: 684.604ms, % non-child: 100.00%) - CodegenTime: 17.456ms - CompileTime: 225.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 427.675ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.077ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 634.645ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.310us - GetResultsTime: 91.172us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 59 (59) - RowsReturnedRate: 0 - StreamingTime: 623.373ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.008ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.049ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9627212) - ProbeRows: 122 (122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 139.300us - RowsReturned: 118 (118) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 171.677us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 426.968us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 306.116us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s210ms, non-child: 77.115us, % non-child: 0.00%) - ConvertRowBatchTime: 44.458us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 770.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s210ms - DataArrivalTimer: 2s210ms SenderSide: - DeserializeRowBatchTimer: 208.253us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 16.706ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 513.895us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9570892) - ProbeRows: 122 (122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 149.128us - RowsReturned: 122 (122) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.406us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 268.775us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.231us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 971.182ms, non-child: 12.992us, % non-child: 0.00%) - ConvertRowBatchTime: 4.153us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 282.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 971.173ms - DataArrivalTimer: 971.170ms SenderSide: - DeserializeRowBatchTimer: 108.603us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s067ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1397435) - BuildTime: 1s661ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 612.13 MB (641863936) - ProbeRows: 37.05M (37052119) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s212ms - RowsReturned: 122 (122) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s372ms - BuildRowsPartitioned: 1.40M (1397435) - GetNewBlockTime: 2.871ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.95K (2950) - HashTablesBuildTime: 276.469ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 612.06 MB (641792128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 188.534ms, % non-child: 0.03%) - ConvertRowBatchTime: 88.755ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1397435) - RowsReturnedRate: 2.19 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 792.34 KB, 19.85 MB, 53.07 MB, 91.57 MB, 128.35 MB, 154.19 MB, 169.39 MB, 178.65 MB, 186.09 MB, 192.62 MB, 198.20 MB, 203.06 MB, 208.21 MB, 213.45 MB, 217.98 MB, 221.51 MB, 224.29 MB, 226.89 MB, 229.33 MB, 231.42 MB, 233.41 MB, 235.29 MB, 236.80 MB, 238.18 MB, 239.45 MB, 240.76 MB, 241.74 MB, 242.49 MB, 243.28 MB, 243.62 MB, 243.84 MB, 244.14 MB, 244.35 MB, 244.39 MB, 244.93 MB, 245.89 MB, 245.89 MB, 245.89 MB, 245.89 MB, 245.89 MB, 245.89 MB, 245.89 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 245.89 MB (257837661) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s743ms - NumBatchesAccepted: 12.54K (12535) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s330ms, % non-child: 1.12%) - ConvertRowBatchTime: 1s000ms - PeakMemoryUsage: 0 - RowsReturned: 37.05M (37052119) - RowsReturnedRate: 312.49 K/sec RecvrSide: BytesReceived(16s000ms): 6.12 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.87 MB, 119.27 MB, 383.76 MB, 503.33 MB, 567.17 MB, 613.80 MB, 644.66 MB, 660.14 MB - FirstBatchArrivalWaitTime: 3s894ms - TotalBytesReceived: 664.75 MB (697040677) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 3s895ms - NumBatchesAccepted: 56.64K (56637) - NumBatchesRejected: 84 (84) Instance 5f429df048b5534b:41bcce1800000280 (host=foo.221.25:22000):(Total: 12m38s, non-child: 75.930ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.07 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.72 MB, 161.92 MB, 162.41 MB, 215.17 MB, 290.42 MB, 294.67 MB, 330.89 MB, 358.17 MB, 370.93 MB, 378.43 MB, 386.17 MB, 402.42 MB, 415.66 MB, 418.42 MB, 418.45 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.40 MB, 418.40 MB, 418.41 MB, 418.93 MB, 426.40 MB, 427.91 MB, 434.43 MB, 434.42 MB, 434.40 MB, 434.41 MB, 434.40 MB, 434.44 MB, 434.40 MB, 434.43 MB, 434.49 MB, 434.36 MB, 446.95 MB, 604.18 MB, 603.62 MB, 603.98 MB, 603.88 MB, 603.80 MB, 604.01 MB, 603.88 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 617.30 MB (647289526) - PerHostPeakMemUsage: 1.32 GB (1416696524) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 14.093ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.70K (3703) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s223ms - TotalThreadsUserTime: 9s490ms - TotalThreadsVoluntaryContextSwitches: 62.80K (62803) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 58.568ms - ExecTreePrepareTime: 730.410us DataStreamSender (dst_id=26):(Total: 576.833us, non-child: 576.833us, % non-child: 100.00%) - BytesSent: 10.05 KB (10288) - OverallThroughput: 17.01 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 44 (44) - SerializeBatchTime: 417.261us - UncompressedRowBatchSize: 10.05 KB (10288) CodeGen:(Total: 675.735ms, non-child: 675.735ms, % non-child: 100.00%) - CodegenTime: 22.330ms - CompileTime: 225.401ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 419.667ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.176ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 618.110ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 477.034us - GetResultsTime: 163.079us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 602.039ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.185ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.714ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623407) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 141.873us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 159.430us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.315ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 148.063us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s587ms, non-child: 39.198us, % non-child: 0.00%) - ConvertRowBatchTime: 24.164us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.07 K/sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s587ms - DataArrivalTimer: 1s587ms SenderSide: - DeserializeRowBatchTimer: 114.579us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 6.546ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.411ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567087) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.515us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 66.694us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.061ms - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.850us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 957.864ms, non-child: 33.305us, % non-child: 0.00%) - ConvertRowBatchTime: 11.990us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 286.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 957.835ms - DataArrivalTimer: 957.831ms SenderSide: - DeserializeRowBatchTimer: 69.307us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s675ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1392441) - BuildTime: 1s757ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 592.13 MB (620892931) - ProbeRows: 37.03M (37027572) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s690ms - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s456ms - BuildRowsPartitioned: 1.39M (1392441) - GetNewBlockTime: 3.168ms - HashBuckets: 3.01M (3014656) - HashCollisions: 3.49K (3489) - HashTablesBuildTime: 287.980ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 592.06 MB (620820608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 202.733ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.219ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1392441) - RowsReturnedRate: 2.19 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 669.37 KB, 19.41 MB, 52.41 MB, 90.73 MB, 127.68 MB, 154.35 MB, 170.01 MB, 179.32 MB, 186.71 MB, 193.25 MB, 198.85 MB, 203.70 MB, 208.80 MB, 214.08 MB, 218.59 MB, 222.15 MB, 225.00 MB, 227.69 MB, 230.21 MB, 232.45 MB, 234.46 MB, 236.33 MB, 237.87 MB, 239.17 MB, 240.54 MB, 241.74 MB, 242.86 MB, 243.61 MB, 244.18 MB, 244.68 MB, 245.04 MB, 245.42 MB, 245.61 MB, 245.67 MB, 246.19 MB, 247.13 MB, 247.13 MB, 247.13 MB, 247.13 MB, 247.13 MB, 247.13 MB, 247.13 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 247.13 MB (259139355) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s808ms - NumBatchesAccepted: 12.49K (12495) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s427ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s065ms - PeakMemoryUsage: 0 - RowsReturned: 37.03M (37027572) - RowsReturnedRate: 313.59 K/sec RecvrSide: BytesReceived(16s000ms): 5.95 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.59 MB, 115.65 MB, 379.25 MB, 501.85 MB, 566.02 MB, 612.98 MB, 644.00 MB, 659.82 MB - FirstBatchArrivalWaitTime: 3s889ms - TotalBytesReceived: 664.58 MB (696860178) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s132ms - NumBatchesAccepted: 56.60K (56602) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce1800000217 (host=foo.221.23:22000):(Total: 12m38s, non-child: 110.667ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.23 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.23 MB, 160.66 MB, 162.43 MB, 208.68 MB, 288.68 MB, 291.91 MB, 318.15 MB, 349.94 MB, 377.91 MB, 386.41 MB, 389.89 MB, 401.15 MB, 402.39 MB, 409.92 MB, 410.42 MB, 410.42 MB, 410.40 MB, 417.90 MB, 418.41 MB, 418.41 MB, 418.42 MB, 418.42 MB, 418.66 MB, 426.41 MB, 426.43 MB, 433.64 MB, 434.38 MB, 434.41 MB, 434.41 MB, 434.38 MB, 434.41 MB, 434.40 MB, 434.37 MB, 434.41 MB, 484.34 MB, 610.61 MB, 610.78 MB, 609.65 MB, 609.95 MB, 609.86 MB, 610.20 MB, 609.98 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 623.30 MB (653580982) - PerHostPeakMemUsage: 1.32 GB (1417043785) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 37.166ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3913) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s284ms - TotalThreadsUserTime: 9s635ms - TotalThreadsVoluntaryContextSwitches: 63.37K (63370) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m35s - PrepareTime: 56.566ms - ExecTreePrepareTime: 892.537us DataStreamSender (dst_id=26):(Total: 763.623us, non-child: 763.623us, % non-child: 100.00%) - BytesSent: 11.35 KB (11622) - OverallThroughput: 14.51 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 53 (53) - SerializeBatchTime: 629.477us - UncompressedRowBatchSize: 11.35 KB (11622) CodeGen:(Total: 638.708ms, non-child: 638.708ms, % non-child: 100.00%) - CodegenTime: 15.869ms - CompileTime: 206.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 397.681ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.880ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 679.972ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 55.020us - GetResultsTime: 132.585us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925578) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - StreamingTime: 666.667ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.251ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 796.743us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 110 (110) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.795us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 124.926us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 400.686us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 171.811us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s660ms, non-child: 46.146us, % non-child: 0.00%) - ConvertRowBatchTime: 27.502us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.02 K/sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s660ms - DataArrivalTimer: 1s660ms SenderSide: - DeserializeRowBatchTimer: 269.594us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.219ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 566.929us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 110 (110) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.544us - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.563us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 350.858us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.368us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s023ms, non-child: 18.680us, % non-child: 0.00%) - ConvertRowBatchTime: 7.884us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 267.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s023ms - DataArrivalTimer: 1s023ms SenderSide: - DeserializeRowBatchTimer: 59.751us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s768ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1405971) - BuildTime: 1s741ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 37.15M (37146164) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s799ms - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s434ms - BuildRowsPartitioned: 1.41M (1405971) - GetNewBlockTime: 3.124ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.13K (4130) - HashTablesBuildTime: 293.446ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 202.697ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.641ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1405971) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 688.50 KB, 18.99 MB, 51.34 MB, 88.86 MB, 125.27 MB, 151.90 MB, 168.17 MB, 177.46 MB, 184.89 MB, 191.40 MB, 196.98 MB, 201.82 MB, 206.95 MB, 212.32 MB, 216.87 MB, 220.47 MB, 223.41 MB, 226.17 MB, 228.82 MB, 231.20 MB, 233.39 MB, 235.52 MB, 237.23 MB, 238.69 MB, 240.14 MB, 241.50 MB, 242.58 MB, 243.45 MB, 244.12 MB, 244.58 MB, 244.80 MB, 245.07 MB, 245.35 MB, 245.41 MB, 245.96 MB, 246.84 MB, 246.84 MB, 246.84 MB, 246.84 MB, 246.84 MB, 246.84 MB, 246.84 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 246.84 MB (258833453) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s968ms - NumBatchesAccepted: 12.62K (12620) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s438ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s074ms - PeakMemoryUsage: 0 - RowsReturned: 37.15M (37146164) - RowsReturnedRate: 306.46 K/sec RecvrSide: BytesReceived(16s000ms): 5.99 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.78 MB, 116.72 MB, 381.20 MB, 503.61 MB, 567.89 MB, 614.99 MB, 646.09 MB, 661.85 MB - FirstBatchArrivalWaitTime: 3s967ms - TotalBytesReceived: 666.59 MB (698970456) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s372ms - NumBatchesAccepted: 56.78K (56776) - NumBatchesRejected: 34 (34) Instance 5f429df048b5534b:41bcce1800000283 (host=foo.221.24:22000):(Total: 12m38s, non-child: 75.155ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.47 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.07 MB, 162.43 MB, 162.44 MB, 231.92 MB, 290.41 MB, 304.16 MB, 351.18 MB, 377.43 MB, 394.40 MB, 398.90 MB, 403.90 MB, 410.43 MB, 410.40 MB, 414.43 MB, 418.41 MB, 426.19 MB, 430.14 MB, 434.41 MB, 434.41 MB, 434.41 MB, 440.42 MB, 445.90 MB, 450.41 MB, 450.39 MB, 450.43 MB, 450.43 MB, 456.93 MB, 458.41 MB, 458.43 MB, 458.41 MB, 465.44 MB, 466.39 MB, 466.42 MB, 466.39 MB, 485.95 MB, 653.47 MB, 653.50 MB, 654.32 MB, 654.06 MB, 653.86 MB, 654.25 MB, 654.07 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 667.30 MB (699718326) - PerHostPeakMemUsage: 1.29 GB (1390088687) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 16.096ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3912) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s224ms - TotalThreadsUserTime: 9s588ms - TotalThreadsVoluntaryContextSwitches: 64.18K (64184) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 48.973ms - ExecTreePrepareTime: 407.012us DataStreamSender (dst_id=26):(Total: 444.312us, non-child: 444.312us, % non-child: 100.00%) - BytesSent: 10.68 KB (10937) - OverallThroughput: 23.48 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 52 (52) - SerializeBatchTime: 353.327us - UncompressedRowBatchSize: 10.68 KB (10937) CodeGen:(Total: 711.180ms, non-child: 711.180ms, % non-child: 100.00%) - CodegenTime: 17.302ms - CompileTime: 210.913ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 474.831ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.907ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 623.953ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 57.854us - GetResultsTime: 116.967us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9924778) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - StreamingTime: 611.538ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.189ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.095ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624874) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.677us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 129.663us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 704.906us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.798us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s185ms, non-child: 88.348us, % non-child: 0.00%) - ConvertRowBatchTime: 48.335us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 779.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s185ms - DataArrivalTimer: 2s185ms SenderSide: - DeserializeRowBatchTimer: 250.748us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.099ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 739.414us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9568554) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 157.080us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.638us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 478.131us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.366us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 998.335ms, non-child: 16.916us, % non-child: 0.00%) - ConvertRowBatchTime: 8.352us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 274.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 998.321ms - DataArrivalTimer: 998.319ms SenderSide: - DeserializeRowBatchTimer: 162.852us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s748ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1446913) - BuildTime: 1s810ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 642.13 MB (673321216) - ProbeRows: 37.13M (37134494) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s705ms - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s476ms - BuildRowsPartitioned: 1.45M (1446913) - GetNewBlockTime: 2.900ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.76K (4756) - HashTablesBuildTime: 320.783ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 642.06 MB (673249408) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 209.097ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.645ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1446913) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 854.20 KB, 20.98 MB, 55.94 MB, 96.06 MB, 134.09 MB, 161.24 MB, 177.46 MB, 187.17 MB, 195.00 MB, 201.99 MB, 207.87 MB, 213.05 MB, 218.53 MB, 224.09 MB, 228.83 MB, 232.63 MB, 235.67 MB, 238.52 MB, 241.14 MB, 243.46 MB, 245.56 MB, 247.52 MB, 249.15 MB, 250.58 MB, 251.97 MB, 253.21 MB, 254.24 MB, 255.04 MB, 255.60 MB, 256.01 MB, 256.29 MB, 256.56 MB, 256.86 MB, 256.96 MB, 257.44 MB, 258.30 MB, 258.30 MB, 258.30 MB, 258.30 MB, 258.30 MB, 258.30 MB, 258.30 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 258.30 MB (270851175) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s999ms - NumBatchesAccepted: 12.99K (12988) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s425ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s068ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37134494) - RowsReturnedRate: 314.78 K/sec RecvrSide: BytesReceived(16s000ms): 6.13 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.77 MB, 118.89 MB, 383.82 MB, 504.28 MB, 568.31 MB, 615.15 MB, 646.11 MB, 661.70 MB - FirstBatchArrivalWaitTime: 3s834ms - TotalBytesReceived: 666.36 MB (698733735) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s525ms - NumBatchesAccepted: 56.76K (56760) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce180000025d (host=foo.221.21:22000):(Total: 12m38s, non-child: 81.055ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.05 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.98 MB, 162.41 MB, 162.41 MB, 233.18 MB, 290.42 MB, 305.42 MB, 339.64 MB, 390.39 MB, 409.40 MB, 417.16 MB, 418.39 MB, 418.42 MB, 418.41 MB, 418.40 MB, 418.42 MB, 419.17 MB, 426.41 MB, 429.90 MB, 439.67 MB, 442.41 MB, 446.64 MB, 450.41 MB, 450.40 MB, 450.42 MB, 450.41 MB, 450.41 MB, 450.42 MB, 450.40 MB, 450.45 MB, 450.37 MB, 450.43 MB, 450.42 MB, 450.35 MB, 450.42 MB, 478.65 MB, 651.81 MB, 652.28 MB, 652.34 MB, 652.15 MB, 652.12 MB, 652.25 MB, 652.23 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 665.30 MB (697621174) - PerHostPeakMemUsage: 1.40 GB (1500370086) - RowsProduced: 60 (60) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 17.949ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.12K (4118) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s235ms - TotalThreadsUserTime: 9s701ms - TotalThreadsVoluntaryContextSwitches: 64.07K (64074) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 64.387ms - ExecTreePrepareTime: 838.114us DataStreamSender (dst_id=26):(Total: 706.050us, non-child: 706.050us, % non-child: 100.00%) - BytesSent: 13.25 KB (13568) - OverallThroughput: 18.33 MB/sec - PeakMemoryUsage: 272.66 KB (279200) - RowsReturned: 60 (60) - SerializeBatchTime: 501.555us - UncompressedRowBatchSize: 13.25 KB (13568) CodeGen:(Total: 717.970ms, non-child: 717.970ms, % non-child: 100.00%) - CodegenTime: 20.688ms - CompileTime: 219.500ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 462.166ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 35.581ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 641.952ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 47.149us - GetResultsTime: 169.159us - HTResizeTime: 596.819us - HashBuckets: 30.72K (30720) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.87 MB (12445521) - PinTime: 0.000ns - ReductionFactorEstimate: 4502866.32 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 60 (60) - RowsReturnedRate: 0 - StreamingTime: 628.461ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 3.089ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.091ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 11.34 MB (11895761) - ProbeRows: 2.75K (2751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 786.593us - RowsReturned: 2.75K (2751) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 150.597us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 507.583us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 106.645us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s541ms, non-child: 96.441us, % non-child: 0.01%) - ConvertRowBatchTime: 79.998us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s541ms - DataArrivalTimer: 1s541ms SenderSide: - DeserializeRowBatchTimer: 275.496us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.884ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 768.070us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565037) - ProbeRows: 2.75K (2751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 763.279us - RowsReturned: 2.75K (2751) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 30.426us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 485.883us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.246us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 929.500ms, non-child: 24.371us, % non-child: 0.00%) - ConvertRowBatchTime: 13.050us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 294.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 929.480ms - DataArrivalTimer: 929.476ms SenderSide: - DeserializeRowBatchTimer: 31.235us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s808ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.49M (1485954) - BuildTime: 1s904ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 640.13 MB (671224064) - ProbeRows: 37.13M (37125829) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s676ms - RowsReturned: 2.75K (2751) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s500ms - BuildRowsPartitioned: 1.49M (1485954) - GetNewBlockTime: 3.241ms - HashBuckets: 4.06M (4063232) - HashCollisions: 2.96K (2960) - HashTablesBuildTime: 389.741ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 640.06 MB (671152256) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 219.643ms, % non-child: 0.03%) - ConvertRowBatchTime: 101.268ms - PeakMemoryUsage: 0 - RowsReturned: 1.49M (1485954) - RowsReturnedRate: 2.34 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 727.06 KB, 20.47 MB, 55.53 MB, 96.20 MB, 135.24 MB, 163.16 MB, 179.86 MB, 189.99 MB, 198.14 MB, 205.27 MB, 211.35 MB, 216.61 MB, 222.06 MB, 227.72 MB, 232.54 MB, 236.48 MB, 239.55 MB, 242.43 MB, 245.16 MB, 247.60 MB, 249.89 MB, 252.01 MB, 253.79 MB, 255.25 MB, 256.73 MB, 258.07 MB, 259.18 MB, 259.85 MB, 260.62 MB, 261.12 MB, 261.45 MB, 261.77 MB, 261.95 MB, 262.04 MB, 262.61 MB, 263.58 MB, 263.58 MB, 263.58 MB, 263.58 MB, 263.58 MB, 263.58 MB, 263.58 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 263.58 MB (276384115) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 2s285ms - NumBatchesAccepted: 13.33K (13327) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s432ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s066ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37125829) - RowsReturnedRate: 312.56 K/sec RecvrSide: BytesReceived(16s000ms): 5.95 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.63 MB, 115.36 MB, 379.57 MB, 502.95 MB, 567.26 MB, 614.41 MB, 645.56 MB, 661.47 MB - FirstBatchArrivalWaitTime: 3s845ms - TotalBytesReceived: 666.25 MB (698612051) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s233ms - NumBatchesAccepted: 56.74K (56743) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce1800000244 (host=foo.221.20:22000):(Total: 12m38s, non-child: 80.147ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.30 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.88 MB, 162.19 MB, 162.40 MB, 224.42 MB, 290.67 MB, 303.65 MB, 338.92 MB, 374.18 MB, 381.68 MB, 386.91 MB, 405.16 MB, 410.40 MB, 410.42 MB, 410.41 MB, 418.16 MB, 426.41 MB, 433.65 MB, 434.41 MB, 434.41 MB, 434.44 MB, 434.41 MB, 434.43 MB, 434.41 MB, 434.44 MB, 438.93 MB, 447.16 MB, 457.93 MB, 458.41 MB, 458.42 MB, 458.42 MB, 458.42 MB, 459.18 MB, 466.41 MB, 466.38 MB, 501.65 MB, 652.92 MB, 652.31 MB, 651.72 MB, 651.47 MB, 651.93 MB, 652.36 MB, 652.38 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 665.30 MB (697621174) - PerHostPeakMemUsage: 1.39 GB (1494618394) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 17.684ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.60K (3599) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s238ms - TotalThreadsUserTime: 9s326ms - TotalThreadsVoluntaryContextSwitches: 64.70K (64699) Fragment Instance Lifecycle Timings: - ExecTime: 1m56s - ExecTreeExecTime: 1m56s - OpenTime: 10m42s - ExecTreeOpenTime: 10m42s - PrepareTime: 54.173ms - ExecTreePrepareTime: 717.041us DataStreamSender (dst_id=26):(Total: 592.180us, non-child: 592.180us, % non-child: 100.00%) - BytesSent: 10.58 KB (10831) - OverallThroughput: 17.44 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 48 (48) - SerializeBatchTime: 433.856us - UncompressedRowBatchSize: 10.58 KB (10831) CodeGen:(Total: 664.873ms, non-child: 664.873ms, % non-child: 100.00%) - CodegenTime: 26.120ms - CompileTime: 224.169ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 412.796ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.446ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 662.921ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 49.925us - GetResultsTime: 188.251us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924028) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 649.621ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.062ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.003ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620028) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.436us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 155.432us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 440.800us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 232.108us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s120ms, non-child: 65.302us, % non-child: 0.01%) - ConvertRowBatchTime: 38.439us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.52 K/sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s120ms - DataArrivalTimer: 1s120ms SenderSide: - DeserializeRowBatchTimer: 162.843us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 55.909ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 632.770us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563708) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 173.359us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.850us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 345.947us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.503us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 977.513ms, non-child: 17.578us, % non-child: 0.00%) - ConvertRowBatchTime: 7.778us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 280.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 977.499ms - DataArrivalTimer: 977.496ms SenderSide: - DeserializeRowBatchTimer: 58.138us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s595ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1434571) - BuildTime: 1s749ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 640.13 MB (671224064) - ProbeRows: 37.05M (37054141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s629ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s470ms - BuildRowsPartitioned: 1.43M (1434571) - GetNewBlockTime: 3.309ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.44K (4442) - HashTablesBuildTime: 267.065ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 640.06 MB (671152256) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 204.475ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.182ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1434571) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 734.48 KB, 20.07 MB, 54.10 MB, 93.85 MB, 132.08 MB, 159.10 MB, 175.02 MB, 184.60 MB, 192.34 MB, 199.25 MB, 205.15 MB, 210.27 MB, 215.52 MB, 221.07 MB, 225.86 MB, 229.55 MB, 232.55 MB, 235.31 MB, 237.89 MB, 240.14 MB, 242.18 MB, 244.22 MB, 245.87 MB, 247.20 MB, 248.80 MB, 249.98 MB, 251.28 MB, 251.99 MB, 252.72 MB, 253.26 MB, 253.58 MB, 253.85 MB, 254.01 MB, 254.07 MB, 254.58 MB, 255.46 MB, 255.46 MB, 255.46 MB, 255.46 MB, 255.46 MB, 255.46 MB, 255.46 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.46 MB (267871962) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s748ms - NumBatchesAccepted: 12.87K (12872) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s398ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s044ms - PeakMemoryUsage: 0 - RowsReturned: 37.05M (37054141) - RowsReturnedRate: 309.39 K/sec RecvrSide: BytesReceived(16s000ms): 6.03 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.77 MB, 116.96 MB, 380.96 MB, 502.62 MB, 566.67 MB, 613.45 MB, 644.40 MB, 660.13 MB - FirstBatchArrivalWaitTime: 3s907ms - TotalBytesReceived: 664.86 MB (697158079) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s388ms - NumBatchesAccepted: 56.63K (56634) - NumBatchesRejected: 52 (52) Instance 5f429df048b5534b:41bcce1800000268 (host=foo.221.17:22000):(Total: 12m38s, non-child: 60.671ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.51 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 27.36 MB, 162.39 MB, 162.40 MB, 235.65 MB, 290.40 MB, 314.88 MB, 348.64 MB, 388.65 MB, 400.13 MB, 409.90 MB, 410.37 MB, 417.64 MB, 418.39 MB, 419.14 MB, 429.16 MB, 434.39 MB, 434.39 MB, 434.39 MB, 434.38 MB, 435.40 MB, 442.37 MB, 442.39 MB, 442.39 MB, 449.65 MB, 450.39 MB, 450.39 MB, 450.39 MB, 450.42 MB, 450.65 MB, 458.40 MB, 458.41 MB, 458.38 MB, 458.38 MB, 458.36 MB, 489.49 MB, 645.10 MB, 646.13 MB, 646.06 MB, 645.77 MB, 645.98 MB, 646.16 MB, 645.76 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 659.28 MB (691308103) - PerHostPeakMemUsage: 1.43 GB (1532785948) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 10.694ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.86K (3861) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s197ms - TotalThreadsUserTime: 9s309ms - TotalThreadsVoluntaryContextSwitches: 63.98K (63976) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 62.930ms - ExecTreePrepareTime: 600.515us DataStreamSender (dst_id=26):(Total: 431.817us, non-child: 431.817us, % non-child: 100.00%) - BytesSent: 8.58 KB (8788) - OverallThroughput: 19.41 MB/sec - PeakMemoryUsage: 228.66 KB (234144) - RowsReturned: 42 (42) - SerializeBatchTime: 325.313us - UncompressedRowBatchSize: 8.58 KB (8788) CodeGen:(Total: 681.850ms, non-child: 681.850ms, % non-child: 100.00%) - CodegenTime: 16.986ms - CompileTime: 211.289ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 429.902ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 40.173ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 628.121ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 54.566us - GetResultsTime: 83.878us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9914190) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - StreamingTime: 614.638ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.795ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.219ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623253) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 114.656us - RowsReturned: 84 (84) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 179.933us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 667.770us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 190.384us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s233ms, non-child: 70.839us, % non-child: 0.00%) - ConvertRowBatchTime: 52.271us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 762.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s233ms - DataArrivalTimer: 2s233ms SenderSide: - DeserializeRowBatchTimer: 183.560us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.030ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 758.967us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566933) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 105.212us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.616us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 495.480us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.347us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 959.251ms, non-child: 19.512us, % non-child: 0.00%) - ConvertRowBatchTime: 8.169us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 285.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 959.236ms - DataArrivalTimer: 959.233ms SenderSide: - DeserializeRowBatchTimer: 22.044us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s494ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1455984) - BuildTime: 1s732ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 634.13 MB (664932608) - ProbeRows: 37.02M (37018675) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s540ms - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s462ms - BuildRowsPartitioned: 1.46M (1455984) - GetNewBlockTime: 3.070ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.92K (3924) - HashTablesBuildTime: 257.710ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 634.06 MB (664860800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 205.301ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.546ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1455984) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 868.66 KB, 20.97 MB, 56.21 MB, 97.26 MB, 136.51 MB, 164.58 MB, 181.16 MB, 190.78 MB, 198.49 MB, 205.23 MB, 210.97 MB, 215.94 MB, 221.17 MB, 226.60 MB, 231.24 MB, 234.88 MB, 237.72 MB, 240.32 MB, 242.78 MB, 244.99 MB, 247.01 MB, 249.00 MB, 250.61 MB, 251.96 MB, 253.42 MB, 254.70 MB, 255.80 MB, 256.49 MB, 257.19 MB, 257.65 MB, 258.04 MB, 258.40 MB, 258.61 MB, 258.64 MB, 259.14 MB, 260.07 MB, 260.07 MB, 260.07 MB, 260.07 MB, 260.07 MB, 260.07 MB, 260.07 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 260.07 MB (272706320) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s915ms - NumBatchesAccepted: 13.06K (13062) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s411ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s055ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37018675) - RowsReturnedRate: 310.81 K/sec RecvrSide: BytesReceived(16s000ms): 6.15 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.99 MB, 119.78 MB, 384.14 MB, 503.21 MB, 567.03 MB, 613.59 MB, 644.37 MB, 659.79 MB - FirstBatchArrivalWaitTime: 3s885ms - TotalBytesReceived: 664.41 MB (696682341) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s376ms - NumBatchesAccepted: 56.58K (56579) - NumBatchesRejected: 56 (56) Instance 5f429df048b5534b:41bcce180000023c (host=foo.221.27:22000):(Total: 12m38s, non-child: 79.683ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.42 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 24.37 MB, 162.39 MB, 162.39 MB, 224.16 MB, 290.41 MB, 299.13 MB, 330.64 MB, 367.91 MB, 394.88 MB, 402.41 MB, 414.39 MB, 418.41 MB, 418.41 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.41 MB, 418.38 MB, 418.41 MB, 419.16 MB, 428.40 MB, 434.40 MB, 434.40 MB, 434.39 MB, 441.90 MB, 442.38 MB, 442.39 MB, 442.40 MB, 442.42 MB, 442.37 MB, 442.39 MB, 442.37 MB, 442.45 MB, 479.81 MB, 627.90 MB, 627.97 MB, 627.94 MB, 627.73 MB, 627.68 MB, 628.28 MB, 628.06 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.28 MB (672433735) - PerHostPeakMemUsage: 1.20 GB (1292996464) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 19.747ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.01K (4009) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s256ms - TotalThreadsUserTime: 9s368ms - TotalThreadsVoluntaryContextSwitches: 64.26K (64262) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m40s - ExecTreeOpenTime: 10m40s - PrepareTime: 51.630ms - ExecTreePrepareTime: 1.345ms DataStreamSender (dst_id=26):(Total: 895.734us, non-child: 895.734us, % non-child: 100.00%) - BytesSent: 9.51 KB (9736) - OverallThroughput: 10.37 MB/sec - PeakMemoryUsage: 224.66 KB (230048) - RowsReturned: 46 (46) - SerializeBatchTime: 668.925us - UncompressedRowBatchSize: 9.51 KB (9736) CodeGen:(Total: 677.885ms, non-child: 677.885ms, % non-child: 100.00%) - CodegenTime: 15.906ms - CompileTime: 234.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 414.286ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.354ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 652.304ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 70.963us - GetResultsTime: 147.186us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919653) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 639.320ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.245ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 949.580us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619749) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 119.480us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 122.634us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 505.134us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 96.889us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s282ms, non-child: 77.535us, % non-child: 0.01%) - ConvertRowBatchTime: 54.565us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.33 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s282ms - DataArrivalTimer: 1s282ms SenderSide: - DeserializeRowBatchTimer: 180.660us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 18.580ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 769.577us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563429) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.845us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.643us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 341.148us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.601us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 1s034ms, non-child: 18.365us, % non-child: 0.00%) - ConvertRowBatchTime: 7.401us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 264.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s034ms - DataArrivalTimer: 1s034ms SenderSide: - DeserializeRowBatchTimer: 38.956us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s526ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1427830) - BuildTime: 1s698ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.04M (37044253) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s610ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s421ms - BuildRowsPartitioned: 1.43M (1427830) - GetNewBlockTime: 2.501ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.73K (3733) - HashTablesBuildTime: 266.145ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 209.728ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.650ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1427830) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 772.99 KB, 20.13 MB, 54.23 MB, 93.59 MB, 131.81 MB, 159.22 MB, 175.18 MB, 184.40 MB, 191.85 MB, 198.55 MB, 204.27 MB, 209.22 MB, 214.46 MB, 219.87 MB, 224.51 MB, 228.17 MB, 231.12 MB, 233.87 MB, 236.43 MB, 238.59 MB, 240.56 MB, 242.43 MB, 243.99 MB, 245.46 MB, 246.75 MB, 248.16 MB, 249.12 MB, 250.01 MB, 250.65 MB, 251.13 MB, 251.35 MB, 251.71 MB, 251.93 MB, 252.02 MB, 252.55 MB, 253.44 MB, 253.44 MB, 253.44 MB, 253.44 MB, 253.44 MB, 253.44 MB, 253.44 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 253.44 MB (265755413) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s969ms - NumBatchesAccepted: 12.81K (12810) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s413ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s046ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37044253) - RowsReturnedRate: 309.11 K/sec RecvrSide: BytesReceived(16s000ms): 6.10 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.86 MB, 118.28 MB, 382.46 MB, 503.03 MB, 566.92 MB, 613.65 MB, 644.55 MB, 660.11 MB - FirstBatchArrivalWaitTime: 3s872ms - TotalBytesReceived: 664.77 MB (697058181) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s301ms - NumBatchesAccepted: 56.62K (56621) - NumBatchesRejected: 54 (54) Instance 5f429df048b5534b:41bcce1800000226 (host=foo.221.28:22000):(Total: 12m38s, non-child: 103.760ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.04 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 23.96 MB, 160.13 MB, 162.43 MB, 222.63 MB, 286.67 MB, 307.91 MB, 338.63 MB, 349.66 MB, 371.17 MB, 400.40 MB, 402.39 MB, 402.42 MB, 402.40 MB, 409.91 MB, 410.40 MB, 410.43 MB, 411.92 MB, 418.65 MB, 426.41 MB, 439.90 MB, 450.40 MB, 450.42 MB, 450.40 MB, 450.41 MB, 450.41 MB, 450.42 MB, 456.65 MB, 458.42 MB, 458.45 MB, 458.42 MB, 458.41 MB, 458.42 MB, 458.37 MB, 458.44 MB, 501.69 MB, 629.99 MB, 629.93 MB, 629.56 MB, 630.07 MB, 629.65 MB, 630.01 MB, 630.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.38 GB (1485233861) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 34.219ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.32K (3322) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s124ms - TotalThreadsUserTime: 9s007ms - TotalThreadsVoluntaryContextSwitches: 64.39K (64395) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 53.503ms - ExecTreePrepareTime: 762.285us DataStreamSender (dst_id=26):(Total: 541.099us, non-child: 541.099us, % non-child: 100.00%) - BytesSent: 9.92 KB (10161) - OverallThroughput: 17.91 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 48 (48) - SerializeBatchTime: 408.806us - UncompressedRowBatchSize: 9.92 KB (10161) CodeGen:(Total: 694.480ms, non-child: 694.480ms, % non-child: 100.00%) - CodegenTime: 18.866ms - CompileTime: 216.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 449.490ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.738ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 679.142ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 63.395us - GetResultsTime: 101.462us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9920103) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 668.495ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.180ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.104ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620328) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 121.909us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 151.296us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 550.652us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 248.853us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s496ms, non-child: 66.348us, % non-child: 0.00%) - ConvertRowBatchTime: 46.357us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s495ms - DataArrivalTimer: 1s495ms SenderSide: - DeserializeRowBatchTimer: 179.766us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 1.970ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 596.558us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564008) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 114.879us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.660us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 362.176us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.678us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 873.142ms, non-child: 13.063us, % non-child: 0.00%) - ConvertRowBatchTime: 4.516us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 313.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 873.132ms - DataArrivalTimer: 873.129ms SenderSide: - DeserializeRowBatchTimer: 234.376us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s313ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1421913) - BuildTime: 1s767ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.08M (37079078) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s339ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s475ms - BuildRowsPartitioned: 1.42M (1421913) - GetNewBlockTime: 3.308ms - HashBuckets: 3.15M (3145728) - HashCollisions: 2.60K (2604) - HashTablesBuildTime: 283.289ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 203.845ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.977ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1421913) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 675.31 KB, 19.75 MB, 53.68 MB, 93.02 MB, 131.05 MB, 157.66 MB, 172.95 MB, 182.27 MB, 189.86 MB, 196.51 MB, 202.27 MB, 207.26 MB, 212.38 MB, 217.75 MB, 222.32 MB, 225.85 MB, 228.65 MB, 231.27 MB, 233.76 MB, 235.90 MB, 237.83 MB, 239.70 MB, 241.23 MB, 242.49 MB, 243.82 MB, 244.99 MB, 246.01 MB, 246.71 MB, 247.34 MB, 247.77 MB, 248.15 MB, 248.43 MB, 248.62 MB, 248.67 MB, 249.16 MB, 250.04 MB, 250.04 MB, 250.04 MB, 250.04 MB, 250.04 MB, 250.04 MB, 250.04 MB - FirstBatchArrivalWaitTime: 1m32s - TotalBytesReceived: 250.04 MB (262188510) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s827ms - NumBatchesAccepted: 12.76K (12759) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s361ms, % non-child: 1.12%) - ConvertRowBatchTime: 1s013ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37079078) - RowsReturnedRate: 306.06 K/sec RecvrSide: BytesReceived(16s000ms): 5.94 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.72 MB, 115.51 MB, 379.44 MB, 502.39 MB, 566.63 MB, 613.67 MB, 644.78 MB, 660.66 MB - FirstBatchArrivalWaitTime: 3s811ms - TotalBytesReceived: 665.42 MB (697748476) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s931ms - NumBatchesAccepted: 56.67K (56675) - NumBatchesRejected: 31 (31) Instance 5f429df048b5534b:41bcce1800000247 (host=foo.221.30:22000):(Total: 12m38s, non-child: 71.738ms, % non-child: 0.01%) MemoryUsage(16s000ms): 13.90 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.48 MB, 161.44 MB, 162.42 MB, 226.41 MB, 290.42 MB, 309.66 MB, 336.40 MB, 354.65 MB, 384.17 MB, 395.17 MB, 411.90 MB, 418.41 MB, 418.41 MB, 418.43 MB, 418.41 MB, 424.42 MB, 427.63 MB, 437.90 MB, 442.41 MB, 442.42 MB, 444.42 MB, 450.39 MB, 450.40 MB, 452.39 MB, 458.41 MB, 458.42 MB, 458.39 MB, 458.41 MB, 458.42 MB, 458.39 MB, 462.20 MB, 466.40 MB, 466.41 MB, 466.43 MB, 494.96 MB, 637.88 MB, 638.05 MB, 637.67 MB, 637.73 MB, 637.79 MB, 637.85 MB, 638.52 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.30 MB (682941110) - PerHostPeakMemUsage: 1.32 GB (1419515909) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 12.956ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.73K (3727) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s234ms - TotalThreadsUserTime: 9s684ms - TotalThreadsVoluntaryContextSwitches: 63.86K (63864) Fragment Instance Lifecycle Timings: - ExecTime: 1m56s - ExecTreeExecTime: 1m56s - OpenTime: 10m42s - ExecTreeOpenTime: 10m42s - PrepareTime: 48.215ms - ExecTreePrepareTime: 691.540us DataStreamSender (dst_id=26):(Total: 471.341us, non-child: 471.341us, % non-child: 100.00%) - BytesSent: 8.38 KB (8579) - OverallThroughput: 17.36 MB/sec - PeakMemoryUsage: 208.66 KB (213664) - RowsReturned: 40 (40) - SerializeBatchTime: 312.083us - UncompressedRowBatchSize: 8.38 KB (8579) CodeGen:(Total: 687.554ms, non-child: 687.554ms, % non-child: 100.00%) - CodegenTime: 17.511ms - CompileTime: 222.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 439.582ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.809ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 631.625ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 55.960us - GetResultsTime: 188.716us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9910894) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 617.610ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.897ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.258ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.451us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 183.065us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 742.205us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 190.824us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s502ms, non-child: 92.860us, % non-child: 0.01%) - ConvertRowBatchTime: 70.532us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.13 K/sec RecvrSide: BytesReceived(16s000ms): 21.95 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s502ms - DataArrivalTimer: 1s502ms SenderSide: - DeserializeRowBatchTimer: 180.890us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 41.089ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 677.626us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.286us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54.064us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 349.928us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 105.777us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 891.176ms, non-child: 20.573us, % non-child: 0.00%) - ConvertRowBatchTime: 7.621us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 307.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 891.162ms - DataArrivalTimer: 891.156ms SenderSide: - DeserializeRowBatchTimer: 74.194us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s834ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1440441) - BuildTime: 1s817ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656546786) - ProbeRows: 37.08M (37080465) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s792ms - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s485ms - BuildRowsPartitioned: 1.44M (1440441) - GetNewBlockTime: 3.134ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.86K (3858) - HashTablesBuildTime: 319.041ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 197.888ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.845ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1440441) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 696.99 KB, 19.90 MB, 54.49 MB, 94.35 MB, 132.75 MB, 160.27 MB, 176.18 MB, 185.77 MB, 193.38 MB, 200.10 MB, 205.95 MB, 211.04 MB, 216.31 MB, 221.84 MB, 226.58 MB, 230.24 MB, 233.18 MB, 235.98 MB, 238.56 MB, 240.85 MB, 242.80 MB, 244.65 MB, 246.26 MB, 247.56 MB, 248.88 MB, 250.08 MB, 251.21 MB, 251.94 MB, 252.60 MB, 253.19 MB, 253.49 MB, 253.75 MB, 254.05 MB, 254.12 MB, 254.62 MB, 255.57 MB, 255.57 MB, 255.57 MB, 255.57 MB, 255.57 MB, 255.57 MB, 255.57 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.57 MB (267988337) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s688ms - NumBatchesAccepted: 12.93K (12925) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s448ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s072ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37080465) - RowsReturnedRate: 310.81 K/sec RecvrSide: BytesReceived(16s000ms): 5.92 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.67 MB, 115.43 MB, 379.29 MB, 502.41 MB, 566.68 MB, 613.72 MB, 644.79 MB, 660.65 MB - FirstBatchArrivalWaitTime: 3s811ms - TotalBytesReceived: 665.41 MB (697732064) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s396ms - NumBatchesAccepted: 56.68K (56677) - NumBatchesRejected: 55 (55) Instance 5f429df048b5534b:41bcce1800000294 (host=foo.221.44:22000):(Total: 12m38s, non-child: 72.141ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.32 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.90 MB, 161.94 MB, 162.42 MB, 225.68 MB, 289.93 MB, 301.67 MB, 350.16 MB, 366.18 MB, 379.67 MB, 398.93 MB, 410.41 MB, 410.41 MB, 410.41 MB, 413.43 MB, 418.41 MB, 425.40 MB, 426.40 MB, 426.40 MB, 434.41 MB, 434.41 MB, 437.16 MB, 442.42 MB, 442.41 MB, 442.43 MB, 442.40 MB, 449.42 MB, 464.42 MB, 466.42 MB, 466.44 MB, 466.41 MB, 469.14 MB, 474.41 MB, 474.35 MB, 474.35 MB, 490.79 MB, 649.11 MB, 650.75 MB, 649.70 MB, 649.99 MB, 650.11 MB, 650.17 MB, 650.41 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 663.30 MB (695524022) - PerHostPeakMemUsage: 1.39 GB (1493934538) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 15.218ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.81K (3815) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s236ms - TotalThreadsUserTime: 9s275ms - TotalThreadsVoluntaryContextSwitches: 64.14K (64137) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 47.762ms - ExecTreePrepareTime: 819.409us DataStreamSender (dst_id=26):(Total: 471.084us, non-child: 471.084us, % non-child: 100.00%) - BytesSent: 10.59 KB (10843) - OverallThroughput: 21.95 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 50 (50) - SerializeBatchTime: 382.903us - UncompressedRowBatchSize: 10.59 KB (10843) CodeGen:(Total: 657.908ms, non-child: 657.908ms, % non-child: 100.00%) - CodegenTime: 18.948ms - CompileTime: 215.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 417.065ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.857ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 645.797ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 42.830us - GetResultsTime: 232.013us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927228) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 630.855ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.763ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 914.132us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623228) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.034us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 129.939us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 574.061us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 125.009us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s091ms, non-child: 58.259us, % non-child: 0.01%) - ConvertRowBatchTime: 42.459us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.56 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s091ms - DataArrivalTimer: 1s091ms SenderSide: - DeserializeRowBatchTimer: 200.724us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 7.710ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 804.783us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566908) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 137.731us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 65.829us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 520.107us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.520us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 718.475ms, non-child: 19.488us, % non-child: 0.00%) - ConvertRowBatchTime: 11.293us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 381.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 718.458ms - DataArrivalTimer: 718.456ms SenderSide: - DeserializeRowBatchTimer: 56.421us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s541ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1458587) - BuildTime: 1s766ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 638.13 MB (669126912) - ProbeRows: 37.07M (37067144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s556ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s485ms - BuildRowsPartitioned: 1.46M (1458587) - GetNewBlockTime: 3.138ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.79K (3787) - HashTablesBuildTime: 268.251ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 638.06 MB (669055104) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 210.201ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.562ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1458587) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 786.32 KB, 20.28 MB, 54.50 MB, 94.20 MB, 132.20 MB, 159.62 MB, 175.95 MB, 185.46 MB, 193.22 MB, 200.07 MB, 206.04 MB, 211.27 MB, 216.72 MB, 222.37 MB, 227.19 MB, 230.93 MB, 234.00 MB, 236.84 MB, 239.54 MB, 241.88 MB, 244.01 MB, 246.06 MB, 247.70 MB, 249.09 MB, 250.52 MB, 251.75 MB, 252.99 MB, 253.83 MB, 254.48 MB, 255.06 MB, 255.42 MB, 255.73 MB, 255.96 MB, 256.02 MB, 256.45 MB, 257.38 MB, 257.38 MB, 257.38 MB, 257.38 MB, 257.38 MB, 257.38 MB, 257.38 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 257.38 MB (269880020) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 2s041ms - NumBatchesAccepted: 13.09K (13086) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s390ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s039ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37067144) - RowsReturnedRate: 313.88 K/sec RecvrSide: BytesReceived(16s000ms): 6.10 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.83 MB, 119.00 MB, 383.60 MB, 503.56 MB, 567.45 MB, 614.13 MB, 645.00 MB, 660.55 MB - FirstBatchArrivalWaitTime: 3s661ms - TotalBytesReceived: 665.18 MB (697495435) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s255ms - NumBatchesAccepted: 56.65K (56652) - NumBatchesRejected: 82 (82) Instance 5f429df048b5534b:41bcce1800000233 (host=foo.221.32:22000):(Total: 12m38s, non-child: 83.658ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.59 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 26.52 MB, 161.89 MB, 162.39 MB, 217.64 MB, 286.63 MB, 300.38 MB, 338.88 MB, 354.41 MB, 359.15 MB, 379.14 MB, 386.39 MB, 391.15 MB, 400.91 MB, 410.39 MB, 410.40 MB, 410.39 MB, 410.37 MB, 416.89 MB, 421.39 MB, 426.40 MB, 426.40 MB, 426.38 MB, 426.37 MB, 432.87 MB, 439.89 MB, 442.38 MB, 448.38 MB, 458.39 MB, 458.36 MB, 464.18 MB, 466.38 MB, 466.38 MB, 466.37 MB, 466.37 MB, 512.72 MB, 637.56 MB, 637.52 MB, 637.53 MB, 637.76 MB, 637.93 MB, 637.99 MB, 637.33 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.28 MB (682919495) - PerHostPeakMemUsage: 1.38 GB (1478564799) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 24.182ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.95K (3947) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s240ms - TotalThreadsUserTime: 9s402ms - TotalThreadsVoluntaryContextSwitches: 64.05K (64053) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 60.812ms - ExecTreePrepareTime: 748.406us DataStreamSender (dst_id=26):(Total: 714.837us, non-child: 714.837us, % non-child: 100.00%) - BytesSent: 10.13 KB (10374) - OverallThroughput: 13.84 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 46 (46) - SerializeBatchTime: 548.543us - UncompressedRowBatchSize: 10.13 KB (10374) CodeGen:(Total: 677.631ms, non-child: 677.631ms, % non-child: 100.00%) - CodegenTime: 15.967ms - CompileTime: 204.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 432.971ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 39.031ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 678.603ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 66.171us - GetResultsTime: 103.461us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 666.645ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.569ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.152ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 708 (708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 399.748us - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 193.419us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 626.413us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 160.529us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s312ms, non-child: 68.339us, % non-child: 0.00%) - ConvertRowBatchTime: 47.529us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 736.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s312ms - DataArrivalTimer: 2s312ms SenderSide: - DeserializeRowBatchTimer: 156.403us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.813ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 836.155us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 708 (708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 548.596us - RowsReturned: 708 (708) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 63.989us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 511.786us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 119.302us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 830.154ms, non-child: 25.613us, % non-child: 0.00%) - ConvertRowBatchTime: 14.046us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 330.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 830.133ms - DataArrivalTimer: 830.129ms SenderSide: - DeserializeRowBatchTimer: 159.153us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s535ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1396601) - BuildTime: 1s719ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 36.96M (36960743) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s598ms - RowsReturned: 708 (708) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s438ms - BuildRowsPartitioned: 1.40M (1396601) - GetNewBlockTime: 4.396ms - HashBuckets: 3.15M (3145728) - HashCollisions: 5.11K (5108) - HashTablesBuildTime: 268.239ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 200.095ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.284ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1396601) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 837.27 KB, 20.07 MB, 53.30 MB, 91.47 MB, 127.69 MB, 153.84 MB, 169.39 MB, 178.58 MB, 186.05 MB, 192.74 MB, 198.54 MB, 203.53 MB, 208.76 MB, 214.16 MB, 218.87 MB, 222.57 MB, 225.48 MB, 228.12 MB, 230.61 MB, 232.87 MB, 234.86 MB, 236.81 MB, 238.29 MB, 239.59 MB, 240.84 MB, 241.93 MB, 242.96 MB, 243.80 MB, 244.21 MB, 244.61 MB, 244.95 MB, 245.33 MB, 245.50 MB, 245.58 MB, 246.18 MB, 247.00 MB, 247.00 MB, 247.00 MB, 247.00 MB, 247.00 MB, 247.00 MB, 247.00 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 247.00 MB (259003208) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s935ms - NumBatchesAccepted: 12.54K (12540) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s432ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s061ms - PeakMemoryUsage: 0 - RowsReturned: 36.96M (36960743) - RowsReturnedRate: 306.55 K/sec RecvrSide: BytesReceived(16s000ms): 6.20 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.20 MB, 120.67 MB, 384.75 MB, 502.74 MB, 566.39 MB, 612.75 MB, 643.45 MB, 658.70 MB - FirstBatchArrivalWaitTime: 3s747ms - TotalBytesReceived: 663.26 MB (695477761) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s340ms - NumBatchesAccepted: 56.49K (56493) - NumBatchesRejected: 35 (35) Instance 5f429df048b5534b:41bcce1800000225 (host=foo.221.35:22000):(Total: 12m38s, non-child: 86.644ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.07 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.24 MB, 161.67 MB, 162.41 MB, 217.41 MB, 290.41 MB, 304.92 MB, 330.18 MB, 351.90 MB, 365.68 MB, 382.90 MB, 404.43 MB, 410.39 MB, 413.91 MB, 418.43 MB, 418.41 MB, 418.42 MB, 418.42 MB, 423.43 MB, 426.40 MB, 426.40 MB, 433.68 MB, 434.41 MB, 434.42 MB, 434.42 MB, 441.68 MB, 447.67 MB, 450.41 MB, 450.42 MB, 450.42 MB, 450.41 MB, 450.42 MB, 450.38 MB, 450.37 MB, 450.44 MB, 494.89 MB, 624.57 MB, 623.80 MB, 624.05 MB, 623.84 MB, 624.04 MB, 623.39 MB, 623.61 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 637.30 MB (668261046) - PerHostPeakMemUsage: 1.34 GB (1442599544) - RowsProduced: 57 (57) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 25.686ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.50K (3496) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s182ms - TotalThreadsUserTime: 9s567ms - TotalThreadsVoluntaryContextSwitches: 63.27K (63274) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m41s - ExecTreeOpenTime: 10m40s - PrepareTime: 47.815ms - ExecTreePrepareTime: 684.436us DataStreamSender (dst_id=26):(Total: 555.182us, non-child: 555.182us, % non-child: 100.00%) - BytesSent: 12.03 KB (12314) - OverallThroughput: 21.15 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 57 (57) - SerializeBatchTime: 443.361us - UncompressedRowBatchSize: 12.03 KB (12314) CodeGen:(Total: 626.936ms, non-child: 626.936ms, % non-child: 100.00%) - CodegenTime: 16.418ms - CompileTime: 208.146ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 392.371ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.896ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 618.186ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 68.940us - GetResultsTime: 184.807us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 57 (57) - RowsReturnedRate: 0 - StreamingTime: 603.807ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.330ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.016ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.048us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 146.109us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 562.337us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 146.782us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s139ms, non-child: 91.137us, % non-child: 0.00%) - ConvertRowBatchTime: 69.579us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 796.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s139ms - DataArrivalTimer: 2s139ms SenderSide: - DeserializeRowBatchTimer: 202.443us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 28.725ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 723.376us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 150.883us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46.881us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 466.007us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.591us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 859.864ms, non-child: 18.462us, % non-child: 0.00%) - ConvertRowBatchTime: 7.697us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 318.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 859.850ms - DataArrivalTimer: 859.847ms SenderSide: - DeserializeRowBatchTimer: 80.710us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s766ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1417952) - BuildTime: 1s743ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 612.13 MB (641864351) - ProbeRows: 36.91M (36907550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s807ms - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s423ms - BuildRowsPartitioned: 1.42M (1417952) - GetNewBlockTime: 2.726ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.92K (2920) - HashTablesBuildTime: 307.273ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 612.06 MB (641792128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 196.037ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.339ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1417952) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 715.33 KB, 19.60 MB, 53.02 MB, 91.68 MB, 128.86 MB, 156.18 MB, 172.08 MB, 181.24 MB, 188.70 MB, 195.32 MB, 201.02 MB, 205.92 MB, 211.13 MB, 216.48 MB, 221.07 MB, 224.67 MB, 227.54 MB, 230.28 MB, 232.80 MB, 234.99 MB, 236.98 MB, 238.97 MB, 240.65 MB, 241.97 MB, 243.41 MB, 244.77 MB, 245.91 MB, 246.78 MB, 247.47 MB, 247.89 MB, 248.26 MB, 248.67 MB, 248.89 MB, 248.98 MB, 249.63 MB, 250.53 MB, 250.53 MB, 250.53 MB, 250.53 MB, 250.53 MB, 250.53 MB, 250.53 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 250.53 MB (262697237) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s962ms - NumBatchesAccepted: 12.72K (12723) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s433ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s062ms - PeakMemoryUsage: 0 - RowsReturned: 36.91M (36907550) - RowsReturnedRate: 305.82 K/sec RecvrSide: BytesReceived(16s000ms): 5.95 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.72 MB, 115.76 MB, 378.60 MB, 500.37 MB, 564.27 MB, 611.02 MB, 641.93 MB, 657.63 MB - FirstBatchArrivalWaitTime: 3s802ms - TotalBytesReceived: 662.34 MB (694513829) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s461ms - NumBatchesAccepted: 56.41K (56413) - NumBatchesRejected: 25 (25) Instance 5f429df048b5534b:41bcce1800000256 (host=foo.221.33:22000):(Total: 12m38s, non-child: 61.576ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.23 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 25.63 MB, 162.43 MB, 162.43 MB, 225.40 MB, 291.43 MB, 303.42 MB, 342.43 MB, 353.64 MB, 367.92 MB, 391.91 MB, 417.14 MB, 422.17 MB, 426.40 MB, 426.42 MB, 426.41 MB, 426.42 MB, 426.40 MB, 426.40 MB, 426.41 MB, 427.65 MB, 434.41 MB, 434.40 MB, 434.40 MB, 441.43 MB, 447.90 MB, 450.41 MB, 450.43 MB, 450.43 MB, 450.46 MB, 450.38 MB, 450.43 MB, 450.41 MB, 450.40 MB, 450.44 MB, 475.19 MB, 620.01 MB, 620.31 MB, 619.50 MB, 620.24 MB, 619.82 MB, 619.69 MB, 619.76 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 633.30 MB (664066742) - PerHostPeakMemUsage: 1.40 GB (1500362839) - RowsProduced: 35 (35) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 9.496ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.01K (4014) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s270ms - TotalThreadsUserTime: 9s554ms - TotalThreadsVoluntaryContextSwitches: 63.80K (63795) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 56.326ms - ExecTreePrepareTime: 625.845us DataStreamSender (dst_id=26):(Total: 390.169us, non-child: 390.169us, % non-child: 100.00%) - BytesSent: 7.22 KB (7394) - OverallThroughput: 18.07 MB/sec - PeakMemoryUsage: 200.66 KB (205472) - RowsReturned: 35 (35) - SerializeBatchTime: 279.839us - UncompressedRowBatchSize: 7.22 KB (7394) CodeGen:(Total: 686.484ms, non-child: 686.484ms, % non-child: 100.00%) - CodegenTime: 16.499ms - CompileTime: 210.293ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 442.995ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 32.675ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 654.230ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 70.264us - GetResultsTime: 93.268us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919240) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 35 (35) - RowsReturnedRate: 0 - StreamingTime: 640.015ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.823ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.243ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619336) - ProbeRows: 70 (70) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 116.317us - RowsReturned: 70 (70) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 214.677us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 653.538us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 254.733us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s643ms, non-child: 69.196us, % non-child: 0.00%) - ConvertRowBatchTime: 46.901us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 644.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s643ms - DataArrivalTimer: 2s643ms SenderSide: - DeserializeRowBatchTimer: 170.034us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.210ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 634.621us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563016) - ProbeRows: 70 (70) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.869us - RowsReturned: 70 (70) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.508us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 339.246us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.236us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 779.781ms, non-child: 16.579us, % non-child: 0.00%) - ConvertRowBatchTime: 7.391us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 351.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 779.768ms - DataArrivalTimer: 779.766ms SenderSide: - DeserializeRowBatchTimer: 87.041us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s747ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1433945) - BuildTime: 1s727ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 608.13 MB (637669632) - ProbeRows: 37.01M (37011824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s800ms - RowsReturned: 70 (70) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s432ms - BuildRowsPartitioned: 1.43M (1433945) - GetNewBlockTime: 2.778ms - HashBuckets: 3.01M (3014656) - HashCollisions: 4.12K (4117) - HashTablesBuildTime: 281.639ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 608.06 MB (637597824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 197.320ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.452ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1433945) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 771.82 KB, 20.28 MB, 54.50 MB, 94.21 MB, 132.24 MB, 159.71 MB, 175.84 MB, 185.13 MB, 192.39 MB, 198.86 MB, 204.50 MB, 209.39 MB, 214.58 MB, 219.92 MB, 224.45 MB, 228.03 MB, 230.87 MB, 233.51 MB, 235.96 MB, 238.07 MB, 240.01 MB, 241.78 MB, 243.22 MB, 244.66 MB, 245.88 MB, 247.15 MB, 248.23 MB, 249.12 MB, 249.74 MB, 250.08 MB, 250.48 MB, 250.91 MB, 251.17 MB, 251.26 MB, 251.78 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB, 252.64 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.64 MB (264912698) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s752ms - NumBatchesAccepted: 12.87K (12868) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s460ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s084ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37011824) - RowsReturnedRate: 312.00 K/sec RecvrSide: BytesReceived(16s000ms): 6.05 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.81 MB, 117.99 MB, 381.99 MB, 502.53 MB, 566.40 MB, 613.07 MB, 643.99 MB, 659.58 MB - FirstBatchArrivalWaitTime: 3s718ms - TotalBytesReceived: 664.24 MB (696506029) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s518ms - NumBatchesAccepted: 56.57K (56569) - NumBatchesRejected: 56 (56) Instance 5f429df048b5534b:41bcce1800000289 (host=foo.221.43:22000):(Total: 12m38s, non-child: 66.642ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.32 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.66 MB, 161.93 MB, 162.41 MB, 221.67 MB, 289.40 MB, 315.64 MB, 335.42 MB, 354.15 MB, 366.68 MB, 370.39 MB, 370.40 MB, 381.15 MB, 397.40 MB, 421.89 MB, 426.39 MB, 426.42 MB, 437.91 MB, 442.42 MB, 442.42 MB, 450.40 MB, 456.41 MB, 458.41 MB, 458.41 MB, 458.40 MB, 458.38 MB, 458.38 MB, 458.40 MB, 458.44 MB, 458.42 MB, 458.45 MB, 458.43 MB, 458.41 MB, 458.36 MB, 458.39 MB, 474.37 MB, 629.55 MB, 630.04 MB, 630.06 MB, 629.91 MB, 629.95 MB, 630.21 MB, 629.48 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.29 GB (1384844262) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 15.740ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.95K (3946) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s266ms - TotalThreadsUserTime: 9s590ms - TotalThreadsVoluntaryContextSwitches: 63.74K (63738) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 54.893ms - ExecTreePrepareTime: 659.530us DataStreamSender (dst_id=26):(Total: 496.139us, non-child: 496.139us, % non-child: 100.00%) - BytesSent: 9.64 KB (9874) - OverallThroughput: 18.98 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 48 (48) - SerializeBatchTime: 377.988us - UncompressedRowBatchSize: 9.64 KB (9874) CodeGen:(Total: 682.916ms, non-child: 682.916ms, % non-child: 100.00%) - CodegenTime: 16.532ms - CompileTime: 226.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 423.654ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 32.369ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 680.528ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 51.834us - GetResultsTime: 110.805us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919336) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 665.691ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.247ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 887.803us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623528) - ProbeRows: 712 (712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 443.354us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 173.148us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 447.009us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 154.966us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s601ms, non-child: 70.717us, % non-child: 0.00%) - ConvertRowBatchTime: 46.537us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 655.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s601ms - DataArrivalTimer: 2s601ms SenderSide: - DeserializeRowBatchTimer: 222.259us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.587ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 604.292us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567208) - ProbeRows: 712 (712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 572.099us - RowsReturned: 712 (712) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.406us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 378.016us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.586us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 745.800ms, non-child: 16.297us, % non-child: 0.00%) - ConvertRowBatchTime: 7.694us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 367.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 745.788ms - DataArrivalTimer: 745.785ms SenderSide: - DeserializeRowBatchTimer: 58.451us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s722ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1418362) - BuildTime: 1s783ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 36.99M (36990397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s716ms - RowsReturned: 712 (712) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s505ms - BuildRowsPartitioned: 1.42M (1418362) - GetNewBlockTime: 3.092ms - HashBuckets: 3.15M (3145728) - HashCollisions: 4.50K (4495) - HashTablesBuildTime: 266.703ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 209.507ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.070ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1418362) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 817.43 KB, 20.45 MB, 54.25 MB, 93.35 MB, 130.65 MB, 157.27 MB, 172.81 MB, 182.11 MB, 189.65 MB, 196.30 MB, 202.02 MB, 206.89 MB, 212.03 MB, 217.34 MB, 221.85 MB, 225.43 MB, 228.31 MB, 230.97 MB, 233.45 MB, 235.67 MB, 237.72 MB, 239.66 MB, 241.14 MB, 242.63 MB, 243.90 MB, 245.13 MB, 246.11 MB, 246.94 MB, 247.48 MB, 247.87 MB, 248.15 MB, 248.47 MB, 248.68 MB, 248.78 MB, 249.32 MB, 250.26 MB, 250.26 MB, 250.26 MB, 250.26 MB, 250.26 MB, 250.26 MB, 250.26 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 250.26 MB (262417601) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 2s028ms - NumBatchesAccepted: 12.73K (12731) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s428ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36990397) - RowsReturnedRate: 313.98 K/sec RecvrSide: BytesReceived(16s000ms): 6.10 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.80 MB, 118.39 MB, 382.36 MB, 502.41 MB, 566.18 MB, 612.83 MB, 643.68 MB, 659.23 MB - FirstBatchArrivalWaitTime: 3s686ms - TotalBytesReceived: 663.88 MB (696125677) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s258ms - NumBatchesAccepted: 56.54K (56541) - NumBatchesRejected: 80 (80) Instance 5f429df048b5534b:41bcce1800000219 (host=foo.221.34:22000):(Total: 12m38s, non-child: 107.446ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.44 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.12 MB, 162.41 MB, 162.42 MB, 214.92 MB, 290.42 MB, 290.67 MB, 313.15 MB, 339.15 MB, 374.41 MB, 405.39 MB, 413.15 MB, 418.41 MB, 418.40 MB, 418.42 MB, 418.41 MB, 418.40 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.42 MB, 418.43 MB, 420.91 MB, 426.40 MB, 426.42 MB, 426.42 MB, 429.16 MB, 434.43 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.41 MB, 434.41 MB, 434.44 MB, 434.33 MB, 485.88 MB, 605.68 MB, 605.86 MB, 605.88 MB, 605.98 MB, 606.05 MB, 606.04 MB, 605.55 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 619.30 MB (649386678) - PerHostPeakMemUsage: 1.40 GB (1500830944) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 40.180ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.63K (3627) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s253ms - TotalThreadsUserTime: 8s915ms - TotalThreadsVoluntaryContextSwitches: 64.85K (64853) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m41s - ExecTreeOpenTime: 10m40s - PrepareTime: 54.705ms - ExecTreePrepareTime: 1.163ms DataStreamSender (dst_id=26):(Total: 800.678us, non-child: 800.678us, % non-child: 100.00%) - BytesSent: 9.46 KB (9689) - OverallThroughput: 11.54 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 46 (46) - SerializeBatchTime: 660.776us - UncompressedRowBatchSize: 9.46 KB (9689) CodeGen:(Total: 641.673ms, non-child: 641.673ms, % non-child: 100.00%) - CodegenTime: 16.389ms - CompileTime: 216.361ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 394.403ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.321ms AGGREGATION_NODE (id=15):(Total: 12m38s, non-child: 715.358ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 106.155us - GetResultsTime: 118.600us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9915232) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 703.783ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.110ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.010ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619424) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 93.201us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 154.593us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 579.686us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 145.817us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s450ms, non-child: 87.401us, % non-child: 0.01%) - ConvertRowBatchTime: 67.345us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s450ms - DataArrivalTimer: 1s450ms SenderSide: - DeserializeRowBatchTimer: 198.153us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 26.300ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 535.184us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563104) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 108.939us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49.293us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 232.484us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.867us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 830.538ms, non-child: 24.096us, % non-child: 0.00%) - ConvertRowBatchTime: 10.825us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 329.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 830.519ms - DataArrivalTimer: 830.515ms SenderSide: - DeserializeRowBatchTimer: 46.520us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s310ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1406902) - BuildTime: 1s719ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 594.13 MB (622989568) - ProbeRows: 36.98M (36979571) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s382ms - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s435ms - BuildRowsPartitioned: 1.41M (1406902) - GetNewBlockTime: 3.050ms - HashBuckets: 3.15M (3145728) - HashCollisions: 4.78K (4783) - HashTablesBuildTime: 272.247ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 594.06 MB (622917760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 205.278ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.449ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1406902) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 756.44 KB, 19.43 MB, 52.24 MB, 90.51 MB, 127.39 MB, 154.03 MB, 169.48 MB, 178.76 MB, 186.28 MB, 193.00 MB, 198.81 MB, 203.83 MB, 209.09 MB, 214.49 MB, 219.09 MB, 222.77 MB, 225.68 MB, 228.35 MB, 230.88 MB, 233.12 MB, 235.16 MB, 237.13 MB, 238.73 MB, 240.17 MB, 241.57 MB, 242.94 MB, 243.94 MB, 244.68 MB, 245.32 MB, 245.71 MB, 246.13 MB, 246.37 MB, 246.54 MB, 246.62 MB, 247.16 MB, 248.06 MB, 248.06 MB, 248.06 MB, 248.06 MB, 248.06 MB, 248.06 MB, 248.06 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 248.06 MB (260110183) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s019ms - NumBatchesAccepted: 12.62K (12625) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s363ms, % non-child: 1.12%) - ConvertRowBatchTime: 1s013ms - PeakMemoryUsage: 0 - RowsReturned: 36.98M (36979571) - RowsReturnedRate: 304.59 K/sec RecvrSide: BytesReceived(16s000ms): 6.11 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.93 MB, 118.31 MB, 382.22 MB, 502.27 MB, 566.01 MB, 612.67 MB, 643.50 MB, 659.04 MB - FirstBatchArrivalWaitTime: 3s766ms - TotalBytesReceived: 663.68 MB (695918746) - TotalGetBatchTime: 2m - DataArrivalTimer: 2m SenderSide: - DeserializeRowBatchTimer: 3s961ms - NumBatchesAccepted: 56.52K (56525) - NumBatchesRejected: 30 (30) Instance 5f429df048b5534b:41bcce1800000279 (host=foo.221.37:22000):(Total: 12m38s, non-child: 74.435ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.48 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.38 MB, 162.43 MB, 162.41 MB, 233.65 MB, 290.41 MB, 303.16 MB, 341.43 MB, 380.92 MB, 395.42 MB, 415.93 MB, 418.40 MB, 418.42 MB, 418.40 MB, 418.41 MB, 418.40 MB, 418.40 MB, 425.14 MB, 426.41 MB, 430.67 MB, 434.43 MB, 434.41 MB, 445.41 MB, 450.41 MB, 450.41 MB, 450.41 MB, 450.42 MB, 450.42 MB, 450.43 MB, 450.43 MB, 450.44 MB, 450.41 MB, 455.43 MB, 458.36 MB, 458.41 MB, 479.08 MB, 635.07 MB, 636.39 MB, 636.10 MB, 636.28 MB, 636.27 MB, 635.89 MB, 635.95 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.30 MB (680843958) - PerHostPeakMemUsage: 1.23 GB (1323240864) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 16.556ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.85K (3855) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s165ms - TotalThreadsUserTime: 9s641ms - TotalThreadsVoluntaryContextSwitches: 64.87K (64868) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 52.062ms - ExecTreePrepareTime: 863.711us DataStreamSender (dst_id=26):(Total: 593.533us, non-child: 593.533us, % non-child: 100.00%) - BytesSent: 11.71 KB (11987) - OverallThroughput: 19.26 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 55 (55) - SerializeBatchTime: 468.780us - UncompressedRowBatchSize: 11.71 KB (11987) CodeGen:(Total: 687.979ms, non-child: 687.979ms, % non-child: 100.00%) - CodegenTime: 16.805ms - CompileTime: 226.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 431.737ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.634ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 697.768ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 51.291us - GetResultsTime: 218.067us - HTResizeTime: 615.569us - HashBuckets: 30.72K (30720) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.96 MB (15682984) - PinTime: 0.000ns - ReductionFactorEstimate: 2912344.83 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - StreamingTime: 685.268ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.323ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.105ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 14.42 MB (15125032) - ProbeRows: 2.13K (2127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 477.239us - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 158.493us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 661.623us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 163.177us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s011ms, non-child: 73.880us, % non-child: 0.00%) - ConvertRowBatchTime: 49.040us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 847.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s011ms - DataArrivalTimer: 2s011ms SenderSide: - DeserializeRowBatchTimer: 200.970us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 6.528ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 652.280us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565808) - ProbeRows: 2.13K (2127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 327.706us - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.037us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 425.485us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.510us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 749.375ms, non-child: 18.931us, % non-child: 0.00%) - ConvertRowBatchTime: 7.667us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 365.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 749.359ms - DataArrivalTimer: 749.356ms SenderSide: - DeserializeRowBatchTimer: 27.173us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s713ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1460294) - BuildTime: 1s749ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654447288) - ProbeRows: 37.12M (37115348) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s735ms - RowsReturned: 2.13K (2127) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s429ms - BuildRowsPartitioned: 1.46M (1460294) - GetNewBlockTime: 2.771ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.73K (4730) - HashTablesBuildTime: 308.059ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 195.743ms, % non-child: 0.03%) - ConvertRowBatchTime: 90.125ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1460294) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 840.08 KB, 20.98 MB, 55.95 MB, 96.31 MB, 135.06 MB, 162.48 MB, 178.59 MB, 188.20 MB, 196.00 MB, 202.83 MB, 208.72 MB, 213.78 MB, 219.18 MB, 224.76 MB, 229.41 MB, 233.15 MB, 236.11 MB, 238.78 MB, 241.35 MB, 243.64 MB, 245.73 MB, 247.74 MB, 249.41 MB, 250.78 MB, 252.23 MB, 253.59 MB, 254.78 MB, 255.59 MB, 256.29 MB, 256.68 MB, 257.00 MB, 257.36 MB, 257.53 MB, 257.58 MB, 258.08 MB, 259.03 MB, 259.03 MB, 259.03 MB, 259.03 MB, 259.03 MB, 259.03 MB, 259.03 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 259.03 MB (271616510) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s876ms - NumBatchesAccepted: 13.10K (13102) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s435ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s068ms - PeakMemoryUsage: 0 - RowsReturned: 37.12M (37115348) - RowsReturnedRate: 314.31 K/sec RecvrSide: BytesReceived(16s000ms): 6.13 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.82 MB, 118.78 MB, 383.66 MB, 504.07 MB, 568.07 MB, 614.87 MB, 645.81 MB, 661.40 MB - FirstBatchArrivalWaitTime: 3s669ms - TotalBytesReceived: 666.06 MB (698409445) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s485ms - NumBatchesAccepted: 56.73K (56734) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce1800000264 (host=foo.221.38:22000):(Total: 12m38s, non-child: 76.506ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.49 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 26.61 MB, 162.38 MB, 162.40 MB, 224.41 MB, 290.37 MB, 299.63 MB, 338.13 MB, 367.88 MB, 380.63 MB, 400.38 MB, 407.39 MB, 418.38 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.38 MB, 418.38 MB, 418.36 MB, 422.13 MB, 426.38 MB, 426.39 MB, 431.65 MB, 442.38 MB, 445.14 MB, 450.39 MB, 450.63 MB, 458.38 MB, 458.40 MB, 458.40 MB, 458.41 MB, 458.41 MB, 458.35 MB, 458.38 MB, 485.76 MB, 633.25 MB, 634.30 MB, 634.04 MB, 633.69 MB, 633.85 MB, 634.05 MB, 633.96 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.28 MB (678725191) - PerHostPeakMemUsage: 1.31 GB (1403689644) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 14.652ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.69K (3694) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s205ms - TotalThreadsUserTime: 9s576ms - TotalThreadsVoluntaryContextSwitches: 63.14K (63144) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m40s - ExecTreeOpenTime: 10m40s - PrepareTime: 53.724ms - ExecTreePrepareTime: 1.168ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 301 (301) - BlocksRecycled: 57 (57) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.04 GB (1116292096) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=26):(Total: 673.230us, non-child: 673.230us, % non-child: 100.00%) - BytesSent: 8.92 KB (9131) - OverallThroughput: 12.93 MB/sec - PeakMemoryUsage: 228.66 KB (234144) - RowsReturned: 40 (40) - SerializeBatchTime: 427.205us - UncompressedRowBatchSize: 8.92 KB (9131) CodeGen:(Total: 707.149ms, non-child: 707.149ms, % non-child: 100.00%) - CodegenTime: 19.117ms - CompileTime: 218.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 460.777ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.723ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 605.008ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.820us - GetResultsTime: 110.448us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9920707) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 593.611ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.941ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.474ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623028) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.932us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 173.258us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 863.046us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 223.203us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s666ms, non-child: 86.938us, % non-child: 0.00%) - ConvertRowBatchTime: 64.775us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 639.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s666ms - DataArrivalTimer: 2s666ms SenderSide: - DeserializeRowBatchTimer: 237.704us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 27.017ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 921.513us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566708) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.301us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62.668us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 583.031us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 90.013us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 822.833ms, non-child: 19.310us, % non-child: 0.00%) - ConvertRowBatchTime: 8.229us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 332.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 822.819ms - DataArrivalTimer: 822.815ms SenderSide: - DeserializeRowBatchTimer: 274.244us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s717ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1432732) - BuildTime: 1s805ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 37.02M (37020699) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s690ms - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s499ms - BuildRowsPartitioned: 1.43M (1432732) - GetNewBlockTime: 2.839ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.14K (4140) - HashTablesBuildTime: 291.688ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 210.791ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.133ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1432732) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 831.54 KB, 20.34 MB, 54.49 MB, 93.77 MB, 131.65 MB, 158.58 MB, 174.50 MB, 183.89 MB, 191.63 MB, 198.45 MB, 204.23 MB, 209.32 MB, 214.67 MB, 220.11 MB, 224.69 MB, 228.41 MB, 231.36 MB, 234.10 MB, 236.73 MB, 239.07 MB, 241.17 MB, 243.10 MB, 244.73 MB, 246.14 MB, 247.57 MB, 248.88 MB, 250.09 MB, 250.83 MB, 251.58 MB, 252.01 MB, 252.29 MB, 252.58 MB, 252.85 MB, 252.98 MB, 253.49 MB, 254.36 MB, 254.36 MB, 254.36 MB, 254.36 MB, 254.36 MB, 254.36 MB, 254.36 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 254.36 MB (266714320) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s950ms - NumBatchesAccepted: 12.86K (12857) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s434ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s066ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37020699) - RowsReturnedRate: 311.90 K/sec RecvrSide: BytesReceived(16s000ms): 6.14 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.90 MB, 119.31 MB, 383.68 MB, 503.17 MB, 566.98 MB, 613.53 MB, 644.32 MB, 659.79 MB - FirstBatchArrivalWaitTime: 3s659ms - TotalBytesReceived: 664.41 MB (696680186) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s118ms - NumBatchesAccepted: 56.59K (56585) - NumBatchesRejected: 57 (57) Instance 5f429df048b5534b:41bcce1800000239 (host=foo.221.36:22000):(Total: 12m38s, non-child: 83.292ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.61 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 28.62 MB, 162.39 MB, 162.38 MB, 237.40 MB, 290.38 MB, 303.40 MB, 347.62 MB, 384.66 MB, 402.39 MB, 415.38 MB, 418.42 MB, 418.39 MB, 418.38 MB, 418.39 MB, 418.40 MB, 418.39 MB, 418.40 MB, 426.39 MB, 433.90 MB, 434.40 MB, 435.14 MB, 442.40 MB, 442.63 MB, 456.38 MB, 458.37 MB, 458.39 MB, 463.89 MB, 466.41 MB, 466.40 MB, 466.39 MB, 466.41 MB, 466.40 MB, 466.40 MB, 466.37 MB, 508.70 MB, 655.62 MB, 655.44 MB, 656.16 MB, 655.76 MB, 655.75 MB, 656.15 MB, 655.84 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 669.28 MB (701793863) - PerHostPeakMemUsage: 1.36 GB (1456874272) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 18.971ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.61K (3610) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s246ms - TotalThreadsUserTime: 9s438ms - TotalThreadsVoluntaryContextSwitches: 64.48K (64480) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 63.072ms - ExecTreePrepareTime: 911.608us DataStreamSender (dst_id=26):(Total: 777.779us, non-child: 777.779us, % non-child: 100.00%) - BytesSent: 10.30 KB (10544) - OverallThroughput: 12.93 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 47 (47) - SerializeBatchTime: 572.784us - UncompressedRowBatchSize: 10.30 KB (10544) CodeGen:(Total: 688.207ms, non-child: 688.207ms, % non-child: 100.00%) - CodegenTime: 16.063ms - CompileTime: 223.630ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 427.410ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 35.526ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 652.356ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 46.757us - GetResultsTime: 163.492us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9914990) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 636.486ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.168ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 954.112us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 143.486us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 163.602us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 364.107us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.828us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s114ms, non-child: 79.531us, % non-child: 0.01%) - ConvertRowBatchTime: 57.990us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.53 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s114ms - DataArrivalTimer: 1s114ms SenderSide: - DeserializeRowBatchTimer: 212.160us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 5.705ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 693.567us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.250us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 58.281us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 317.433us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 118.887us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 873.246ms, non-child: 17.207us, % non-child: 0.00%) - ConvertRowBatchTime: 7.949us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 313.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 873.232ms - DataArrivalTimer: 873.229ms SenderSide: - DeserializeRowBatchTimer: 56.049us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s697ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1472191) - BuildTime: 1s781ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 644.13 MB (675418368) - ProbeRows: 37.02M (37017772) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s691ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s438ms - BuildRowsPartitioned: 1.47M (1472191) - GetNewBlockTime: 2.746ms - HashBuckets: 3.80M (3801088) - HashCollisions: 4.79K (4795) - HashTablesBuildTime: 330.610ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 644.06 MB (675346560) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 202.913ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.857ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1472191) - RowsReturnedRate: 2.32 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 938.53 KB, 21.44 MB, 56.95 MB, 97.73 MB, 136.10 MB, 163.30 MB, 179.46 MB, 189.30 MB, 197.26 MB, 204.27 MB, 210.36 MB, 215.61 MB, 221.03 MB, 226.69 MB, 231.56 MB, 235.36 MB, 238.33 MB, 241.13 MB, 243.84 MB, 246.17 MB, 248.25 MB, 250.30 MB, 252.00 MB, 253.31 MB, 254.82 MB, 256.02 MB, 257.21 MB, 257.82 MB, 258.34 MB, 258.86 MB, 259.27 MB, 259.57 MB, 259.75 MB, 259.82 MB, 260.38 MB, 261.22 MB, 261.22 MB, 261.22 MB, 261.22 MB, 261.22 MB, 261.22 MB, 261.22 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 261.22 MB (273908895) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s888ms - NumBatchesAccepted: 13.21K (13210) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s441ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s073ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37017772) - RowsReturnedRate: 309.68 K/sec RecvrSide: BytesReceived(16s000ms): 6.21 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.18 MB, 120.74 MB, 385.27 MB, 503.55 MB, 567.28 MB, 613.71 MB, 644.48 MB, 659.79 MB - FirstBatchArrivalWaitTime: 3s707ms - TotalBytesReceived: 664.36 MB (696632856) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s463ms - NumBatchesAccepted: 56.58K (56576) - NumBatchesRejected: 48 (48) Instance 5f429df048b5534b:41bcce180000025e (host=foo.221.42:22000):(Total: 12m38s, non-child: 64.028ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.61 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.64 MB, 162.42 MB, 162.46 MB, 228.90 MB, 290.44 MB, 302.17 MB, 344.67 MB, 374.43 MB, 386.93 MB, 400.67 MB, 407.42 MB, 418.41 MB, 418.40 MB, 418.40 MB, 418.41 MB, 419.19 MB, 426.40 MB, 426.39 MB, 426.43 MB, 426.39 MB, 426.41 MB, 426.40 MB, 432.17 MB, 438.92 MB, 442.38 MB, 442.41 MB, 442.41 MB, 442.40 MB, 442.43 MB, 442.41 MB, 442.42 MB, 442.42 MB, 442.35 MB, 442.36 MB, 470.65 MB, 621.91 MB, 621.15 MB, 622.00 MB, 621.71 MB, 621.84 MB, 622.02 MB, 622.31 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 635.30 MB (666163894) - PerHostPeakMemUsage: 1.43 GB (1539857554) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 11.361ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.58K (3584) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s203ms - TotalThreadsUserTime: 9s268ms - TotalThreadsVoluntaryContextSwitches: 64.89K (64890) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 47.909ms - ExecTreePrepareTime: 623.942us DataStreamSender (dst_id=26):(Total: 331.138us, non-child: 331.138us, % non-child: 100.00%) - BytesSent: 8.82 KB (9033) - OverallThroughput: 26.01 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 41 (41) - SerializeBatchTime: 247.372us - UncompressedRowBatchSize: 8.82 KB (9033) CodeGen:(Total: 699.561ms, non-child: 699.561ms, % non-child: 100.00%) - CodegenTime: 17.416ms - CompileTime: 226.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 448.419ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.066ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 670.958ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.742us - GetResultsTime: 101.184us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919390) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - StreamingTime: 659.051ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.763ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.068ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619486) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 105.103us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 139.812us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 585.792us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.579us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s373ms, non-child: 59.840us, % non-child: 0.00%) - ConvertRowBatchTime: 41.186us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.24 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s373ms - DataArrivalTimer: 1s373ms SenderSide: - DeserializeRowBatchTimer: 122.652us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 9.774ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 631.602us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563166) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.292us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.703us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 347.232us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.741us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 753.433ms, non-child: 12.633us, % non-child: 0.00%) - ConvertRowBatchTime: 5.258us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 363.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 753.423ms - DataArrivalTimer: 753.421ms SenderSide: - DeserializeRowBatchTimer: 28.137us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s551ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1442516) - BuildTime: 1s750ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 610.13 MB (639766784) - ProbeRows: 37.06M (37060494) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s581ms - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s426ms - BuildRowsPartitioned: 1.44M (1442516) - GetNewBlockTime: 3.362ms - HashBuckets: 3.67M (3670016) - HashCollisions: 1.93K (1929) - HashTablesBuildTime: 313.266ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 610.06 MB (639694976) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 201.099ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.781ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1442516) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 852.94 KB, 20.59 MB, 55.05 MB, 95.23 MB, 133.36 MB, 160.40 MB, 176.44 MB, 186.07 MB, 193.82 MB, 200.57 MB, 206.37 MB, 211.45 MB, 216.80 MB, 222.34 MB, 227.10 MB, 230.76 MB, 233.72 MB, 236.40 MB, 238.90 MB, 241.06 MB, 243.02 MB, 244.96 MB, 246.49 MB, 247.86 MB, 249.23 MB, 250.50 MB, 251.63 MB, 252.35 MB, 252.97 MB, 253.28 MB, 253.72 MB, 254.04 MB, 254.19 MB, 254.24 MB, 254.76 MB, 255.68 MB, 255.68 MB, 255.68 MB, 255.68 MB, 255.68 MB, 255.68 MB, 255.68 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.68 MB (268102922) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s984ms - NumBatchesAccepted: 12.94K (12938) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s400ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37060494) - RowsReturnedRate: 312.07 K/sec RecvrSide: BytesReceived(16s000ms): 6.20 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.14 MB, 120.55 MB, 385.22 MB, 503.85 MB, 567.68 MB, 614.22 MB, 645.03 MB, 660.40 MB - FirstBatchArrivalWaitTime: 3s677ms - TotalBytesReceived: 665.01 MB (697317831) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s522ms - NumBatchesAccepted: 56.64K (56643) - NumBatchesRejected: 75 (75) Instance 5f429df048b5534b:41bcce1800000254 (host=foo.221.41:22000):(Total: 12m38s, non-child: 63.673ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.27 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 25.37 MB, 161.92 MB, 162.64 MB, 221.65 MB, 292.63 MB, 310.63 MB, 324.15 MB, 334.15 MB, 362.14 MB, 398.91 MB, 405.88 MB, 418.65 MB, 426.41 MB, 429.90 MB, 434.39 MB, 434.38 MB, 434.38 MB, 434.37 MB, 434.39 MB, 434.39 MB, 442.42 MB, 442.39 MB, 442.38 MB, 442.39 MB, 442.39 MB, 442.37 MB, 442.39 MB, 442.40 MB, 442.40 MB, 442.42 MB, 442.37 MB, 442.38 MB, 442.38 MB, 442.40 MB, 468.22 MB, 612.12 MB, 612.03 MB, 611.80 MB, 612.10 MB, 612.09 MB, 611.54 MB, 611.29 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 625.28 MB (655656519) - PerHostPeakMemUsage: 1.43 GB (1531852975) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 11.588ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.51K (3514) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s164ms - TotalThreadsUserTime: 9s040ms - TotalThreadsVoluntaryContextSwitches: 63.85K (63851) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 52.584ms - ExecTreePrepareTime: 669.313us DataStreamSender (dst_id=26):(Total: 513.804us, non-child: 513.804us, % non-child: 100.00%) - BytesSent: 9.75 KB (9985) - OverallThroughput: 18.53 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 46 (46) - SerializeBatchTime: 396.911us - UncompressedRowBatchSize: 9.75 KB (9985) CodeGen:(Total: 704.921ms, non-child: 704.921ms, % non-child: 100.00%) - CodegenTime: 17.685ms - CompileTime: 212.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 463.358ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.428ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 648.265ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 57.982us - GetResultsTime: 116.681us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 9 (9) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9910894) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 633.452ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.038ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 843.912us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 110.999us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 130.134us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 426.865us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.244us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s348ms, non-child: 98.606us, % non-child: 0.01%) - ConvertRowBatchTime: 65.933us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.26 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s347ms - DataArrivalTimer: 1s347ms SenderSide: - DeserializeRowBatchTimer: 172.683us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.093ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 643.054us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.151us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53.627us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 356.230us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.121us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 723.267ms, non-child: 23.541us, % non-child: 0.00%) - ConvertRowBatchTime: 13.177us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 378.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 723.247ms - DataArrivalTimer: 723.244ms SenderSide: - DeserializeRowBatchTimer: 218.057us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s351ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1426434) - BuildTime: 1s686ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 600.13 MB (629281024) - ProbeRows: 36.92M (36920360) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s452ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s424ms - BuildRowsPartitioned: 1.43M (1426434) - GetNewBlockTime: 3.356ms - HashBuckets: 3.01M (3014656) - HashCollisions: 3.87K (3867) - HashTablesBuildTime: 250.891ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 600.06 MB (629209216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 200.204ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.191ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1426434) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 794.74 KB, 20.28 MB, 54.23 MB, 93.52 MB, 131.52 MB, 158.61 MB, 174.33 MB, 183.68 MB, 191.23 MB, 197.89 MB, 203.52 MB, 208.44 MB, 213.57 MB, 218.88 MB, 223.32 MB, 226.93 MB, 229.82 MB, 232.53 MB, 235.06 MB, 237.31 MB, 239.42 MB, 241.37 MB, 243.00 MB, 244.26 MB, 245.79 MB, 246.99 MB, 248.19 MB, 248.94 MB, 249.48 MB, 249.95 MB, 250.26 MB, 250.57 MB, 250.83 MB, 250.93 MB, 251.56 MB, 252.49 MB, 252.49 MB, 252.49 MB, 252.49 MB, 252.49 MB, 252.49 MB, 252.49 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.49 MB (264755245) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s960ms - NumBatchesAccepted: 12.80K (12804) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s387ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s026ms - PeakMemoryUsage: 0 - RowsReturned: 36.92M (36920360) - RowsReturnedRate: 310.27 K/sec RecvrSide: BytesReceived(16s000ms): 6.07 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.79 MB, 117.71 MB, 381.10 MB, 501.37 MB, 565.11 MB, 611.71 MB, 642.51 MB, 658.04 MB - FirstBatchArrivalWaitTime: 3s660ms - TotalBytesReceived: 662.69 MB (694880663) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s138ms - NumBatchesAccepted: 56.43K (56431) - NumBatchesRejected: 49 (49) Instance 5f429df048b5534b:41bcce1800000227 (host=foo.221.40:22000):(Total: 12m38s, non-child: 97.037ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.44 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 24.37 MB, 161.38 MB, 162.40 MB, 217.16 MB, 289.64 MB, 297.38 MB, 331.14 MB, 358.64 MB, 371.65 MB, 383.88 MB, 394.38 MB, 394.38 MB, 399.64 MB, 405.39 MB, 417.65 MB, 418.39 MB, 418.39 MB, 418.40 MB, 421.41 MB, 426.39 MB, 426.38 MB, 426.40 MB, 426.38 MB, 430.39 MB, 442.39 MB, 442.39 MB, 444.64 MB, 450.39 MB, 450.40 MB, 450.42 MB, 450.41 MB, 450.44 MB, 450.43 MB, 450.42 MB, 505.49 MB, 631.79 MB, 632.63 MB, 632.19 MB, 631.93 MB, 631.87 MB, 632.17 MB, 632.16 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.28 MB (676628039) - PerHostPeakMemUsage: 1.23 GB (1324343334) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 31.965ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.00K (3997) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s185ms - TotalThreadsUserTime: 9s571ms - TotalThreadsVoluntaryContextSwitches: 63.05K (63047) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m40s - ExecTreeOpenTime: 10m40s - PrepareTime: 45.743ms - ExecTreePrepareTime: 698.376us DataStreamSender (dst_id=26):(Total: 645.967us, non-child: 645.967us, % non-child: 100.00%) - BytesSent: 9.64 KB (9875) - OverallThroughput: 14.58 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 47 (47) - SerializeBatchTime: 514.419us - UncompressedRowBatchSize: 9.64 KB (9875) CodeGen:(Total: 657.357ms, non-child: 657.357ms, % non-child: 100.00%) - CodegenTime: 15.906ms - CompileTime: 219.534ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 412.604ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.724ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 626.916ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 270.921us - GetResultsTime: 173.496us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9915015) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 610.672ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.969ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.704ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622324) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 151.266us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 267.374us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.030ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 250.116us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s408ms, non-child: 87.611us, % non-child: 0.01%) - ConvertRowBatchTime: 54.459us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.21 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s408ms - DataArrivalTimer: 1s408ms SenderSide: - DeserializeRowBatchTimer: 163.074us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 24.542ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 939.246us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566004) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 154.360us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.920us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 697.491us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.368us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 776.135ms, non-child: 22.366us, % non-child: 0.00%) - ConvertRowBatchTime: 9.987us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 353.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 776.116ms - DataArrivalTimer: 776.113ms SenderSide: - DeserializeRowBatchTimer: 27.750us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s684ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1401260) - BuildTime: 1s675ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252884) - ProbeRows: 37.06M (37057363) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s777ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s346ms - BuildRowsPartitioned: 1.40M (1401260) - GetNewBlockTime: 2.902ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.81K (3808) - HashTablesBuildTime: 316.812ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 192.922ms, % non-child: 0.03%) - ConvertRowBatchTime: 87.118ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1401260) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 758.11 KB, 19.76 MB, 53.06 MB, 91.60 MB, 128.74 MB, 155.32 MB, 171.05 MB, 180.26 MB, 187.66 MB, 194.09 MB, 199.63 MB, 204.47 MB, 209.52 MB, 214.78 MB, 219.31 MB, 222.86 MB, 225.68 MB, 228.27 MB, 230.82 MB, 233.04 MB, 235.08 MB, 236.98 MB, 238.52 MB, 239.94 MB, 241.26 MB, 242.45 MB, 243.54 MB, 244.27 MB, 244.83 MB, 245.28 MB, 245.63 MB, 246.02 MB, 246.11 MB, 246.22 MB, 246.79 MB, 247.69 MB, 247.69 MB, 247.69 MB, 247.69 MB, 247.69 MB, 247.69 MB, 247.69 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 247.69 MB (259721031) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s843ms - NumBatchesAccepted: 12.58K (12579) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s458ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s080ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37057363) - RowsReturnedRate: 307.32 K/sec RecvrSide: BytesReceived(16s000ms): 6.11 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.91 MB, 118.59 MB, 383.00 MB, 503.31 MB, 567.20 MB, 613.94 MB, 644.85 MB, 660.41 MB - FirstBatchArrivalWaitTime: 3s711ms - TotalBytesReceived: 665.05 MB (697355539) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s423ms - NumBatchesAccepted: 56.64K (56641) - NumBatchesRejected: 43 (43) Instance 5f429df048b5534b:41bcce1800000216 (host=foo.221.39:22000):(Total: 12m38s, non-child: 117.329ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.57 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.13 MB, 161.67 MB, 162.42 MB, 218.92 MB, 289.15 MB, 296.92 MB, 329.93 MB, 362.67 MB, 376.92 MB, 395.17 MB, 410.40 MB, 410.40 MB, 410.41 MB, 410.41 MB, 410.41 MB, 416.16 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.43 MB, 418.40 MB, 418.43 MB, 418.41 MB, 418.43 MB, 420.16 MB, 426.42 MB, 426.38 MB, 426.37 MB, 426.42 MB, 426.89 MB, 436.92 MB, 442.41 MB, 442.41 MB, 442.37 MB, 498.69 MB, 619.58 MB, 619.42 MB, 619.93 MB, 619.87 MB, 619.96 MB, 620.11 MB, 619.89 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 633.30 MB (664066742) - PerHostPeakMemUsage: 1.37 GB (1474043505) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 40.014ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.77K (3772) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s233ms - TotalThreadsUserTime: 8s773ms - TotalThreadsVoluntaryContextSwitches: 64.35K (64353) Fragment Instance Lifecycle Timings: - ExecTime: 2m3s - ExecTreeExecTime: 2m3s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 58.563ms - ExecTreePrepareTime: 592.286us DataStreamSender (dst_id=26):(Total: 728.480us, non-child: 728.480us, % non-child: 100.00%) - BytesSent: 11.15 KB (11418) - OverallThroughput: 14.95 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 51 (51) - SerializeBatchTime: 604.956us - UncompressedRowBatchSize: 11.15 KB (11418) CodeGen:(Total: 632.290ms, non-child: 632.290ms, % non-child: 100.00%) - CodegenTime: 16.216ms - CompileTime: 202.978ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 398.513ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.062ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 667.148ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 57.906us - GetResultsTime: 169.662us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9926753) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 653.071ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.078ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 820.029us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622753) - ProbeRows: 718 (718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 350.259us - RowsReturned: 716 (716) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 197.311us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 350.513us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 208.398us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s050ms, non-child: 69.368us, % non-child: 0.00%) - ConvertRowBatchTime: 48.765us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 831.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s050ms - DataArrivalTimer: 2s050ms SenderSide: - DeserializeRowBatchTimer: 125.544us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.357ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 531.303us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566433) - ProbeRows: 718 (718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 525.785us - RowsReturned: 718 (718) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 68.691us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 256.136us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.844us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 789.807ms, non-child: 17.028us, % non-child: 0.00%) - ConvertRowBatchTime: 7.875us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 346.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 789.794ms - DataArrivalTimer: 789.791ms SenderSide: - DeserializeRowBatchTimer: 66.807us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s138ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1403414) - BuildTime: 1s733ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 608.13 MB (637670072) - ProbeRows: 37.04M (37035632) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s204ms - RowsReturned: 718 (718) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s471ms - BuildRowsPartitioned: 1.40M (1403414) - GetNewBlockTime: 3.356ms - HashBuckets: 3.54M (3538944) - HashCollisions: 2.57K (2566) - HashTablesBuildTime: 251.215ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 608.06 MB (637597824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 203.701ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.980ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1403414) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 842.88 KB, 20.17 MB, 53.46 MB, 91.97 MB, 128.65 MB, 155.22 MB, 171.42 MB, 181.00 MB, 188.60 MB, 195.21 MB, 200.87 MB, 205.81 MB, 211.05 MB, 216.41 MB, 221.02 MB, 224.58 MB, 227.42 MB, 230.10 MB, 232.63 MB, 234.84 MB, 236.76 MB, 238.55 MB, 239.98 MB, 241.24 MB, 242.46 MB, 243.63 MB, 244.66 MB, 245.43 MB, 246.12 MB, 246.55 MB, 246.99 MB, 247.40 MB, 247.59 MB, 247.64 MB, 248.17 MB, 249.04 MB, 249.04 MB, 249.04 MB, 249.04 MB, 249.04 MB, 249.04 MB, 249.04 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 249.04 MB (261140390) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s778ms - NumBatchesAccepted: 12.59K (12594) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s354ms, % non-child: 1.11%) - ConvertRowBatchTime: 1s004ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37035632) - RowsReturnedRate: 303.85 K/sec RecvrSide: BytesReceived(16s000ms): 6.18 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.17 MB, 120.30 MB, 384.82 MB, 503.52 MB, 567.32 MB, 613.81 MB, 644.61 MB, 659.98 MB - FirstBatchArrivalWaitTime: 3s732ms - TotalBytesReceived: 664.58 MB (696861377) - TotalGetBatchTime: 2m - DataArrivalTimer: 2m SenderSide: - DeserializeRowBatchTimer: 4s009ms - NumBatchesAccepted: 56.61K (56610) - NumBatchesRejected: 27 (27) Instance 5f429df048b5534b:41bcce1800000281 (host=foo.221.45:22000):(Total: 12m38s, non-child: 85.138ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.83 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.88 MB, 162.43 MB, 162.42 MB, 220.42 MB, 290.41 MB, 299.14 MB, 328.17 MB, 337.40 MB, 354.92 MB, 397.13 MB, 410.40 MB, 414.66 MB, 418.43 MB, 418.42 MB, 418.43 MB, 418.43 MB, 418.40 MB, 418.42 MB, 418.41 MB, 418.43 MB, 426.41 MB, 437.17 MB, 442.41 MB, 442.42 MB, 445.92 MB, 450.38 MB, 450.43 MB, 450.41 MB, 450.42 MB, 450.44 MB, 450.42 MB, 450.41 MB, 450.44 MB, 450.49 MB, 470.80 MB, 620.99 MB, 620.11 MB, 621.02 MB, 620.30 MB, 620.50 MB, 620.22 MB, 619.85 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 633.30 MB (664066742) - PerHostPeakMemUsage: 1.22 GB (1309290671) - RowsProduced: 58 (58) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 17.370ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3835) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s218ms - TotalThreadsUserTime: 9s468ms - TotalThreadsVoluntaryContextSwitches: 63.64K (63638) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 61.486ms - ExecTreePrepareTime: 1.073ms DataStreamSender (dst_id=26):(Total: 809.173us, non-child: 809.173us, % non-child: 100.00%) - BytesSent: 12.08 KB (12368) - OverallThroughput: 14.58 MB/sec - PeakMemoryUsage: 276.66 KB (283296) - RowsReturned: 58 (58) - SerializeBatchTime: 541.229us - UncompressedRowBatchSize: 12.08 KB (12368) CodeGen:(Total: 738.109ms, non-child: 738.109ms, % non-child: 100.00%) - CodegenTime: 30.564ms - CompileTime: 242.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 464.422ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.573ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 646.236ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 103.234us - GetResultsTime: 241.345us - HTResizeTime: 609.491us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.71 MB (18566576) - PinTime: 0.000ns - ReductionFactorEstimate: 2146470.56 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 58 (58) - RowsReturnedRate: 0 - StreamingTime: 632.020ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.830ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.004ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 17.17 MB (18004528) - ProbeRows: 2.13K (2134) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 492.286us - RowsReturned: 2.13K (2134) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 164.622us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 454.644us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 213.326us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s245ms, non-child: 90.211us, % non-child: 0.01%) - ConvertRowBatchTime: 58.016us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.37 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s245ms - DataArrivalTimer: 1s245ms SenderSide: - DeserializeRowBatchTimer: 138.887us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 7.704ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 647.816us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 2.13K (2134) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 341.508us - RowsReturned: 2.13K (2134) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.360us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 382.522us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.758us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 626.259ms, non-child: 24.206us, % non-child: 0.00%) - ConvertRowBatchTime: 13.825us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 437.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 626.238ms - DataArrivalTimer: 626.235ms SenderSide: - DeserializeRowBatchTimer: 67.676us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s604ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1400931) - BuildTime: 1s706ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 608.13 MB (637669722) - ProbeRows: 36.99M (36989767) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s675ms - RowsReturned: 2.13K (2134) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s429ms - BuildRowsPartitioned: 1.40M (1400931) - GetNewBlockTime: 2.866ms - HashBuckets: 3.01M (3014656) - HashCollisions: 4.18K (4185) - HashTablesBuildTime: 264.915ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 608.06 MB (637597824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 201.968ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.722ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1400931) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 936.37 KB, 20.43 MB, 53.93 MB, 92.60 MB, 129.12 MB, 155.44 MB, 170.95 MB, 180.19 MB, 187.78 MB, 194.55 MB, 200.37 MB, 205.47 MB, 210.82 MB, 216.28 MB, 220.99 MB, 224.60 MB, 227.44 MB, 230.06 MB, 232.50 MB, 234.71 MB, 236.73 MB, 238.66 MB, 240.18 MB, 241.57 MB, 242.84 MB, 244.11 MB, 245.06 MB, 245.82 MB, 246.45 MB, 246.89 MB, 247.17 MB, 247.47 MB, 247.73 MB, 247.79 MB, 248.30 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 249.20 MB (261307969) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s790ms - NumBatchesAccepted: 12.57K (12573) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s424ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s061ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36989767) - RowsReturnedRate: 314.12 K/sec RecvrSide: BytesReceived(16s000ms): 6.33 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.25 MB, 122.88 MB, 387.61 MB, 503.90 MB, 567.34 MB, 613.51 MB, 644.12 MB, 659.20 MB - FirstBatchArrivalWaitTime: 3s554ms - TotalBytesReceived: 663.70 MB (695944432) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s380ms - NumBatchesAccepted: 56.54K (56539) - NumBatchesRejected: 92 (92) Instance 5f429df048b5534b:41bcce1800000274 (host=foo.232.12:22000):(Total: 12m38s, non-child: 152.430ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.83 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 28.30 MB, 162.42 MB, 162.41 MB, 223.42 MB, 290.44 MB, 309.15 MB, 341.90 MB, 351.16 MB, 364.90 MB, 375.41 MB, 391.63 MB, 407.90 MB, 416.92 MB, 418.37 MB, 426.42 MB, 430.41 MB, 440.15 MB, 450.42 MB, 450.42 MB, 450.43 MB, 450.41 MB, 453.17 MB, 458.41 MB, 458.40 MB, 459.65 MB, 466.43 MB, 466.42 MB, 466.44 MB, 466.41 MB, 466.45 MB, 466.43 MB, 466.39 MB, 466.36 MB, 466.40 MB, 490.54 MB, 636.91 MB, 635.92 MB, 636.25 MB, 636.01 MB, 635.65 MB, 635.82 MB, 635.67 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.30 MB (680843958) - PerHostPeakMemUsage: 1.39 GB (1491728620) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m37s - TotalNetworkSendTime: 12.736ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.64K (3638) - TotalThreadsTotalWallClockTime: 23m20s - TotalThreadsSysTime: 1s213ms - TotalThreadsUserTime: 8s987ms - TotalThreadsVoluntaryContextSwitches: 64.33K (64328) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 51.065ms - ExecTreePrepareTime: 767.446us DataStreamSender (dst_id=26):(Total: 534.708us, non-child: 534.708us, % non-child: 100.00%) - BytesSent: 8.42 KB (8618) - OverallThroughput: 15.37 MB/sec - PeakMemoryUsage: 208.66 KB (213664) - RowsReturned: 39 (39) - SerializeBatchTime: 351.689us - UncompressedRowBatchSize: 8.42 KB (8618) CodeGen:(Total: 651.644ms, non-child: 651.644ms, % non-child: 100.00%) - CodegenTime: 16.025ms - CompileTime: 211.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 410.911ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.352ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 641.447ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.408us - GetResultsTime: 104.841us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919290) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - StreamingTime: 629.674ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.729ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 981.644us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619386) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 83.507us - RowsReturned: 78 (78) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 149.358us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 553.315us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.791us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s039ms, non-child: 68.231us, % non-child: 0.00%) - ConvertRowBatchTime: 46.727us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 560.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s039ms - DataArrivalTimer: 3s039ms SenderSide: - DeserializeRowBatchTimer: 189.262us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 5.450ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 670.744us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563066) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 98.174us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57.673us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 337.950us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.778us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 739.381ms, non-child: 17.998us, % non-child: 0.00%) - ConvertRowBatchTime: 7.791us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 370.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 739.367ms - DataArrivalTimer: 739.364ms SenderSide: - DeserializeRowBatchTimer: 58.688us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s298ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1440106) - BuildTime: 1s760ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654446848) - ProbeRows: 37.00M (36997603) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s328ms - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s481ms - BuildRowsPartitioned: 1.44M (1440106) - GetNewBlockTime: 3.143ms - HashBuckets: 3.01M (3014656) - HashCollisions: 3.17K (3168) - HashTablesBuildTime: 268.526ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 208.333ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.074ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1440106) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 958.98 KB, 20.77 MB, 54.71 MB, 93.74 MB, 130.74 MB, 157.76 MB, 174.14 MB, 183.72 MB, 191.55 MB, 198.45 MB, 204.46 MB, 209.69 MB, 215.17 MB, 220.79 MB, 225.62 MB, 229.38 MB, 232.37 MB, 235.18 MB, 237.77 MB, 240.01 MB, 242.06 MB, 244.00 MB, 245.52 MB, 246.93 MB, 248.22 MB, 249.56 MB, 250.70 MB, 251.55 MB, 252.14 MB, 252.73 MB, 253.10 MB, 253.45 MB, 253.73 MB, 253.83 MB, 254.36 MB, 255.17 MB, 255.17 MB, 255.17 MB, 255.17 MB, 255.17 MB, 255.17 MB, 255.17 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.17 MB (267563407) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s981ms - NumBatchesAccepted: 12.93K (12925) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s367ms, % non-child: 1.15%) - ConvertRowBatchTime: 1s011ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (36997603) - RowsReturnedRate: 312.05 K/sec RecvrSide: BytesReceived(16s000ms): 6.33 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.32 MB, 123.23 MB, 388.05 MB, 504.18 MB, 567.67 MB, 613.80 MB, 644.39 MB, 659.45 MB - FirstBatchArrivalWaitTime: 3s598ms - TotalBytesReceived: 663.94 MB (696194089) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s045ms - NumBatchesAccepted: 56.55K (56550) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce180000027f (host=foo.221.47:22000):(Total: 12m38s, non-child: 76.776ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.57 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.11 MB, 161.92 MB, 162.39 MB, 228.67 MB, 288.92 MB, 306.17 MB, 346.66 MB, 373.39 MB, 394.40 MB, 402.40 MB, 407.67 MB, 410.43 MB, 410.43 MB, 416.92 MB, 420.15 MB, 426.41 MB, 426.44 MB, 426.40 MB, 426.41 MB, 434.43 MB, 442.40 MB, 442.40 MB, 442.89 MB, 457.40 MB, 458.44 MB, 458.40 MB, 458.40 MB, 464.39 MB, 466.42 MB, 466.42 MB, 466.45 MB, 466.39 MB, 466.38 MB, 466.44 MB, 483.09 MB, 643.54 MB, 643.97 MB, 643.44 MB, 644.15 MB, 644.08 MB, 643.94 MB, 643.39 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 657.30 MB (689232566) - PerHostPeakMemUsage: 1.42 GB (1520540796) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 17.411ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.34K (3340) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s277ms - TotalThreadsUserTime: 9s251ms - TotalThreadsVoluntaryContextSwitches: 64.49K (64488) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 49.599ms - ExecTreePrepareTime: 658.461us DataStreamSender (dst_id=26):(Total: 536.080us, non-child: 536.080us, % non-child: 100.00%) - BytesSent: 10.47 KB (10723) - OverallThroughput: 19.08 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 48 (48) - SerializeBatchTime: 365.873us - UncompressedRowBatchSize: 10.47 KB (10723) CodeGen:(Total: 671.399ms, non-child: 671.399ms, % non-child: 100.00%) - CodegenTime: 17.539ms - CompileTime: 199.232ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 445.104ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.463ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 694.693ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 51.267us - GetResultsTime: 210.246us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 682.078ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.856ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 933.532us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622353) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 113.200us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 142.843us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 531.050us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 142.597us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s184ms, non-child: 71.535us, % non-child: 0.00%) - ConvertRowBatchTime: 43.430us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 780.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s184ms - DataArrivalTimer: 2s184ms SenderSide: - DeserializeRowBatchTimer: 179.468us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 4.938ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 577.897us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566033) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.078us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.420us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 337.217us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.435us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 683.069ms, non-child: 18.947us, % non-child: 0.00%) - ConvertRowBatchTime: 7.515us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 401.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 683.054ms - DataArrivalTimer: 683.051ms SenderSide: - DeserializeRowBatchTimer: 88.651us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s640ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1471836) - BuildTime: 1s826ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 632.13 MB (662835456) - ProbeRows: 36.96M (36960695) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s599ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s521ms - BuildRowsPartitioned: 1.47M (1471836) - GetNewBlockTime: 3.673ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.72K (4722) - HashTablesBuildTime: 292.817ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 632.06 MB (662763648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 211.778ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.796ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1471836) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 865.42 KB, 20.88 MB, 55.37 MB, 95.18 MB, 133.57 MB, 161.07 MB, 177.52 MB, 187.22 MB, 195.09 MB, 202.06 MB, 208.01 MB, 213.14 MB, 218.62 MB, 224.37 MB, 229.24 MB, 233.05 MB, 236.15 MB, 239.05 MB, 241.73 MB, 244.12 MB, 246.29 MB, 248.34 MB, 250.09 MB, 251.57 MB, 253.07 MB, 254.57 MB, 255.79 MB, 256.61 MB, 257.40 MB, 257.93 MB, 258.28 MB, 258.54 MB, 258.79 MB, 258.92 MB, 259.48 MB, 260.39 MB, 260.39 MB, 260.39 MB, 260.39 MB, 260.39 MB, 260.39 MB, 260.39 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 260.39 MB (273034182) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s940ms - NumBatchesAccepted: 13.21K (13205) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s394ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s040ms - PeakMemoryUsage: 0 - RowsReturned: 36.96M (36960695) - RowsReturnedRate: 313.64 K/sec RecvrSide: BytesReceived(16s000ms): 6.18 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.08 MB, 120.29 MB, 384.40 MB, 502.73 MB, 566.35 MB, 612.72 MB, 643.46 MB, 658.77 MB - FirstBatchArrivalWaitTime: 3s625ms - TotalBytesReceived: 663.34 MB (695567151) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s236ms - NumBatchesAccepted: 56.49K (56494) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce1800000253 (host=foo.221.46:22000):(Total: 12m38s, non-child: 72.284ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.62 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 25.36 MB, 162.40 MB, 162.39 MB, 215.66 MB, 289.88 MB, 294.66 MB, 322.64 MB, 339.89 MB, 371.16 MB, 387.63 MB, 400.39 MB, 414.62 MB, 418.42 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.40 MB, 418.41 MB, 426.14 MB, 426.40 MB, 426.39 MB, 426.38 MB, 431.15 MB, 434.40 MB, 434.40 MB, 434.38 MB, 434.41 MB, 436.63 MB, 442.41 MB, 442.41 MB, 442.40 MB, 448.21 MB, 450.42 MB, 450.44 MB, 479.87 MB, 627.90 MB, 628.02 MB, 627.84 MB, 628.21 MB, 627.88 MB, 627.73 MB, 627.39 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.28 MB (672433735) - PerHostPeakMemUsage: 1.38 GB (1481371800) - RowsProduced: 31 (31) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 10.576ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3829) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s249ms - TotalThreadsUserTime: 9s336ms - TotalThreadsVoluntaryContextSwitches: 64.20K (64204) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 58.583ms - ExecTreePrepareTime: 775.542us DataStreamSender (dst_id=26):(Total: 472.982us, non-child: 472.982us, % non-child: 100.00%) - BytesSent: 6.60 KB (6754) - OverallThroughput: 13.62 MB/sec - PeakMemoryUsage: 200.66 KB (205472) - RowsReturned: 31 (31) - SerializeBatchTime: 343.939us - UncompressedRowBatchSize: 6.60 KB (6754) CodeGen:(Total: 675.330ms, non-child: 675.330ms, % non-child: 100.00%) - CodegenTime: 23.049ms - CompileTime: 219.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 424.607ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.620ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 651.039ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 134.469us - GetResultsTime: 91.762us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 9 (9) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 31 (31) - RowsReturnedRate: 0 - StreamingTime: 638.312ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.046ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.580ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 62 (62) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 116.652us - RowsReturned: 62 (62) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 192.734us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 955.994us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 181.665us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s178ms, non-child: 98.859us, % non-child: 0.00%) - ConvertRowBatchTime: 76.809us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 782.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s178ms - DataArrivalTimer: 2s178ms SenderSide: - DeserializeRowBatchTimer: 178.919us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.263ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.055ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 62 (62) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 93.899us - RowsReturned: 62 (62) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46.423us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 749.494us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.150us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 682.829ms, non-child: 32.921us, % non-child: 0.00%) - ConvertRowBatchTime: 15.623us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 401.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 682.800ms - DataArrivalTimer: 682.797ms SenderSide: - DeserializeRowBatchTimer: 81.468us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s465ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1402856) - BuildTime: 1s707ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 36.99M (36985487) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s545ms - RowsReturned: 62 (62) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s443ms - BuildRowsPartitioned: 1.40M (1402856) - GetNewBlockTime: 3.021ms - HashBuckets: 3.01M (3014656) - HashCollisions: 3.60K (3595) - HashTablesBuildTime: 251.842ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 208.432ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.722ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1402856) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 831.45 KB, 19.97 MB, 53.00 MB, 91.09 MB, 127.53 MB, 154.03 MB, 170.05 MB, 179.33 MB, 186.86 MB, 193.53 MB, 199.26 MB, 204.33 MB, 209.60 MB, 214.92 MB, 219.51 MB, 223.11 MB, 226.01 MB, 228.78 MB, 231.35 MB, 233.63 MB, 235.74 MB, 237.74 MB, 239.25 MB, 240.78 MB, 241.98 MB, 243.32 MB, 244.36 MB, 245.22 MB, 245.93 MB, 246.32 MB, 246.64 MB, 246.91 MB, 247.09 MB, 247.17 MB, 247.78 MB, 248.71 MB, 248.71 MB, 248.71 MB, 248.71 MB, 248.71 MB, 248.71 MB, 248.71 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 248.71 MB (260787442) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s917ms - NumBatchesAccepted: 12.59K (12586) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s407ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s049ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36985487) - RowsReturnedRate: 311.20 K/sec RecvrSide: BytesReceived(16s000ms): 6.21 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.16 MB, 120.93 MB, 385.33 MB, 503.16 MB, 566.75 MB, 613.13 MB, 643.85 MB, 659.14 MB - FirstBatchArrivalWaitTime: 3s617ms - TotalBytesReceived: 663.71 MB (695949948) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s434ms - NumBatchesAccepted: 56.53K (56531) - NumBatchesRejected: 52 (52) Instance 5f429df048b5534b:41bcce1800000270 (host=foo.221.48:22000):(Total: 12m38s, non-child: 74.811ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.72 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 27.62 MB, 161.88 MB, 162.38 MB, 222.15 MB, 289.39 MB, 294.40 MB, 322.14 MB, 354.14 MB, 376.15 MB, 399.41 MB, 407.88 MB, 410.40 MB, 410.41 MB, 410.38 MB, 410.40 MB, 410.40 MB, 410.39 MB, 416.89 MB, 419.64 MB, 426.39 MB, 426.41 MB, 434.41 MB, 434.40 MB, 434.40 MB, 434.39 MB, 434.38 MB, 434.39 MB, 434.37 MB, 434.41 MB, 434.40 MB, 434.42 MB, 437.89 MB, 442.39 MB, 442.34 MB, 472.63 MB, 624.46 MB, 623.78 MB, 624.22 MB, 624.12 MB, 623.99 MB, 623.73 MB, 624.00 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 637.28 MB (668239431) - PerHostPeakMemUsage: 1.32 GB (1419969646) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 16.694ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.03K (4028) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s246ms - TotalThreadsUserTime: 9s294ms - TotalThreadsVoluntaryContextSwitches: 63.21K (63210) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 53.330ms - ExecTreePrepareTime: 890.722us DataStreamSender (dst_id=26):(Total: 534.386us, non-child: 534.386us, % non-child: 100.00%) - BytesSent: 11.26 KB (11534) - OverallThroughput: 20.58 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 54 (54) - SerializeBatchTime: 418.455us - UncompressedRowBatchSize: 11.26 KB (11534) CodeGen:(Total: 694.662ms, non-child: 694.662ms, % non-child: 100.00%) - CodegenTime: 17.917ms - CompileTime: 221.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 444.259ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.392ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 621.233ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 93.731us - GetResultsTime: 110.014us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921461) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - StreamingTime: 608.123ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.312ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.071ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9625653) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 180.082us - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 156.371us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 614.825us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 146.782us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s261ms, non-child: 67.988us, % non-child: 0.01%) - ConvertRowBatchTime: 46.728us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.35 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s261ms - DataArrivalTimer: 1s260ms SenderSide: - DeserializeRowBatchTimer: 153.016us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 6.239ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 684.097us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9569333) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 185.828us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.465us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 395.738us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.494us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 647.254ms, non-child: 15.161us, % non-child: 0.00%) - ConvertRowBatchTime: 7.428us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 423.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 647.241ms - DataArrivalTimer: 647.239ms SenderSide: - DeserializeRowBatchTimer: 47.956us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s477ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1403960) - BuildTime: 1s673ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 612.13 MB (641863936) - ProbeRows: 37.03M (37026165) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s590ms - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s393ms - BuildRowsPartitioned: 1.40M (1403960) - GetNewBlockTime: 2.970ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.48K (4478) - HashTablesBuildTime: 266.751ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 612.06 MB (641792128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 200.235ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.813ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1403960) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 920.87 KB, 20.49 MB, 53.88 MB, 92.85 MB, 129.30 MB, 155.13 MB, 170.85 MB, 180.17 MB, 187.71 MB, 194.44 MB, 200.19 MB, 205.13 MB, 210.22 MB, 215.60 MB, 220.23 MB, 223.88 MB, 226.77 MB, 229.50 MB, 232.06 MB, 234.22 MB, 236.15 MB, 238.07 MB, 239.61 MB, 240.90 MB, 242.20 MB, 243.39 MB, 244.48 MB, 245.23 MB, 245.90 MB, 246.35 MB, 246.66 MB, 246.94 MB, 247.28 MB, 247.33 MB, 247.81 MB, 248.70 MB, 248.70 MB, 248.70 MB, 248.70 MB, 248.70 MB, 248.70 MB, 248.70 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 248.70 MB (260779167) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s603ms - NumBatchesAccepted: 12.60K (12602) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s409ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s050ms - PeakMemoryUsage: 0 - RowsReturned: 37.03M (37026165) - RowsReturnedRate: 312.33 K/sec RecvrSide: BytesReceived(16s000ms): 6.27 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.22 MB, 122.12 MB, 387.00 MB, 504.15 MB, 567.74 MB, 614.04 MB, 644.72 MB, 659.90 MB - FirstBatchArrivalWaitTime: 3s566ms - TotalBytesReceived: 664.43 MB (696703376) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s239ms - NumBatchesAccepted: 56.59K (56594) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce180000021b (host=foo.221.49:22000):(Total: 12m38s, non-child: 105.840ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.18 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 24.39 MB, 161.65 MB, 162.40 MB, 215.17 MB, 289.42 MB, 291.92 MB, 323.43 MB, 346.65 MB, 363.40 MB, 377.92 MB, 384.93 MB, 409.15 MB, 410.39 MB, 410.41 MB, 410.39 MB, 411.93 MB, 418.40 MB, 418.43 MB, 418.42 MB, 418.40 MB, 418.43 MB, 418.41 MB, 418.42 MB, 418.42 MB, 425.92 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.42 MB, 426.40 MB, 427.66 MB, 434.40 MB, 434.40 MB, 436.44 MB, 493.44 MB, 622.05 MB, 621.95 MB, 621.85 MB, 621.78 MB, 621.56 MB, 622.21 MB, 622.57 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 635.30 MB (666163894) - PerHostPeakMemUsage: 1.39 GB (1493206787) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 39.949ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.48K (3483) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s207ms - TotalThreadsUserTime: 8s703ms - TotalThreadsVoluntaryContextSwitches: 64.19K (64187) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 47.531ms - ExecTreePrepareTime: 750.873us DataStreamSender (dst_id=26):(Total: 655.591us, non-child: 655.591us, % non-child: 100.00%) - BytesSent: 11.28 KB (11555) - OverallThroughput: 16.81 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 55 (55) - SerializeBatchTime: 532.465us - UncompressedRowBatchSize: 11.28 KB (11555) CodeGen:(Total: 638.888ms, non-child: 638.888ms, % non-child: 100.00%) - CodegenTime: 15.087ms - CompileTime: 212.195ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 399.532ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.710ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 626.060ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 51.791us - GetResultsTime: 154.358us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923557) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - StreamingTime: 615.027ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.099ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.091ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622632) - ProbeRows: 110 (110) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 150.422us - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 157.132us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 586.436us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 142.750us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s309ms, non-child: 99.805us, % non-child: 0.01%) - ConvertRowBatchTime: 75.401us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.30 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s309ms - DataArrivalTimer: 1s309ms SenderSide: - DeserializeRowBatchTimer: 460.819us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 14.147ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 723.739us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566312) - ProbeRows: 110 (110) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 137.898us - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.813us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 425.267us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.524us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 694.162ms, non-child: 19.562us, % non-child: 0.00%) - ConvertRowBatchTime: 8.606us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 394.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 694.146ms - DataArrivalTimer: 694.143ms SenderSide: - DeserializeRowBatchTimer: 66.536us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s146ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1386084) - BuildTime: 1s644ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 610.13 MB (639767199) - ProbeRows: 37.10M (37101753) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s298ms - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s407ms - BuildRowsPartitioned: 1.39M (1386084) - GetNewBlockTime: 3.197ms - HashBuckets: 3.15M (3145728) - HashCollisions: 4.13K (4127) - HashTablesBuildTime: 224.883ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 610.06 MB (639694976) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 202.620ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.226ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1386084) - RowsReturnedRate: 2.19 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 746.44 KB, 19.47 MB, 52.46 MB, 90.48 MB, 126.85 MB, 152.70 MB, 167.93 MB, 176.98 MB, 184.34 MB, 190.82 MB, 196.34 MB, 201.10 MB, 206.12 MB, 211.29 MB, 215.76 MB, 219.37 MB, 222.29 MB, 224.97 MB, 227.46 MB, 229.67 MB, 231.63 MB, 233.47 MB, 235.07 MB, 236.34 MB, 237.72 MB, 238.89 MB, 240.04 MB, 240.76 MB, 241.30 MB, 241.79 MB, 242.20 MB, 242.52 MB, 242.74 MB, 242.81 MB, 243.41 MB, 244.27 MB, 244.27 MB, 244.27 MB, 244.27 MB, 244.27 MB, 244.27 MB, 244.27 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 244.27 MB (256131295) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s908ms - NumBatchesAccepted: 12.45K (12447) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s347ms, % non-child: 1.11%) - ConvertRowBatchTime: 999.933ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37101753) - RowsReturnedRate: 305.75 K/sec RecvrSide: BytesReceived(16s000ms): 6.08 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.92 MB, 118.20 MB, 382.83 MB, 503.73 MB, 567.77 MB, 614.60 MB, 645.54 MB, 661.16 MB - FirstBatchArrivalWaitTime: 3s615ms - TotalBytesReceived: 665.83 MB (698170071) - TotalGetBatchTime: 2m - DataArrivalTimer: 2m SenderSide: - DeserializeRowBatchTimer: 3s976ms - NumBatchesAccepted: 56.71K (56713) - NumBatchesRejected: 36 (36) Instance 5f429df048b5534b:41bcce1800000284 (host=foo.232.11:22000):(Total: 12m38s, non-child: 62.576ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.78 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.64 MB, 162.42 MB, 162.42 MB, 222.93 MB, 290.43 MB, 293.90 MB, 329.16 MB, 368.13 MB, 379.66 MB, 395.90 MB, 407.90 MB, 418.38 MB, 418.43 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.42 MB, 418.42 MB, 418.42 MB, 421.67 MB, 427.64 MB, 434.40 MB, 434.43 MB, 434.41 MB, 434.42 MB, 434.40 MB, 434.42 MB, 434.40 MB, 434.39 MB, 434.41 MB, 434.39 MB, 434.41 MB, 434.42 MB, 434.41 MB, 454.44 MB, 610.58 MB, 610.45 MB, 609.81 MB, 609.83 MB, 609.61 MB, 610.29 MB, 610.30 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 623.30 MB (653580982) - PerHostPeakMemUsage: 1.40 GB (1507459617) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 9.518ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.34K (3336) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s179ms - TotalThreadsUserTime: 8s623ms - TotalThreadsVoluntaryContextSwitches: 64.48K (64485) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 58.840ms - ExecTreePrepareTime: 847.857us DataStreamSender (dst_id=26):(Total: 466.522us, non-child: 466.522us, % non-child: 100.00%) - BytesSent: 8.07 KB (8267) - OverallThroughput: 16.90 MB/sec - PeakMemoryUsage: 212.66 KB (217760) - RowsReturned: 40 (40) - SerializeBatchTime: 263.685us - UncompressedRowBatchSize: 8.07 KB (8267) CodeGen:(Total: 683.114ms, non-child: 683.114ms, % non-child: 100.00%) - CodegenTime: 18.160ms - CompileTime: 203.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 445.401ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.341ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 625.223ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 65.400us - GetResultsTime: 91.199us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 11 (11) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9922636) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 615.075ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.005ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.008ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622732) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 95.400us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 175.201us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 476.248us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 180.942us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 689.706ms, non-child: 88.009us, % non-child: 0.01%) - ConvertRowBatchTime: 42.602us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.47 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 689.655ms - DataArrivalTimer: 689.619ms SenderSide: - DeserializeRowBatchTimer: 309.493us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 8.146ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 477.766us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566412) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.434us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.167us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 310.004us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.012us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 600.566ms, non-child: 11.914us, % non-child: 0.00%) - ConvertRowBatchTime: 5.003us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 456.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 600.556ms - DataArrivalTimer: 600.554ms SenderSide: - DeserializeRowBatchTimer: 29.456us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s089ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1405070) - BuildTime: 1s698ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 37.11M (37112226) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s188ms - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s425ms - BuildRowsPartitioned: 1.41M (1405070) - GetNewBlockTime: 3.415ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.43K (4429) - HashTablesBuildTime: 263.659ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 194.475ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.995ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1405070) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 927.20 KB, 20.40 MB, 54.02 MB, 92.86 MB, 130.04 MB, 156.95 MB, 172.70 MB, 181.84 MB, 189.33 MB, 195.99 MB, 201.67 MB, 206.63 MB, 211.82 MB, 217.07 MB, 221.53 MB, 225.04 MB, 227.90 MB, 230.58 MB, 233.06 MB, 235.31 MB, 237.28 MB, 239.16 MB, 240.72 MB, 242.05 MB, 243.40 MB, 244.65 MB, 245.78 MB, 246.58 MB, 247.20 MB, 247.77 MB, 248.04 MB, 248.34 MB, 248.62 MB, 248.69 MB, 249.23 MB, 250.09 MB, 250.09 MB, 250.09 MB, 250.09 MB, 250.09 MB, 250.09 MB, 250.09 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 250.09 MB (262242484) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s825ms - NumBatchesAccepted: 12.61K (12610) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s321ms, % non-child: 1.12%) - ConvertRowBatchTime: 979.992ms - PeakMemoryUsage: 0 - RowsReturned: 37.11M (37112226) - RowsReturnedRate: 313.83 K/sec RecvrSide: BytesReceived(16s000ms): 6.30 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.22 MB, 122.76 MB, 388.28 MB, 505.40 MB, 569.08 MB, 615.50 MB, 646.26 MB, 661.44 MB - FirstBatchArrivalWaitTime: 3s531ms - TotalBytesReceived: 665.97 MB (698320387) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 3s932ms - NumBatchesAccepted: 56.71K (56714) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce180000026d (host=foo.221.51:22000):(Total: 12m38s, non-child: 69.052ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.87 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 28.80 MB, 162.42 MB, 162.41 MB, 233.67 MB, 290.43 MB, 305.18 MB, 340.17 MB, 367.66 MB, 388.43 MB, 394.40 MB, 407.16 MB, 418.41 MB, 418.41 MB, 418.41 MB, 423.67 MB, 426.42 MB, 426.42 MB, 426.44 MB, 426.42 MB, 430.15 MB, 437.17 MB, 442.41 MB, 442.41 MB, 442.40 MB, 443.16 MB, 455.39 MB, 458.41 MB, 458.41 MB, 458.39 MB, 458.37 MB, 458.42 MB, 458.42 MB, 458.37 MB, 458.49 MB, 486.25 MB, 634.45 MB, 633.95 MB, 634.05 MB, 633.43 MB, 633.92 MB, 634.16 MB, 634.32 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.30 MB (678746806) - PerHostPeakMemUsage: 1.34 GB (1434765277) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 13.833ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.85K (3847) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s256ms - TotalThreadsUserTime: 9s467ms - TotalThreadsVoluntaryContextSwitches: 64.61K (64615) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 57.540ms - ExecTreePrepareTime: 1.181ms DataStreamSender (dst_id=26):(Total: 554.468us, non-child: 554.468us, % non-child: 100.00%) - BytesSent: 11.38 KB (11658) - OverallThroughput: 20.05 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 51 (51) - SerializeBatchTime: 425.159us - UncompressedRowBatchSize: 11.38 KB (11658) CodeGen:(Total: 731.907ms, non-child: 731.907ms, % non-child: 100.00%) - CodegenTime: 18.436ms - CompileTime: 230.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 469.600ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.832ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 688.830ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 91.088us - GetResultsTime: 126.302us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925382) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 672.773ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.357ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.263ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622307) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.738us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 205.190us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 698.853us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 153.666us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 921.296ms, non-child: 91.687us, % non-child: 0.01%) - ConvertRowBatchTime: 73.393us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.85 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 921.212ms - DataArrivalTimer: 921.205ms SenderSide: - DeserializeRowBatchTimer: 179.605us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 5.793ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 703.839us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565987) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 143.875us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.960us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 491.094us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.619us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 556.112ms, non-child: 27.188us, % non-child: 0.00%) - ConvertRowBatchTime: 7.259us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 492.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 556.088ms - DataArrivalTimer: 556.086ms SenderSide: - DeserializeRowBatchTimer: 21.911us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s635ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1452927) - BuildTime: 1s821ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 37.07M (37071933) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s600ms - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s500ms - BuildRowsPartitioned: 1.45M (1452927) - GetNewBlockTime: 2.816ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.87K (2869) - HashTablesBuildTime: 306.902ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 207.767ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.007ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1452927) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1005.38 KB, 21.44 MB, 56.38 MB, 96.67 MB, 134.62 MB, 161.25 MB, 177.10 MB, 186.51 MB, 194.12 MB, 200.78 MB, 206.49 MB, 211.51 MB, 217.00 MB, 222.55 MB, 227.28 MB, 230.89 MB, 233.85 MB, 236.64 MB, 239.23 MB, 241.53 MB, 243.57 MB, 245.63 MB, 247.14 MB, 248.59 MB, 249.94 MB, 251.21 MB, 252.30 MB, 252.95 MB, 253.63 MB, 254.08 MB, 254.38 MB, 254.62 MB, 254.80 MB, 254.87 MB, 255.40 MB, 256.29 MB, 256.29 MB, 256.29 MB, 256.29 MB, 256.29 MB, 256.29 MB, 256.29 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 256.29 MB (268734415) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s987ms - NumBatchesAccepted: 13.04K (13037) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s408ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37071933) - RowsReturnedRate: 313.22 K/sec RecvrSide: BytesReceived(16s000ms): 6.35 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.36 MB, 123.43 MB, 388.85 MB, 505.23 MB, 568.81 MB, 615.03 MB, 645.67 MB, 660.77 MB - FirstBatchArrivalWaitTime: 3s492ms - TotalBytesReceived: 665.28 MB (697601793) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s460ms - NumBatchesAccepted: 56.67K (56666) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce180000026a (host=foo.221.52:22000):(Total: 12m38s, non-child: 66.190ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.70 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 28.04 MB, 162.41 MB, 162.41 MB, 227.92 MB, 289.65 MB, 306.92 MB, 344.89 MB, 366.16 MB, 378.43 MB, 386.40 MB, 387.91 MB, 397.15 MB, 408.41 MB, 410.39 MB, 411.16 MB, 418.41 MB, 418.41 MB, 420.16 MB, 426.42 MB, 445.40 MB, 450.40 MB, 450.41 MB, 456.39 MB, 458.40 MB, 458.40 MB, 458.41 MB, 458.41 MB, 458.44 MB, 458.42 MB, 458.40 MB, 458.43 MB, 458.41 MB, 458.48 MB, 458.41 MB, 486.40 MB, 636.19 MB, 635.47 MB, 636.24 MB, 636.16 MB, 636.09 MB, 635.92 MB, 635.98 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.30 MB (680843958) - PerHostPeakMemUsage: 1.40 GB (1498813388) - RowsProduced: 66 (66) - TotalNetworkReceiveTime: 12m36s - TotalNetworkSendTime: 14.445ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.64K (3644) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s210ms - TotalThreadsUserTime: 8s895ms - TotalThreadsVoluntaryContextSwitches: 64.60K (64600) Fragment Instance Lifecycle Timings: - ExecTime: 1m54s - ExecTreeExecTime: 1m54s - OpenTime: 10m43s - ExecTreeOpenTime: 10m43s - PrepareTime: 57.974ms - ExecTreePrepareTime: 832.552us DataStreamSender (dst_id=26):(Total: 484.631us, non-child: 484.631us, % non-child: 100.00%) - BytesSent: 14.44 KB (14788) - OverallThroughput: 29.10 MB/sec - PeakMemoryUsage: 292.66 KB (299680) - RowsReturned: 66 (66) - SerializeBatchTime: 377.136us - UncompressedRowBatchSize: 14.44 KB (14788) CodeGen:(Total: 694.224ms, non-child: 694.224ms, % non-child: 100.00%) - CodegenTime: 19.077ms - CompileTime: 204.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 456.482ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 32.712ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 588.578ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 61.034us - GetResultsTime: 109.398us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923386) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 66 (66) - RowsReturnedRate: 0 - StreamingTime: 577.575ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.017ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.262ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 132 (132) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.884us - RowsReturned: 132 (132) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 206.821us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 646.410us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 246.470us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s429ms, non-child: 56.160us, % non-child: 0.00%) - ConvertRowBatchTime: 37.633us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 701.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s429ms - DataArrivalTimer: 2s429ms SenderSide: - DeserializeRowBatchTimer: 152.432us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 58.875ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 786.881us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 132 (132) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 196.142us - RowsReturned: 132 (132) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.200us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 449.860us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.087us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 610.534ms, non-child: 18.273us, % non-child: 0.00%) - ConvertRowBatchTime: 7.791us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 448.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 610.519ms - DataArrivalTimer: 610.516ms SenderSide: - DeserializeRowBatchTimer: 54.416us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s277ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1435360) - BuildTime: 1s766ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654446848) - ProbeRows: 37.03M (37029101) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s304ms - RowsReturned: 132 (132) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s463ms - BuildRowsPartitioned: 1.44M (1435360) - GetNewBlockTime: 2.838ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.21K (3210) - HashTablesBuildTime: 291.947ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 268.399ms, % non-child: 0.04%) - ConvertRowBatchTime: 95.759ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1435360) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 932.80 KB, 20.89 MB, 55.22 MB, 95.01 MB, 132.57 MB, 159.12 MB, 174.91 MB, 184.23 MB, 191.68 MB, 198.35 MB, 204.04 MB, 208.99 MB, 214.26 MB, 219.55 MB, 224.09 MB, 227.69 MB, 230.52 MB, 233.22 MB, 235.78 MB, 238.01 MB, 240.04 MB, 242.09 MB, 243.66 MB, 245.09 MB, 246.44 MB, 247.64 MB, 248.81 MB, 249.50 MB, 250.09 MB, 250.50 MB, 250.84 MB, 251.11 MB, 251.26 MB, 251.36 MB, 251.91 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB, 252.77 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.77 MB (265047752) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s777ms - NumBatchesAccepted: 12.88K (12882) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s359ms, % non-child: 1.14%) - ConvertRowBatchTime: 1s007ms - PeakMemoryUsage: 0 - RowsReturned: 37.03M (37029101) - RowsReturnedRate: 311.29 K/sec RecvrSide: BytesReceived(16s000ms): 6.26 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.21 MB, 121.72 MB, 386.57 MB, 503.99 MB, 567.60 MB, 613.97 MB, 644.67 MB, 659.89 MB - FirstBatchArrivalWaitTime: 3s537ms - TotalBytesReceived: 664.45 MB (696724961) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s199ms - NumBatchesAccepted: 56.60K (56601) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce180000022e (host=foo.221.50:22000):(Total: 12m38s, non-child: 94.887ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.19 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.63 MB, 162.40 MB, 162.42 MB, 231.16 MB, 290.41 MB, 303.89 MB, 341.91 MB, 370.15 MB, 398.16 MB, 409.17 MB, 410.43 MB, 413.91 MB, 418.41 MB, 418.41 MB, 418.44 MB, 418.41 MB, 426.17 MB, 426.91 MB, 434.43 MB, 434.44 MB, 439.92 MB, 450.42 MB, 450.43 MB, 450.43 MB, 450.42 MB, 450.39 MB, 457.64 MB, 458.40 MB, 458.40 MB, 458.43 MB, 458.44 MB, 458.41 MB, 458.35 MB, 458.38 MB, 505.45 MB, 634.01 MB, 634.24 MB, 633.53 MB, 633.99 MB, 633.62 MB, 633.71 MB, 633.73 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.30 MB (678746806) - PerHostPeakMemUsage: 1.35 GB (1445681303) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 26.777ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.61K (3608) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s243ms - TotalThreadsUserTime: 9s572ms - TotalThreadsVoluntaryContextSwitches: 64.16K (64158) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 52.960ms - ExecTreePrepareTime: 902.893us DataStreamSender (dst_id=26):(Total: 613.493us, non-child: 613.493us, % non-child: 100.00%) - BytesSent: 10.34 KB (10589) - OverallThroughput: 16.46 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 48 (48) - SerializeBatchTime: 505.738us - UncompressedRowBatchSize: 10.34 KB (10589) CodeGen:(Total: 629.338ms, non-child: 629.338ms, % non-child: 100.00%) - CodegenTime: 19.623ms - CompileTime: 198.817ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 402.960ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.973ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 673.630ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 71.377us - GetResultsTime: 156.718us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9922582) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 658.151ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.774ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.143ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9626774) - ProbeRows: 714 (714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 474.107us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 152.926us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 539.527us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 153.821us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s901ms, non-child: 56.871us, % non-child: 0.00%) - ConvertRowBatchTime: 41.850us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 896.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s901ms - DataArrivalTimer: 1s901ms SenderSide: - DeserializeRowBatchTimer: 249.475us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 3.119ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 629.107us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9570454) - ProbeRows: 714 (714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 573.116us - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.608us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 303.638us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.523us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 682.569ms, non-child: 17.114us, % non-child: 0.00%) - ConvertRowBatchTime: 7.854us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 401.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 682.556ms - DataArrivalTimer: 682.552ms SenderSide: - DeserializeRowBatchTimer: 137.834us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s799ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1460466) - BuildTime: 1s810ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349911) - ProbeRows: 37.00M (36998344) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s768ms - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s519ms - BuildRowsPartitioned: 1.46M (1460466) - GetNewBlockTime: 3.127ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.15K (4154) - HashTablesBuildTime: 280.094ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 206.740ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.280ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1460466) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 823.90 KB, 20.92 MB, 55.72 MB, 95.65 MB, 133.96 MB, 161.39 MB, 177.40 MB, 187.14 MB, 195.05 MB, 202.03 MB, 208.00 MB, 213.27 MB, 218.74 MB, 224.39 MB, 229.17 MB, 232.89 MB, 235.87 MB, 238.65 MB, 241.23 MB, 243.57 MB, 245.65 MB, 247.58 MB, 249.18 MB, 250.58 MB, 251.93 MB, 253.19 MB, 254.25 MB, 255.09 MB, 255.70 MB, 256.22 MB, 256.53 MB, 256.85 MB, 257.16 MB, 257.24 MB, 257.76 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 258.59 MB (271151570) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s805ms - NumBatchesAccepted: 13.11K (13109) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s434ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s068ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (36998344) - RowsReturnedRate: 307.18 K/sec RecvrSide: BytesReceived(16s000ms): 6.08 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.89 MB, 118.17 MB, 382.08 MB, 502.33 MB, 566.13 MB, 612.84 MB, 643.73 MB, 659.29 MB - FirstBatchArrivalWaitTime: 3s600ms - TotalBytesReceived: 663.93 MB (696186235) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s446ms - NumBatchesAccepted: 56.55K (56553) - NumBatchesRejected: 37 (37) Instance 5f429df048b5534b:41bcce1800000255 (host=foo.232.15:22000):(Total: 12m38s, non-child: 174.912ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.94 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 28.81 MB, 161.91 MB, 162.41 MB, 223.44 MB, 288.92 MB, 301.92 MB, 341.41 MB, 357.16 MB, 377.68 MB, 394.39 MB, 394.41 MB, 396.15 MB, 409.16 MB, 410.42 MB, 410.43 MB, 413.43 MB, 428.40 MB, 434.42 MB, 434.41 MB, 434.42 MB, 434.40 MB, 434.40 MB, 434.41 MB, 434.40 MB, 434.89 MB, 442.41 MB, 442.40 MB, 449.41 MB, 450.43 MB, 450.42 MB, 450.38 MB, 450.41 MB, 450.40 MB, 450.45 MB, 482.42 MB, 625.03 MB, 625.42 MB, 625.40 MB, 626.24 MB, 625.90 MB, 626.32 MB, 626.02 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 639.30 MB (670358198) - PerHostPeakMemUsage: 1.42 GB (1529109992) - RowsProduced: 57 (57) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 20.625ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.43K (3431) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s254ms - TotalThreadsUserTime: 8s944ms - TotalThreadsVoluntaryContextSwitches: 64.44K (64437) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.552ms - ExecTreePrepareTime: 643.642us DataStreamSender (dst_id=26):(Total: 608.729us, non-child: 608.729us, % non-child: 100.00%) - BytesSent: 12.65 KB (12951) - OverallThroughput: 20.29 MB/sec - PeakMemoryUsage: 276.66 KB (283296) - RowsReturned: 57 (57) - SerializeBatchTime: 419.631us - UncompressedRowBatchSize: 12.65 KB (12951) CodeGen:(Total: 617.204ms, non-child: 617.204ms, % non-child: 100.00%) - CodegenTime: 15.076ms - CompileTime: 186.312ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 404.512ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.870ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 651.700ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 76.842us - GetResultsTime: 156.450us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927278) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 57 (57) - RowsReturnedRate: 0 - StreamingTime: 638.925ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.783ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 989.508us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.387us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 152.621us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 502.297us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 157.231us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 649.993ms, non-child: 113.686us, % non-child: 0.02%) - ConvertRowBatchTime: 42.204us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.62 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 649.944ms - DataArrivalTimer: 649.881ms SenderSide: - DeserializeRowBatchTimer: 166.722us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.004ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 456.862us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 114 (114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.235us - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46.530us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 216.881us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.227us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 652.045ms, non-child: 12.234us, % non-child: 0.00%) - ConvertRowBatchTime: 4.575us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 420.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 652.036ms - DataArrivalTimer: 652.034ms SenderSide: - DeserializeRowBatchTimer: 112.316us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s411ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1416927) - BuildTime: 1s780ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 614.13 MB (643961088) - ProbeRows: 37.14M (37140859) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s424ms - RowsReturned: 114 (114) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s467ms - BuildRowsPartitioned: 1.42M (1416927) - GetNewBlockTime: 2.980ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.61K (2613) - HashTablesBuildTime: 300.347ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 614.06 MB (643889280) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 207.213ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.926ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1416927) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1003.26 KB, 20.71 MB, 54.20 MB, 93.11 MB, 130.24 MB, 157.08 MB, 172.87 MB, 182.16 MB, 189.71 MB, 196.40 MB, 202.14 MB, 207.18 MB, 212.45 MB, 217.86 MB, 222.50 MB, 226.21 MB, 229.11 MB, 231.85 MB, 234.46 MB, 236.81 MB, 238.81 MB, 240.74 MB, 242.34 MB, 243.65 MB, 245.10 MB, 246.33 MB, 247.57 MB, 248.33 MB, 248.86 MB, 249.41 MB, 249.69 MB, 249.92 MB, 250.18 MB, 250.22 MB, 250.76 MB, 251.63 MB, 251.63 MB, 251.63 MB, 251.63 MB, 251.63 MB, 251.63 MB, 251.63 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 251.63 MB (263848598) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s997ms - NumBatchesAccepted: 12.71K (12714) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s373ms, % non-child: 1.16%) - ConvertRowBatchTime: 1s018ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37140859) - RowsReturnedRate: 312.68 K/sec RecvrSide: BytesReceived(16s000ms): 6.39 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.48 MB, 125.19 MB, 391.42 MB, 506.74 MB, 570.29 MB, 616.48 MB, 647.07 MB, 662.04 MB - FirstBatchArrivalWaitTime: 3s497ms - TotalBytesReceived: 666.48 MB (698850150) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s099ms - NumBatchesAccepted: 56.77K (56774) - NumBatchesRejected: 67 (67) Instance 5f429df048b5534b:41bcce1800000263 (host=foo.232.22:22000):(Total: 12m38s, non-child: 162.666ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.67 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 26.87 MB, 162.40 MB, 162.38 MB, 222.66 MB, 290.40 MB, 302.40 MB, 325.14 MB, 359.89 MB, 378.67 MB, 393.65 MB, 402.41 MB, 410.40 MB, 412.38 MB, 426.38 MB, 426.37 MB, 426.37 MB, 431.42 MB, 434.38 MB, 434.37 MB, 434.41 MB, 434.38 MB, 436.13 MB, 442.39 MB, 442.39 MB, 442.38 MB, 442.39 MB, 442.39 MB, 442.41 MB, 442.36 MB, 442.42 MB, 442.39 MB, 442.39 MB, 442.43 MB, 442.41 MB, 471.71 MB, 622.23 MB, 621.25 MB, 622.14 MB, 621.72 MB, 621.85 MB, 622.17 MB, 621.68 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 635.28 MB (666142279) - PerHostPeakMemUsage: 1.42 GB (1527033436) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 23.570ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.80K (3799) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s218ms - TotalThreadsUserTime: 9s026ms - TotalThreadsVoluntaryContextSwitches: 64.60K (64598) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 62.091ms - ExecTreePrepareTime: 834.280us DataStreamSender (dst_id=26):(Total: 577.227us, non-child: 577.227us, % non-child: 100.00%) - BytesSent: 9.65 KB (9881) - OverallThroughput: 16.33 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 44 (44) - SerializeBatchTime: 407.575us - UncompressedRowBatchSize: 9.65 KB (9881) CodeGen:(Total: 651.225ms, non-child: 651.225ms, % non-child: 100.00%) - CodegenTime: 15.512ms - CompileTime: 214.747ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 396.174ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 39.315ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 651.488ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 58.410us - GetResultsTime: 125.373us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 638.720ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.071ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 950.917us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 121.596us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 175.091us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 509.492us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 169.261us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s776ms, non-child: 59.540us, % non-child: 0.00%) - ConvertRowBatchTime: 39.674us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 959.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s776ms - DataArrivalTimer: 1s776ms SenderSide: - DeserializeRowBatchTimer: 161.499us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.143ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 531.571us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.830us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 67.135us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 274.726us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 109.795us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 532.715ms, non-child: 12.354us, % non-child: 0.00%) - ConvertRowBatchTime: 4.706us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 514.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 532.706ms - DataArrivalTimer: 532.704ms SenderSide: - DeserializeRowBatchTimer: 70.179us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s302ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1442486) - BuildTime: 1s785ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 610.13 MB (639766784) - ProbeRows: 37.00M (37004952) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s305ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s515ms - BuildRowsPartitioned: 1.44M (1442486) - GetNewBlockTime: 3.926ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.53K (3528) - HashTablesBuildTime: 257.956ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 610.06 MB (639694976) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 214.531ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.618ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1442486) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 888.57 KB, 20.31 MB, 54.25 MB, 93.43 MB, 130.61 MB, 157.68 MB, 173.87 MB, 183.23 MB, 190.84 MB, 197.52 MB, 203.28 MB, 208.33 MB, 213.63 MB, 219.10 MB, 223.88 MB, 227.53 MB, 230.46 MB, 233.26 MB, 235.89 MB, 238.30 MB, 240.50 MB, 242.59 MB, 244.22 MB, 245.64 MB, 247.09 MB, 248.44 MB, 249.55 MB, 250.46 MB, 251.24 MB, 251.73 MB, 252.02 MB, 252.38 MB, 252.64 MB, 252.73 MB, 253.32 MB, 254.20 MB, 254.20 MB, 254.20 MB, 254.20 MB, 254.20 MB, 254.20 MB, 254.20 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 254.20 MB (266546837) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s821ms - NumBatchesAccepted: 12.94K (12943) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s363ms, % non-child: 1.15%) - ConvertRowBatchTime: 1s008ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (37004952) - RowsReturnedRate: 311.24 K/sec RecvrSide: BytesReceived(16s000ms): 6.24 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.21 MB, 121.77 MB, 386.47 MB, 503.81 MB, 567.38 MB, 613.73 MB, 644.44 MB, 659.61 MB - FirstBatchArrivalWaitTime: 3s452ms - TotalBytesReceived: 664.14 MB (696402119) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s127ms - NumBatchesAccepted: 56.56K (56561) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce180000022d (host=foo.232.13:22000):(Total: 12m38s, non-child: 90.259ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.22 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 26.64 MB, 162.41 MB, 162.43 MB, 231.91 MB, 290.42 MB, 316.67 MB, 343.91 MB, 357.40 MB, 371.90 MB, 402.90 MB, 410.42 MB, 410.43 MB, 410.41 MB, 418.15 MB, 426.40 MB, 436.17 MB, 442.42 MB, 445.91 MB, 450.40 MB, 450.42 MB, 450.43 MB, 450.40 MB, 457.40 MB, 458.41 MB, 458.41 MB, 458.40 MB, 458.40 MB, 458.39 MB, 458.40 MB, 458.42 MB, 458.43 MB, 458.43 MB, 458.34 MB, 458.47 MB, 504.54 MB, 627.53 MB, 628.27 MB, 628.00 MB, 628.07 MB, 627.69 MB, 628.29 MB, 628.03 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.30 MB (672455350) - PerHostPeakMemUsage: 1.41 GB (1510408439) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 32.076ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.35K (3349) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s165ms - TotalThreadsUserTime: 8s703ms - TotalThreadsVoluntaryContextSwitches: 64.48K (64480) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 52.733ms - ExecTreePrepareTime: 931.821us DataStreamSender (dst_id=26):(Total: 474.131us, non-child: 474.131us, % non-child: 100.00%) - BytesSent: 10.30 KB (10549) - OverallThroughput: 21.22 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 45 (45) - SerializeBatchTime: 349.280us - UncompressedRowBatchSize: 10.30 KB (10549) CodeGen:(Total: 662.870ms, non-child: 662.870ms, % non-child: 100.00%) - CodegenTime: 16.394ms - CompileTime: 215.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 417.129ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.670ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 631.584ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 58.043us - GetResultsTime: 134.102us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921536) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 619.737ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.002ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 709.840us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621632) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 92.233us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 95.430us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 305.334us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 140.505us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s887ms, non-child: 33.649us, % non-child: 0.00%) - ConvertRowBatchTime: 23.123us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 902.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s887ms - DataArrivalTimer: 1s887ms SenderSide: - DeserializeRowBatchTimer: 259.735us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 8.390ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 464.837us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565312) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 97.708us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.645us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 191.637us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.231us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 610.999ms, non-child: 13.183us, % non-child: 0.00%) - ConvertRowBatchTime: 4.484us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 448.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 610.989ms - DataArrivalTimer: 610.987ms SenderSide: - DeserializeRowBatchTimer: 81.404us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s121ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1445729) - BuildTime: 1s717ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.04M (37042697) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s205ms - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s412ms - BuildRowsPartitioned: 1.45M (1445729) - GetNewBlockTime: 3.017ms - HashBuckets: 3.01M (3014656) - HashCollisions: 5.12K (5116) - HashTablesBuildTime: 293.796ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 191.730ms, % non-child: 0.03%) - ConvertRowBatchTime: 88.485ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1445729) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 832.18 KB, 20.78 MB, 55.92 MB, 96.53 MB, 134.66 MB, 161.70 MB, 177.67 MB, 187.41 MB, 195.19 MB, 202.01 MB, 207.76 MB, 212.81 MB, 218.12 MB, 223.59 MB, 228.28 MB, 232.00 MB, 234.88 MB, 237.59 MB, 240.13 MB, 242.41 MB, 244.47 MB, 246.39 MB, 247.93 MB, 249.39 MB, 250.66 MB, 252.07 MB, 253.04 MB, 253.91 MB, 254.61 MB, 255.03 MB, 255.28 MB, 255.55 MB, 255.76 MB, 255.85 MB, 256.35 MB, 257.26 MB, 257.26 MB, 257.26 MB, 257.26 MB, 257.26 MB, 257.26 MB, 257.26 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 257.26 MB (269754403) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s765ms - NumBatchesAccepted: 12.97K (12970) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m1s, non-child: 1s340ms, % non-child: 1.11%) - ConvertRowBatchTime: 996.077ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37042697) - RowsReturnedRate: 306.12 K/sec RecvrSide: BytesReceived(16s000ms): 6.11 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.90 MB, 118.37 MB, 382.64 MB, 503.00 MB, 566.92 MB, 613.62 MB, 644.53 MB, 660.07 MB - FirstBatchArrivalWaitTime: 3s552ms - TotalBytesReceived: 664.69 MB (696980745) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s732ms - NumBatchesAccepted: 56.61K (56612) - NumBatchesRejected: 40 (40) Instance 5f429df048b5534b:41bcce180000027d (host=foo.232.18:22000):(Total: 12m38s, non-child: 171.724ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.59 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.89 MB, 162.41 MB, 162.42 MB, 229.16 MB, 290.43 MB, 297.92 MB, 350.66 MB, 363.42 MB, 383.68 MB, 405.42 MB, 412.40 MB, 418.44 MB, 418.43 MB, 418.43 MB, 418.40 MB, 418.41 MB, 418.42 MB, 418.40 MB, 420.41 MB, 435.40 MB, 442.42 MB, 443.42 MB, 450.40 MB, 450.41 MB, 450.42 MB, 458.16 MB, 458.42 MB, 458.42 MB, 458.42 MB, 458.47 MB, 458.40 MB, 458.40 MB, 458.42 MB, 460.71 MB, 483.79 MB, 641.83 MB, 642.21 MB, 642.05 MB, 641.93 MB, 641.63 MB, 641.83 MB, 641.99 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 655.30 MB (687135414) - PerHostPeakMemUsage: 1.36 GB (1459405202) - RowsProduced: 39 (39) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 11.904ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.56K (3556) - TotalThreadsTotalWallClockTime: 23m19s - TotalThreadsSysTime: 1s207ms - TotalThreadsUserTime: 9s579ms - TotalThreadsVoluntaryContextSwitches: 63.67K (63671) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 65.319ms - ExecTreePrepareTime: 834.609us DataStreamSender (dst_id=26):(Total: 594.746us, non-child: 594.746us, % non-child: 100.00%) - BytesSent: 8.39 KB (8594) - OverallThroughput: 13.78 MB/sec - PeakMemoryUsage: 216.66 KB (221856) - RowsReturned: 39 (39) - SerializeBatchTime: 429.816us - UncompressedRowBatchSize: 8.39 KB (8594) CodeGen:(Total: 696.399ms, non-child: 696.399ms, % non-child: 100.00%) - CodegenTime: 16.215ms - CompileTime: 250.885ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 414.331ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.653ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 643.647ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 59.683us - GetResultsTime: 122.469us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9920736) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 39 (39) - RowsReturnedRate: 0 - StreamingTime: 630.139ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.129ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.060ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621803) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 104.803us - RowsReturned: 78 (78) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 160.397us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 601.204us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.698us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 3s026ms, non-child: 93.689us, % non-child: 0.00%) - ConvertRowBatchTime: 68.364us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 563.00 /sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 3s026ms - DataArrivalTimer: 3s026ms SenderSide: - DeserializeRowBatchTimer: 249.559us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.331ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 562.533us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565483) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.305us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35.091us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 346.124us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.147us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 441.339ms, non-child: 25.085us, % non-child: 0.01%) - ConvertRowBatchTime: 8.052us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 620.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 441.325ms - DataArrivalTimer: 441.315ms SenderSide: - DeserializeRowBatchTimer: 94.121us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s681ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1463609) - BuildTime: 1s739ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 630.13 MB (660738394) - ProbeRows: 37.14M (37142532) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s721ms - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s408ms - BuildRowsPartitioned: 1.46M (1463609) - GetNewBlockTime: 3.058ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.17K (4175) - HashTablesBuildTime: 316.752ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 630.06 MB (660666496) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 197.769ms, % non-child: 0.03%) - ConvertRowBatchTime: 91.823ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1463609) - RowsReturnedRate: 2.30 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 935.46 KB, 20.95 MB, 55.38 MB, 95.16 MB, 133.11 MB, 160.10 MB, 176.32 MB, 185.93 MB, 193.72 MB, 200.53 MB, 206.40 MB, 211.59 MB, 217.04 MB, 222.65 MB, 227.46 MB, 231.26 MB, 234.31 MB, 237.18 MB, 239.78 MB, 242.09 MB, 244.17 MB, 246.23 MB, 247.91 MB, 249.32 MB, 250.69 MB, 251.94 MB, 253.13 MB, 253.89 MB, 254.50 MB, 254.92 MB, 255.19 MB, 255.59 MB, 255.92 MB, 256.05 MB, 256.54 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB, 257.43 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 257.43 MB (269938329) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m36s SenderSide: - DeserializeRowBatchTimer: 1s593ms - NumBatchesAccepted: 13.13K (13133) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s437ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37142532) - RowsReturnedRate: 316.18 K/sec RecvrSide: BytesReceived(16s000ms): 6.25 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.13 MB, 121.64 MB, 387.14 MB, 505.35 MB, 569.29 MB, 615.85 MB, 646.66 MB, 661.95 MB - FirstBatchArrivalWaitTime: 3s358ms - TotalBytesReceived: 666.52 MB (698896835) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s252ms - NumBatchesAccepted: 56.77K (56767) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce1800000224 (host=foo.232.20:22000):(Total: 12m38s, non-child: 90.100ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.96 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 28.30 MB, 162.41 MB, 162.43 MB, 221.44 MB, 290.42 MB, 291.93 MB, 325.66 MB, 362.92 MB, 377.41 MB, 393.18 MB, 410.40 MB, 410.41 MB, 410.42 MB, 417.91 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.42 MB, 418.40 MB, 418.40 MB, 418.42 MB, 418.41 MB, 426.41 MB, 426.40 MB, 429.43 MB, 434.42 MB, 434.41 MB, 434.39 MB, 434.41 MB, 434.45 MB, 434.37 MB, 434.42 MB, 434.42 MB, 436.14 MB, 499.86 MB, 625.82 MB, 626.66 MB, 625.87 MB, 625.71 MB, 625.30 MB, 626.20 MB, 626.68 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 639.30 MB (670358198) - PerHostPeakMemUsage: 1.37 GB (1474452829) - RowsProduced: 37 (37) - TotalNetworkReceiveTime: 12m35s - TotalNetworkSendTime: 25.012ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.59K (3588) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s204ms - TotalThreadsUserTime: 9s424ms - TotalThreadsVoluntaryContextSwitches: 64.17K (64170) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m35s - PrepareTime: 44.736ms - ExecTreePrepareTime: 809.504us DataStreamSender (dst_id=26):(Total: 505.326us, non-child: 505.326us, % non-child: 100.00%) - BytesSent: 8.24 KB (8442) - OverallThroughput: 15.93 MB/sec - PeakMemoryUsage: 216.66 KB (221856) - RowsReturned: 37 (37) - SerializeBatchTime: 328.623us - UncompressedRowBatchSize: 8.24 KB (8442) CodeGen:(Total: 647.010ms, non-child: 647.010ms, % non-child: 100.00%) - CodegenTime: 15.183ms - CompileTime: 202.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 420.221ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.712ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 650.976ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.132us - GetResultsTime: 115.239us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921511) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 0 - StreamingTime: 637.474ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.264ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 885.469us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622053) - ProbeRows: 78 (78) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.860us - RowsReturned: 74 (74) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 146.839us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 470.661us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 152.995us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s391ms, non-child: 63.557us, % non-child: 0.00%) - ConvertRowBatchTime: 44.369us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 712.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s391ms - DataArrivalTimer: 2s391ms SenderSide: - DeserializeRowBatchTimer: 242.344us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 2.341ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 569.175us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565733) - ProbeRows: 78 (78) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 117.024us - RowsReturned: 78 (78) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.081us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 317.842us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.743us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 560.839ms, non-child: 19.768us, % non-child: 0.00%) - ConvertRowBatchTime: 8.164us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 488.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 560.823ms - DataArrivalTimer: 560.820ms SenderSide: - DeserializeRowBatchTimer: 180.887us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s690ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1423766) - BuildTime: 1s756ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 614.13 MB (643962174) - ProbeRows: 37.08M (37084617) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s711ms - RowsReturned: 78 (78) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s451ms - BuildRowsPartitioned: 1.42M (1423766) - GetNewBlockTime: 2.938ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.84K (3842) - HashTablesBuildTime: 290.862ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 614.06 MB (643889280) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 197.211ms, % non-child: 0.03%) - ConvertRowBatchTime: 90.898ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1423766) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 984.58 KB, 20.60 MB, 54.13 MB, 92.84 MB, 129.95 MB, 156.11 MB, 171.63 MB, 180.92 MB, 188.46 MB, 195.09 MB, 200.72 MB, 205.72 MB, 210.93 MB, 216.25 MB, 220.83 MB, 224.54 MB, 227.53 MB, 230.28 MB, 232.89 MB, 235.24 MB, 237.39 MB, 239.46 MB, 241.09 MB, 242.53 MB, 243.94 MB, 245.29 MB, 246.38 MB, 247.32 MB, 247.92 MB, 248.36 MB, 248.63 MB, 248.87 MB, 249.14 MB, 249.29 MB, 249.92 MB, 250.76 MB, 250.76 MB, 250.76 MB, 250.76 MB, 250.76 MB, 250.76 MB, 250.76 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 250.76 MB (262944048) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s717ms - NumBatchesAccepted: 12.78K (12778) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s447ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s070ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37084617) - RowsReturnedRate: 307.88 K/sec RecvrSide: BytesReceived(16s000ms): 6.41 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.53 MB, 124.85 MB, 390.51 MB, 505.80 MB, 569.35 MB, 615.49 MB, 646.06 MB, 661.03 MB - FirstBatchArrivalWaitTime: 3s482ms - TotalBytesReceived: 665.48 MB (697803434) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s613ms - NumBatchesAccepted: 56.68K (56682) - NumBatchesRejected: 39 (39) Instance 5f429df048b5534b:41bcce180000025c (host=foo.232.24:22000):(Total: 12m38s, non-child: 61.345ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.91 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 29.30 MB, 162.43 MB, 162.41 MB, 221.19 MB, 290.42 MB, 297.67 MB, 329.18 MB, 357.64 MB, 371.42 MB, 381.90 MB, 395.16 MB, 402.39 MB, 409.42 MB, 413.43 MB, 418.42 MB, 418.42 MB, 419.39 MB, 426.40 MB, 426.44 MB, 426.41 MB, 426.42 MB, 426.40 MB, 426.39 MB, 426.41 MB, 426.41 MB, 426.43 MB, 426.42 MB, 426.40 MB, 426.41 MB, 426.45 MB, 426.42 MB, 430.13 MB, 434.33 MB, 434.42 MB, 465.93 MB, 605.27 MB, 606.21 MB, 606.03 MB, 606.06 MB, 605.47 MB, 606.12 MB, 606.30 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 619.30 MB (649386678) - PerHostPeakMemUsage: 1.32 GB (1416421510) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 9.820ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.48K (3480) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s185ms - TotalThreadsUserTime: 9s396ms - TotalThreadsVoluntaryContextSwitches: 63.49K (63487) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 50.121ms - ExecTreePrepareTime: 860.296us DataStreamSender (dst_id=26):(Total: 490.603us, non-child: 490.603us, % non-child: 100.00%) - BytesSent: 9.23 KB (9450) - OverallThroughput: 18.37 MB/sec - PeakMemoryUsage: 216.66 KB (221856) - RowsReturned: 43 (43) - SerializeBatchTime: 366.923us - UncompressedRowBatchSize: 9.23 KB (9450) CodeGen:(Total: 646.995ms, non-child: 646.995ms, % non-child: 100.00%) - CodegenTime: 15.811ms - CompileTime: 226.855ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 393.907ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.705ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 653.856ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.646us - GetResultsTime: 132.575us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925732) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 638.872ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.407ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 838.460us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621732) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.816us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 135.512us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 474.520us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 119.051us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s151ms, non-child: 76.402us, % non-child: 0.01%) - ConvertRowBatchTime: 44.360us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.48 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s151ms - DataArrivalTimer: 1s151ms SenderSide: - DeserializeRowBatchTimer: 222.882us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 10.200ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 573.618us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565412) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.384us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 67.883us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 294.320us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 134.591us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 532.701ms, non-child: 13.543us, % non-child: 0.00%) - ConvertRowBatchTime: 4.753us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 514.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 532.692ms - DataArrivalTimer: 532.689ms SenderSide: - DeserializeRowBatchTimer: 57.847us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s604ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1399469) - BuildTime: 1s667ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 594.13 MB (622989568) - ProbeRows: 37.09M (37094503) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s711ms - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s367ms - BuildRowsPartitioned: 1.40M (1399469) - GetNewBlockTime: 2.555ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.35K (3350) - HashTablesBuildTime: 288.388ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 594.06 MB (622917760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 196.128ms, % non-child: 0.03%) - ConvertRowBatchTime: 90.836ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1399469) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1004.85 KB, 20.65 MB, 54.07 MB, 92.74 MB, 129.52 MB, 155.71 MB, 171.11 MB, 180.26 MB, 187.68 MB, 194.12 MB, 199.59 MB, 204.41 MB, 209.49 MB, 214.69 MB, 219.09 MB, 222.57 MB, 225.39 MB, 228.00 MB, 230.42 MB, 232.64 MB, 234.62 MB, 236.54 MB, 238.00 MB, 239.35 MB, 240.66 MB, 241.88 MB, 242.95 MB, 243.76 MB, 244.33 MB, 244.66 MB, 245.04 MB, 245.37 MB, 245.59 MB, 245.64 MB, 246.22 MB, 247.09 MB, 247.09 MB, 247.09 MB, 247.09 MB, 247.09 MB, 247.09 MB, 247.09 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 247.09 MB (259089642) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s749ms - NumBatchesAccepted: 12.56K (12559) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s428ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s054ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37094503) - RowsReturnedRate: 313.18 K/sec RecvrSide: BytesReceived(16s000ms): 6.44 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.53 MB, 125.36 MB, 391.24 MB, 506.06 MB, 569.53 MB, 615.68 MB, 646.26 MB, 661.19 MB - FirstBatchArrivalWaitTime: 3s461ms - TotalBytesReceived: 665.61 MB (697945565) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s503ms - NumBatchesAccepted: 56.70K (56695) - NumBatchesRejected: 66 (66) Instance 5f429df048b5534b:41bcce180000023e (host=foo.232.23:22000):(Total: 12m38s, non-child: 79.482ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.30 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.13 MB, 162.40 MB, 162.42 MB, 222.63 MB, 289.93 MB, 318.17 MB, 343.92 MB, 356.66 MB, 364.17 MB, 372.43 MB, 403.93 MB, 410.40 MB, 411.16 MB, 427.67 MB, 446.17 MB, 450.43 MB, 450.42 MB, 451.16 MB, 458.43 MB, 458.43 MB, 458.42 MB, 458.42 MB, 458.40 MB, 458.42 MB, 458.42 MB, 458.43 MB, 458.41 MB, 458.43 MB, 460.15 MB, 466.41 MB, 466.42 MB, 466.43 MB, 466.40 MB, 466.45 MB, 504.56 MB, 649.14 MB, 650.12 MB, 649.82 MB, 649.78 MB, 649.99 MB, 650.23 MB, 650.13 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 663.30 MB (695524022) - PerHostPeakMemUsage: 1.38 GB (1486259692) - RowsProduced: 31 (31) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 14.826ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.72K (3721) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s146ms - TotalThreadsUserTime: 9s686ms - TotalThreadsVoluntaryContextSwitches: 64.35K (64350) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 55.679ms - ExecTreePrepareTime: 648.549us DataStreamSender (dst_id=26):(Total: 365.570us, non-child: 365.570us, % non-child: 100.00%) - BytesSent: 6.86 KB (7021) - OverallThroughput: 18.32 MB/sec - PeakMemoryUsage: 196.66 KB (201376) - RowsReturned: 31 (31) - SerializeBatchTime: 263.398us - UncompressedRowBatchSize: 6.86 KB (7021) CodeGen:(Total: 704.158ms, non-child: 704.158ms, % non-child: 100.00%) - CodegenTime: 16.660ms - CompileTime: 239.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 433.750ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.405ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 659.824ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.345us - GetResultsTime: 89.158us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9914990) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 31 (31) - RowsReturnedRate: 0 - StreamingTime: 643.749ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 1.794ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 936.490us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622257) - ProbeRows: 68 (68) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 85.115us - RowsReturned: 62 (62) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 123.968us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 511.614us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 151.218us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s953ms, non-child: 153.725us, % non-child: 0.01%) - ConvertRowBatchTime: 56.050us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 872.00 /sec RecvrSide: BytesReceived(16s000ms): 22.25 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s953ms - DataArrivalTimer: 1s953ms SenderSide: - DeserializeRowBatchTimer: 222.338us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 11.412ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 575.595us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565937) - ProbeRows: 68 (68) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 105.260us - RowsReturned: 68 (68) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54.766us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 338.921us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.290us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 454.996ms, non-child: 14.316us, % non-child: 0.00%) - ConvertRowBatchTime: 7.457us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 602.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 454.984ms - DataArrivalTimer: 454.983ms SenderSide: - DeserializeRowBatchTimer: 33.738us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s696ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1474275) - BuildTime: 1s771ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 638.13 MB (669126977) - ProbeRows: 37.04M (37042260) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s709ms - RowsReturned: 68 (68) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s480ms - BuildRowsPartitioned: 1.47M (1474275) - GetNewBlockTime: 2.743ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.60K (3596) - HashTablesBuildTime: 279.187ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 638.06 MB (669055104) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 194.837ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.147ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1474275) - RowsReturnedRate: 2.32 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 867.89 KB, 20.45 MB, 54.52 MB, 94.10 MB, 132.00 MB, 159.47 MB, 176.82 MB, 186.76 MB, 194.74 MB, 201.72 MB, 207.70 MB, 212.92 MB, 218.35 MB, 223.90 MB, 228.70 MB, 232.59 MB, 235.66 MB, 238.55 MB, 241.25 MB, 243.65 MB, 245.83 MB, 247.99 MB, 249.71 MB, 251.22 MB, 252.71 MB, 254.12 MB, 255.30 MB, 256.21 MB, 256.99 MB, 257.48 MB, 257.73 MB, 258.13 MB, 258.37 MB, 258.45 MB, 258.91 MB, 259.82 MB, 259.82 MB, 259.82 MB, 259.82 MB, 259.82 MB, 259.82 MB, 259.82 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 259.82 MB (272437430) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s597ms - NumBatchesAccepted: 13.22K (13223) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s429ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37042260) - RowsReturnedRate: 310.63 K/sec RecvrSide: BytesReceived(16s000ms): 6.15 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.99 MB, 119.59 MB, 384.02 MB, 503.42 MB, 567.22 MB, 613.77 MB, 644.61 MB, 660.07 MB - FirstBatchArrivalWaitTime: 3s393ms - TotalBytesReceived: 664.69 MB (696973749) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s439ms - NumBatchesAccepted: 56.62K (56619) - NumBatchesRejected: 49 (49) Instance 5f429df048b5534b:41bcce180000026c (host=foo.232.25:22000):(Total: 12m38s, non-child: 70.479ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.48 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 26.86 MB, 161.88 MB, 162.37 MB, 225.63 MB, 288.16 MB, 298.90 MB, 355.13 MB, 366.65 MB, 378.90 MB, 391.16 MB, 397.16 MB, 402.42 MB, 408.14 MB, 410.39 MB, 410.40 MB, 414.64 MB, 418.37 MB, 420.88 MB, 429.65 MB, 434.36 MB, 434.40 MB, 434.38 MB, 444.14 MB, 458.89 MB, 466.41 MB, 466.39 MB, 466.39 MB, 466.39 MB, 466.41 MB, 474.13 MB, 474.40 MB, 474.41 MB, 474.39 MB, 474.43 MB, 503.91 MB, 660.06 MB, 659.69 MB, 659.95 MB, 660.03 MB, 659.79 MB, 659.54 MB, 659.59 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 673.28 MB (705988167) - PerHostPeakMemUsage: 1.41 GB (1513013883) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 15.081ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.76K (3762) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s240ms - TotalThreadsUserTime: 9s152ms - TotalThreadsVoluntaryContextSwitches: 64.01K (64010) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 50.797ms - ExecTreePrepareTime: 885.313us DataStreamSender (dst_id=26):(Total: 589.353us, non-child: 589.353us, % non-child: 100.00%) - BytesSent: 10.49 KB (10744) - OverallThroughput: 17.39 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 51 (51) - SerializeBatchTime: 507.680us - UncompressedRowBatchSize: 10.49 KB (10744) CodeGen:(Total: 663.758ms, non-child: 663.758ms, % non-child: 100.00%) - CodegenTime: 16.497ms - CompileTime: 217.581ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 417.900ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.642ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 651.952ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 46.146us - GetResultsTime: 186.640us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9914990) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 639.394ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.064ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 850.499us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621553) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 115.281us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 147.492us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 414.875us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 172.795us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s092ms, non-child: 77.683us, % non-child: 0.01%) - ConvertRowBatchTime: 45.569us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.56 K/sec RecvrSide: BytesReceived(16s000ms): 22.69 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s091ms - DataArrivalTimer: 1s091ms SenderSide: - DeserializeRowBatchTimer: 233.718us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 16.731ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 584.337us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565233) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 147.325us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 81.154us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 286.990us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.752us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 468.478ms, non-child: 18.271us, % non-child: 0.00%) - ConvertRowBatchTime: 7.821us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 584.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 468.463ms - DataArrivalTimer: 468.460ms SenderSide: - DeserializeRowBatchTimer: 179.740us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m37s, non-child: 6s359ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1445283) - BuildTime: 1s752ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 648.13 MB (679612672) - ProbeRows: 36.89M (36894221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s392ms - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s478ms - BuildRowsPartitioned: 1.45M (1445283) - GetNewBlockTime: 2.971ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.76K (4760) - HashTablesBuildTime: 263.222ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 648.06 MB (679540864) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 204.881ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.124ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1445283) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 871.51 KB, 20.47 MB, 54.65 MB, 93.95 MB, 131.27 MB, 158.36 MB, 174.79 MB, 184.56 MB, 192.44 MB, 199.41 MB, 205.40 MB, 210.59 MB, 216.04 MB, 221.71 MB, 226.46 MB, 230.27 MB, 233.31 MB, 236.15 MB, 238.76 MB, 241.03 MB, 243.12 MB, 245.06 MB, 246.62 MB, 248.00 MB, 249.37 MB, 250.63 MB, 251.65 MB, 252.49 MB, 253.22 MB, 253.59 MB, 253.91 MB, 254.36 MB, 254.58 MB, 254.65 MB, 255.13 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 256.06 MB (268497999) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s898ms - NumBatchesAccepted: 12.96K (12961) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s404ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s028ms - PeakMemoryUsage: 0 - RowsReturned: 36.89M (36894221) - RowsReturnedRate: 311.21 K/sec RecvrSide: BytesReceived(16s000ms): 6.19 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.12 MB, 120.48 MB, 384.17 MB, 501.98 MB, 565.51 MB, 611.74 MB, 642.37 MB, 657.57 MB - FirstBatchArrivalWaitTime: 3s399ms - TotalBytesReceived: 662.12 MB (694279998) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s242ms - NumBatchesAccepted: 56.39K (56393) - NumBatchesRejected: 68 (68) Instance 5f429df048b5534b:41bcce1800000220 (host=foo.232.26:22000):(Total: 12m38s, non-child: 98.567ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.96 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 30.56 MB, 162.16 MB, 162.41 MB, 236.69 MB, 290.42 MB, 307.92 MB, 349.19 MB, 387.92 MB, 402.43 MB, 402.41 MB, 405.65 MB, 410.41 MB, 412.39 MB, 418.41 MB, 418.40 MB, 418.42 MB, 422.38 MB, 429.66 MB, 442.42 MB, 442.42 MB, 442.42 MB, 442.42 MB, 442.42 MB, 444.66 MB, 451.91 MB, 458.41 MB, 458.43 MB, 458.41 MB, 458.41 MB, 458.45 MB, 461.90 MB, 466.43 MB, 466.41 MB, 466.34 MB, 522.67 MB, 645.79 MB, 646.13 MB, 645.80 MB, 645.87 MB, 646.09 MB, 645.86 MB, 645.76 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 659.30 MB (691329718) - PerHostPeakMemUsage: 1.35 GB (1451386358) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 37.232ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.44K (3437) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s289ms - TotalThreadsUserTime: 9s593ms - TotalThreadsVoluntaryContextSwitches: 64.24K (64237) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m38s - PrepareTime: 51.579ms - ExecTreePrepareTime: 1.420ms DataStreamSender (dst_id=26):(Total: 723.444us, non-child: 723.444us, % non-child: 100.00%) - BytesSent: 10.59 KB (10843) - OverallThroughput: 14.29 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 50 (50) - SerializeBatchTime: 538.816us - UncompressedRowBatchSize: 10.59 KB (10843) CodeGen:(Total: 651.363ms, non-child: 651.363ms, % non-child: 100.00%) - CodegenTime: 15.794ms - CompileTime: 203.893ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 417.365ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.608ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 673.966ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 59.438us - GetResultsTime: 174.745us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927278) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 660.791ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.747ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 730.742us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.196us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 156.423us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 337.916us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 149.273us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 817.723ms, non-child: 77.540us, % non-child: 0.01%) - ConvertRowBatchTime: 58.927us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.08 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 817.653ms - DataArrivalTimer: 817.647ms SenderSide: - DeserializeRowBatchTimer: 186.941us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 22.818ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 478.158us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 102 (102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 154.669us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.351us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 214.327us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 111.226us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 570.666ms, non-child: 16.828us, % non-child: 0.00%) - ConvertRowBatchTime: 7.414us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 480.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 570.653ms - DataArrivalTimer: 570.650ms SenderSide: - DeserializeRowBatchTimer: 131.112us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s860ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1461841) - BuildTime: 1s790ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 634.13 MB (664932773) - ProbeRows: 37.01M (37013392) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s837ms - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s476ms - BuildRowsPartitioned: 1.46M (1461841) - GetNewBlockTime: 2.776ms - HashBuckets: 3.67M (3670016) - HashCollisions: 5.35K (5346) - HashTablesBuildTime: 301.678ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 634.06 MB (664860800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 207.422ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.056ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1461841) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.03 MB, 21.94 MB, 57.22 MB, 97.75 MB, 136.11 MB, 163.53 MB, 179.35 MB, 188.89 MB, 196.73 MB, 203.65 MB, 209.57 MB, 214.72 MB, 220.22 MB, 225.73 MB, 230.41 MB, 234.11 MB, 237.01 MB, 239.76 MB, 242.33 MB, 244.59 MB, 246.58 MB, 248.55 MB, 250.17 MB, 251.60 MB, 253.08 MB, 254.40 MB, 255.52 MB, 256.26 MB, 256.91 MB, 257.38 MB, 257.71 MB, 258.00 MB, 258.22 MB, 258.27 MB, 258.85 MB, 259.70 MB, 259.70 MB, 259.70 MB, 259.70 MB, 259.70 MB, 259.70 MB, 259.70 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 259.70 MB (272313401) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s903ms - NumBatchesAccepted: 13.11K (13114) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s437ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37013392) - RowsReturnedRate: 307.40 K/sec RecvrSide: BytesReceived(16s000ms): 6.41 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.58 MB, 125.00 MB, 390.29 MB, 505.02 MB, 568.35 MB, 614.35 MB, 644.82 MB, 659.73 MB - FirstBatchArrivalWaitTime: 3s416ms - TotalBytesReceived: 664.16 MB (696427127) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s367ms - NumBatchesAccepted: 56.57K (56570) - NumBatchesRejected: 33 (33) Instance 5f429df048b5534b:41bcce1800000234 (host=foo.232.27:22000):(Total: 12m38s, non-child: 94.323ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.06 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.54 MB, 162.39 MB, 162.42 MB, 229.41 MB, 291.91 MB, 304.93 MB, 341.66 MB, 375.91 MB, 383.90 MB, 390.91 MB, 401.40 MB, 403.66 MB, 414.43 MB, 424.42 MB, 426.42 MB, 426.42 MB, 426.42 MB, 426.43 MB, 436.15 MB, 442.39 MB, 442.42 MB, 442.42 MB, 442.43 MB, 442.42 MB, 442.43 MB, 442.43 MB, 442.43 MB, 442.41 MB, 442.42 MB, 442.41 MB, 442.41 MB, 442.42 MB, 442.44 MB, 442.43 MB, 496.23 MB, 629.63 MB, 629.96 MB, 629.57 MB, 629.97 MB, 630.07 MB, 630.14 MB, 629.97 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.34 GB (1442870921) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 27.470ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.70K (3704) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s243ms - TotalThreadsUserTime: 9s529ms - TotalThreadsVoluntaryContextSwitches: 64.05K (64053) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m35s - PrepareTime: 56.669ms - ExecTreePrepareTime: 884.181us DataStreamSender (dst_id=26):(Total: 595.713us, non-child: 595.713us, % non-child: 100.00%) - BytesSent: 11.44 KB (11712) - OverallThroughput: 18.75 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 54 (54) - SerializeBatchTime: 448.930us - UncompressedRowBatchSize: 11.44 KB (11712) CodeGen:(Total: 651.217ms, non-child: 651.217ms, % non-child: 100.00%) - CodegenTime: 34.088ms - CompileTime: 191.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 433.718ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.683ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 666.466ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.089us - GetResultsTime: 134.018us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923607) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - StreamingTime: 653.447ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.875ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 945.734us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622874) - ProbeRows: 722 (722) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 465.361us - RowsReturned: 722 (722) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 241.033us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 296.163us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 201.962us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s203ms, non-child: 73.751us, % non-child: 0.00%) - ConvertRowBatchTime: 53.905us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 773.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s203ms - DataArrivalTimer: 2s203ms SenderSide: - DeserializeRowBatchTimer: 194.148us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.707ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 586.665us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566554) - ProbeRows: 722 (722) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 527.179us - RowsReturned: 722 (722) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.245us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 343.814us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.900us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 373.553ms, non-child: 29.832us, % non-child: 0.01%) - ConvertRowBatchTime: 8.740us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 733.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 373.537ms - DataArrivalTimer: 373.524ms SenderSide: - DeserializeRowBatchTimer: 96.047us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s676ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1455444) - BuildTime: 1s767ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.04M (37043830) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s674ms - RowsReturned: 722 (722) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s444ms - BuildRowsPartitioned: 1.46M (1455444) - GetNewBlockTime: 2.483ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.60K (3605) - HashTablesBuildTime: 310.094ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 203.838ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.742ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1455444) - RowsReturnedRate: 2.30 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.08 MB, 21.46 MB, 55.97 MB, 95.87 MB, 133.80 MB, 160.60 MB, 176.35 MB, 185.92 MB, 193.69 MB, 200.67 MB, 206.60 MB, 211.75 MB, 217.24 MB, 222.90 MB, 227.71 MB, 231.44 MB, 234.44 MB, 237.21 MB, 239.80 MB, 242.03 MB, 244.13 MB, 246.15 MB, 247.81 MB, 249.18 MB, 250.63 MB, 251.84 MB, 252.91 MB, 253.68 MB, 254.29 MB, 254.72 MB, 254.98 MB, 255.28 MB, 255.57 MB, 255.72 MB, 256.34 MB, 257.14 MB, 257.14 MB, 257.14 MB, 257.14 MB, 257.14 MB, 257.14 MB, 257.14 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 257.14 MB (269631958) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s938ms - NumBatchesAccepted: 13.06K (13063) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s453ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37043830) - RowsReturnedRate: 308.68 K/sec RecvrSide: BytesReceived(16s000ms): 6.46 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.70 MB, 126.02 MB, 391.52 MB, 505.67 MB, 569.07 MB, 615.00 MB, 645.50 MB, 660.35 MB - FirstBatchArrivalWaitTime: 3s311ms - TotalBytesReceived: 664.76 MB (697055353) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s362ms - NumBatchesAccepted: 56.62K (56623) - NumBatchesRejected: 47 (47) Instance 5f429df048b5534b:41bcce180000028e (host=foo.232.35:22000):(Total: 12m38s, non-child: 67.573ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.10 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 30.30 MB, 162.44 MB, 162.42 MB, 222.68 MB, 289.15 MB, 295.91 MB, 332.20 MB, 350.90 MB, 370.17 MB, 389.16 MB, 394.42 MB, 402.18 MB, 410.45 MB, 410.41 MB, 410.41 MB, 410.42 MB, 413.16 MB, 418.41 MB, 418.44 MB, 426.43 MB, 434.43 MB, 434.43 MB, 434.42 MB, 434.39 MB, 434.42 MB, 435.93 MB, 442.41 MB, 442.40 MB, 442.42 MB, 450.18 MB, 450.39 MB, 450.44 MB, 450.41 MB, 450.44 MB, 477.14 MB, 636.84 MB, 638.07 MB, 638.42 MB, 637.98 MB, 637.93 MB, 637.61 MB, 637.31 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 651.31 MB (682949462) - PerHostPeakMemUsage: 1.30 GB (1400725701) - RowsProduced: 58 (58) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 15.357ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.73K (3732) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s192ms - TotalThreadsUserTime: 9s341ms - TotalThreadsVoluntaryContextSwitches: 63.18K (63177) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 51.523ms - ExecTreePrepareTime: 663.496us DataStreamSender (dst_id=26):(Total: 816.321us, non-child: 816.321us, % non-child: 100.00%) - BytesSent: 11.52 KB (11800) - OverallThroughput: 13.79 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 58 (58) - SerializeBatchTime: 645.412us - UncompressedRowBatchSize: 11.52 KB (11800) CodeGen:(Total: 612.015ms, non-child: 612.015ms, % non-child: 100.00%) - CodegenTime: 14.952ms - CompileTime: 202.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 119 (119) - NumInstructions: 7.22K (7221) - OptimizationTime: 379.294ms - PeakMemoryUsage: 3.53 MB (3697152) - PrepareTime: 29.983ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 639.919ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 84.984us - GetResultsTime: 145.854us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919515) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 58 (58) - RowsReturnedRate: 0 - StreamingTime: 626.482ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m37s, non-child: 2.116ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 869.737us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619611) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.459us - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 129.499us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 469.095us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.515us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s543ms, non-child: 56.062us, % non-child: 0.00%) - ConvertRowBatchTime: 32.960us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s543ms - DataArrivalTimer: 1s543ms SenderSide: - DeserializeRowBatchTimer: 164.733us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m37s, non-child: 7.126ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 784.128us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563291) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 167.386us - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 96.693us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 415.948us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.993us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 258.556ms, non-child: 17.055us, % non-child: 0.01%) - ConvertRowBatchTime: 7.971us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.06 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 258.542ms - DataArrivalTimer: 258.539ms SenderSide: - DeserializeRowBatchTimer: 25.955us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s535ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1404218) - BuildTime: 1s648ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 36.93M (36925978) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s658ms - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s370ms - BuildRowsPartitioned: 1.40M (1404218) - GetNewBlockTime: 2.304ms - HashBuckets: 3.15M (3145728) - HashCollisions: 4.48K (4479) - HashTablesBuildTime: 267.738ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m36s, non-child: 191.995ms, % non-child: 0.03%) - ConvertRowBatchTime: 89.233ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1404218) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.03 MB, 20.89 MB, 54.43 MB, 93.03 MB, 129.55 MB, 155.30 MB, 170.36 MB, 179.49 MB, 186.90 MB, 193.43 MB, 199.00 MB, 203.96 MB, 209.26 MB, 214.66 MB, 219.21 MB, 222.77 MB, 225.64 MB, 228.40 MB, 230.98 MB, 233.27 MB, 235.36 MB, 237.41 MB, 238.90 MB, 240.37 MB, 241.72 MB, 243.00 MB, 244.06 MB, 244.89 MB, 245.47 MB, 245.91 MB, 246.31 MB, 246.68 MB, 246.93 MB, 247.06 MB, 247.59 MB, 248.42 MB, 248.42 MB, 248.42 MB, 248.42 MB, 248.42 MB, 248.42 MB, 248.42 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 248.42 MB (260482856) - TotalGetBatchTime: 10m36s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s757ms - NumBatchesAccepted: 12.60K (12604) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s424ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s059ms - PeakMemoryUsage: 0 - RowsReturned: 36.93M (36925978) - RowsReturnedRate: 314.22 K/sec RecvrSide: BytesReceived(16s000ms): 6.48 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.62 MB, 125.82 MB, 390.46 MB, 504.17 MB, 567.32 MB, 613.12 MB, 643.52 MB, 658.29 MB - FirstBatchArrivalWaitTime: 3s192ms - TotalBytesReceived: 662.68 MB (694869855) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s320ms - NumBatchesAccepted: 56.44K (56436) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce180000021d (host=foo.232.28:22000):(Total: 12m38s, non-child: 219.215ms, % non-child: 0.03%) MemoryUsage(16s000ms): 14.76 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 31.03 MB, 162.41 MB, 162.38 MB, 241.93 MB, 291.65 MB, 318.15 MB, 359.65 MB, 383.39 MB, 403.89 MB, 417.89 MB, 418.39 MB, 418.40 MB, 424.91 MB, 426.39 MB, 427.88 MB, 434.40 MB, 434.38 MB, 434.41 MB, 442.39 MB, 442.40 MB, 442.40 MB, 446.64 MB, 450.39 MB, 451.40 MB, 458.42 MB, 473.40 MB, 481.64 MB, 482.40 MB, 482.40 MB, 482.37 MB, 482.38 MB, 482.37 MB, 482.46 MB, 482.49 MB, 539.71 MB, 663.81 MB, 663.99 MB, 663.65 MB, 664.11 MB, 663.87 MB, 663.76 MB, 663.89 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 677.28 MB (710182471) - PerHostPeakMemUsage: 1.43 GB (1534517528) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 165.406ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.61K (3612) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s187ms - TotalThreadsUserTime: 8s934ms - TotalThreadsVoluntaryContextSwitches: 65.53K (65527) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 41.734ms - ExecTreePrepareTime: 704.195us DataStreamSender (dst_id=26):(Total: 593.239us, non-child: 593.239us, % non-child: 100.00%) - BytesSent: 8.96 KB (9172) - OverallThroughput: 14.74 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 45 (45) - SerializeBatchTime: 383.143us - UncompressedRowBatchSize: 8.96 KB (9172) CodeGen:(Total: 638.089ms, non-child: 638.089ms, % non-child: 100.00%) - CodegenTime: 14.197ms - CompileTime: 214.332ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 401.722ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 21.492ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 656.304ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 54.893us - GetResultsTime: 177.630us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925307) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 644.870ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.703ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 838.608us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621307) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 102.915us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 96.909us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 535.582us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 150.841us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s212ms, non-child: 36.251us, % non-child: 0.00%) - ConvertRowBatchTime: 21.910us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 770.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s212ms - DataArrivalTimer: 2s212ms SenderSide: - DeserializeRowBatchTimer: 206.491us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.098ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 503.192us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564987) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.642us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.228us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 213.221us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.454us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 277.666ms, non-child: 19.545us, % non-child: 0.01%) - ConvertRowBatchTime: 8.352us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 986.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 277.651ms - DataArrivalTimer: 277.647ms SenderSide: - DeserializeRowBatchTimer: 54.006us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s298ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.50M (1501806) - BuildTime: 1s827ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 652.13 MB (683807716) - ProbeRows: 37.20M (37199064) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s257ms - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s523ms - BuildRowsPartitioned: 1.50M (1501806) - GetNewBlockTime: 3.118ms - HashBuckets: 3.80M (3801088) - HashCollisions: 4.40K (4396) - HashTablesBuildTime: 291.707ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 652.06 MB (683735168) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 213.145ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.539ms - PeakMemoryUsage: 0 - RowsReturned: 1.50M (1501806) - RowsReturnedRate: 2.37 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.05 MB, 22.33 MB, 58.20 MB, 99.76 MB, 139.24 MB, 167.43 MB, 184.17 MB, 193.94 MB, 201.76 MB, 208.77 MB, 214.72 MB, 219.91 MB, 225.44 MB, 231.13 MB, 235.96 MB, 239.80 MB, 242.84 MB, 245.65 MB, 248.34 MB, 250.66 MB, 252.69 MB, 254.76 MB, 256.40 MB, 257.82 MB, 259.25 MB, 260.59 MB, 261.75 MB, 262.52 MB, 263.11 MB, 263.54 MB, 263.84 MB, 264.26 MB, 264.53 MB, 264.55 MB, 265.06 MB, 265.90 MB, 265.90 MB, 265.90 MB, 265.90 MB, 265.90 MB, 265.90 MB, 265.90 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 265.90 MB (278818338) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s111ms - NumBatchesAccepted: 13.47K (13471) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s365ms, % non-child: 1.13%) - ConvertRowBatchTime: 1s005ms - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37199064) - RowsReturnedRate: 307.71 K/sec RecvrSide: BytesReceived(16s000ms): 6.35 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.51 MB, 124.10 MB, 390.42 MB, 506.99 MB, 570.82 MB, 617.26 MB, 648.02 MB, 663.11 MB - FirstBatchArrivalWaitTime: 3s210ms - TotalBytesReceived: 667.60 MB (700034448) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s957ms - NumBatchesAccepted: 56.85K (56852) - NumBatchesRejected: 46 (46) Instance 5f429df048b5534b:41bcce1800000235 (host=foo.232.30:22000):(Total: 12m38s, non-child: 199.930ms, % non-child: 0.03%) MemoryUsage(16s000ms): 15.07 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.30 MB, 162.43 MB, 162.41 MB, 225.42 MB, 290.39 MB, 299.43 MB, 319.17 MB, 363.18 MB, 390.38 MB, 398.15 MB, 412.17 MB, 418.42 MB, 418.42 MB, 418.41 MB, 418.43 MB, 418.42 MB, 418.42 MB, 424.17 MB, 426.40 MB, 426.42 MB, 426.42 MB, 427.15 MB, 434.39 MB, 434.41 MB, 434.43 MB, 440.65 MB, 442.39 MB, 442.40 MB, 442.43 MB, 442.42 MB, 442.44 MB, 442.39 MB, 442.35 MB, 442.42 MB, 493.70 MB, 617.79 MB, 617.00 MB, 618.11 MB, 617.94 MB, 617.56 MB, 618.36 MB, 618.36 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.40 GB (1502874196) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 18.421ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.69K (3690) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s191ms - TotalThreadsUserTime: 8s813ms - TotalThreadsVoluntaryContextSwitches: 63.87K (63867) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 44.117ms - ExecTreePrepareTime: 924.659us DataStreamSender (dst_id=26):(Total: 434.192us, non-child: 434.192us, % non-child: 100.00%) - BytesSent: 9.93 KB (10171) - OverallThroughput: 22.34 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 50 (50) - SerializeBatchTime: 335.338us - UncompressedRowBatchSize: 9.93 KB (10171) CodeGen:(Total: 643.595ms, non-child: 643.595ms, % non-child: 100.00%) - CodegenTime: 16.073ms - CompileTime: 208.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 412.766ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 22.017ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 607.186ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.524us - GetResultsTime: 123.020us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919807) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 596.309ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.142ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 990.737us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624132) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.053us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 138.699us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 494.611us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.862us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 862.805ms, non-child: 70.382us, % non-child: 0.01%) - ConvertRowBatchTime: 51.998us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.97 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 862.744ms - DataArrivalTimer: 862.735ms SenderSide: - DeserializeRowBatchTimer: 342.478us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 16.930ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 795.003us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567812) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 122.784us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.382us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 404.453us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.682us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 253.051ms, non-child: 32.103us, % non-child: 0.01%) - ConvertRowBatchTime: 8.232us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.08 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 253.036ms - DataArrivalTimer: 253.020ms SenderSide: - DeserializeRowBatchTimer: 57.857us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s139ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1432580) - BuildTime: 1s701ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635572480) - ProbeRows: 37.07M (37066144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s241ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s443ms - BuildRowsPartitioned: 1.43M (1432580) - GetNewBlockTime: 3.115ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.90K (3896) - HashTablesBuildTime: 246.278ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 199.770ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.925ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1432580) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.07 MB, 21.13 MB, 54.82 MB, 94.04 MB, 131.03 MB, 157.64 MB, 173.74 MB, 183.13 MB, 190.83 MB, 197.51 MB, 203.18 MB, 208.18 MB, 213.47 MB, 218.94 MB, 223.58 MB, 227.16 MB, 230.08 MB, 232.84 MB, 235.41 MB, 237.68 MB, 239.75 MB, 241.69 MB, 243.25 MB, 244.57 MB, 245.96 MB, 247.15 MB, 248.28 MB, 249.03 MB, 249.64 MB, 250.13 MB, 250.44 MB, 250.80 MB, 250.99 MB, 251.03 MB, 251.61 MB, 252.45 MB, 252.45 MB, 252.45 MB, 252.45 MB, 252.45 MB, 252.45 MB, 252.45 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.45 MB (264710902) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s714ms - NumBatchesAccepted: 12.86K (12856) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s337ms, % non-child: 1.11%) - ConvertRowBatchTime: 999.208ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37066144) - RowsReturnedRate: 307.75 K/sec RecvrSide: BytesReceived(16s000ms): 6.47 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.79 MB, 126.54 MB, 392.28 MB, 506.17 MB, 569.50 MB, 615.43 MB, 645.91 MB, 660.71 MB - FirstBatchArrivalWaitTime: 3s171ms - TotalBytesReceived: 665.11 MB (697420612) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s840ms - NumBatchesAccepted: 56.66K (56657) - NumBatchesRejected: 41 (41) Instance 5f429df048b5534b:41bcce1800000252 (host=foo.232.19:22000):(Total: 12m38s, non-child: 177.899ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.81 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 27.55 MB, 162.43 MB, 162.42 MB, 211.91 MB, 290.16 MB, 290.42 MB, 306.66 MB, 345.17 MB, 365.91 MB, 388.17 MB, 394.41 MB, 395.93 MB, 402.41 MB, 407.42 MB, 414.40 MB, 418.41 MB, 418.40 MB, 418.42 MB, 418.42 MB, 418.43 MB, 418.42 MB, 418.43 MB, 418.43 MB, 418.43 MB, 418.41 MB, 424.18 MB, 426.42 MB, 426.41 MB, 426.42 MB, 426.41 MB, 426.45 MB, 426.40 MB, 426.42 MB, 426.45 MB, 460.12 MB, 605.80 MB, 606.31 MB, 605.41 MB, 605.61 MB, 606.00 MB, 606.23 MB, 606.00 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 619.30 MB (649386678) - PerHostPeakMemUsage: 1.36 GB (1462073058) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 14.865ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.59K (3589) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s265ms - TotalThreadsUserTime: 9s441ms - TotalThreadsVoluntaryContextSwitches: 63.64K (63638) Fragment Instance Lifecycle Timings: - ExecTime: 1m56s - ExecTreeExecTime: 1m56s - OpenTime: 10m41s - ExecTreeOpenTime: 10m40s - PrepareTime: 44.454ms - ExecTreePrepareTime: 718.169us DataStreamSender (dst_id=26):(Total: 583.029us, non-child: 583.029us, % non-child: 100.00%) - BytesSent: 9.66 KB (9894) - OverallThroughput: 16.18 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 47 (47) - SerializeBatchTime: 465.200us - UncompressedRowBatchSize: 9.66 KB (9894) CodeGen:(Total: 600.191ms, non-child: 600.191ms, % non-child: 100.00%) - CodegenTime: 14.277ms - CompileTime: 199.532ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 376.125ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.077ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 663.200ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.885us - GetResultsTime: 122.289us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 650.821ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.310ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.300ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619832) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 140.932us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 293.839us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 536.559us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 266.183us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 420.579ms, non-child: 70.647us, % non-child: 0.02%) - ConvertRowBatchTime: 48.002us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 4.05 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 420.517ms - DataArrivalTimer: 420.509ms SenderSide: - DeserializeRowBatchTimer: 182.160us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 38.884ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 680.066us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563512) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 166.129us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 70.236us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 407.969us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.838us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 378.107ms, non-child: 21.339us, % non-child: 0.01%) - ConvertRowBatchTime: 9.542us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 724.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 378.090ms - DataArrivalTimer: 378.086ms SenderSide: - DeserializeRowBatchTimer: 39.658us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s744ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.38M (1376869) - BuildTime: 1s719ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 594.13 MB (622989568) - ProbeRows: 37.03M (37029397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s808ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s431ms - BuildRowsPartitioned: 1.38M (1376869) - GetNewBlockTime: 51.289ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.24K (3243) - HashTablesBuildTime: 275.575ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 594.06 MB (622917760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 194.529ms, % non-child: 0.03%) - ConvertRowBatchTime: 90.066ms - PeakMemoryUsage: 0 - RowsReturned: 1.38M (1376869) - RowsReturnedRate: 2.17 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 941.63 KB, 20.02 MB, 52.41 MB, 90.07 MB, 125.65 MB, 150.63 MB, 165.93 MB, 175.13 MB, 182.59 MB, 189.24 MB, 194.91 MB, 199.87 MB, 205.06 MB, 210.39 MB, 215.01 MB, 218.67 MB, 221.56 MB, 224.26 MB, 226.81 MB, 229.07 MB, 231.17 MB, 233.23 MB, 234.84 MB, 236.36 MB, 237.82 MB, 239.06 MB, 240.29 MB, 241.14 MB, 241.80 MB, 242.31 MB, 242.67 MB, 243.01 MB, 243.26 MB, 243.33 MB, 243.84 MB, 244.68 MB, 244.68 MB, 244.68 MB, 244.68 MB, 244.68 MB, 244.68 MB, 244.68 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 244.68 MB (256565507) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s742ms - NumBatchesAccepted: 12.36K (12357) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s445ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s070ms - PeakMemoryUsage: 0 - RowsReturned: 37.03M (37029397) - RowsReturnedRate: 313.54 K/sec RecvrSide: BytesReceived(16s000ms): 6.38 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.41 MB, 124.09 MB, 389.29 MB, 504.88 MB, 568.33 MB, 614.48 MB, 645.11 MB, 660.10 MB - FirstBatchArrivalWaitTime: 3s216ms - TotalBytesReceived: 664.55 MB (696826782) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s578ms - NumBatchesAccepted: 56.60K (56600) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce1800000221 (host=foo.232.29:22000):(Total: 12m38s, non-child: 220.282ms, % non-child: 0.03%) MemoryUsage(16s000ms): 15.34 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.05 MB, 162.40 MB, 162.41 MB, 220.42 MB, 287.68 MB, 304.42 MB, 338.17 MB, 349.94 MB, 365.42 MB, 378.40 MB, 386.41 MB, 393.67 MB, 396.43 MB, 402.43 MB, 404.63 MB, 410.41 MB, 418.41 MB, 418.42 MB, 420.40 MB, 426.42 MB, 426.42 MB, 431.66 MB, 434.40 MB, 436.92 MB, 447.40 MB, 450.40 MB, 458.15 MB, 458.41 MB, 458.39 MB, 458.41 MB, 458.40 MB, 458.41 MB, 458.40 MB, 458.42 MB, 515.49 MB, 632.95 MB, 632.07 MB, 632.14 MB, 631.97 MB, 631.42 MB, 631.95 MB, 631.74 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.40 GB (1507296406) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 157.319ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.46K (3462) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s203ms - TotalThreadsUserTime: 8s844ms - TotalThreadsVoluntaryContextSwitches: 63.99K (63990) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 59.957ms - ExecTreePrepareTime: 611.179us DataStreamSender (dst_id=26):(Total: 726.095us, non-child: 726.095us, % non-child: 100.00%) - BytesSent: 10.98 KB (11239) - OverallThroughput: 14.76 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 50 (50) - SerializeBatchTime: 619.465us - UncompressedRowBatchSize: 10.98 KB (11239) CodeGen:(Total: 680.504ms, non-child: 680.504ms, % non-child: 100.00%) - CodegenTime: 23.825ms - CompileTime: 222.027ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 424.515ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.295ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 666.851ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.496us - GetResultsTime: 105.737us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927449) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 654.991ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.208ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.045ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9627545) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.279us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 195.184us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 434.020us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 204.401us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s426ms, non-child: 70.124us, % non-child: 0.00%) - ConvertRowBatchTime: 47.941us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.19 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s426ms - DataArrivalTimer: 1s425ms SenderSide: - DeserializeRowBatchTimer: 185.994us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 5.844ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 760.565us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9571225) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 122.806us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 59.945us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 354.733us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 113.922us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 181.224ms, non-child: 20.117us, % non-child: 0.01%) - ConvertRowBatchTime: 8.887us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.51 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 181.207ms - DataArrivalTimer: 181.204ms SenderSide: - DeserializeRowBatchTimer: 132.620us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s247ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1398225) - BuildTime: 1s693ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 37.00M (37004942) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s345ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s423ms - BuildRowsPartitioned: 1.40M (1398225) - GetNewBlockTime: 2.934ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.91K (2908) - HashTablesBuildTime: 262.359ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 200.116ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.334ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1398225) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.14 MB, 20.92 MB, 53.99 MB, 92.62 MB, 129.00 MB, 154.70 MB, 170.14 MB, 179.12 MB, 186.38 MB, 192.82 MB, 198.26 MB, 203.06 MB, 208.17 MB, 213.36 MB, 217.74 MB, 221.22 MB, 224.04 MB, 226.68 MB, 229.18 MB, 231.39 MB, 233.44 MB, 235.43 MB, 237.05 MB, 238.46 MB, 239.89 MB, 241.23 MB, 242.48 MB, 243.30 MB, 244.00 MB, 244.49 MB, 244.90 MB, 245.23 MB, 245.45 MB, 245.53 MB, 246.13 MB, 246.96 MB, 246.96 MB, 246.96 MB, 246.96 MB, 246.96 MB, 246.96 MB, 246.96 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 246.96 MB (258954172) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s770ms - NumBatchesAccepted: 12.54K (12545) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s375ms, % non-child: 1.14%) - ConvertRowBatchTime: 1s021ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (37004942) - RowsReturnedRate: 307.13 K/sec RecvrSide: BytesReceived(16s000ms): 6.62 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.14 MB, 129.33 MB, 395.00 MB, 506.46 MB, 569.44 MB, 615.06 MB, 645.34 MB, 659.81 MB - FirstBatchArrivalWaitTime: 3s123ms - TotalBytesReceived: 664.11 MB (696365385) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 4s089ms - NumBatchesAccepted: 56.56K (56564) - NumBatchesRejected: 35 (35) Instance 5f429df048b5534b:41bcce1800000246 (host=foo.232.33:22000):(Total: 12m38s, non-child: 178.339ms, % non-child: 0.02%) MemoryUsage(16s000ms): 14.97 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.04 MB, 162.43 MB, 162.44 MB, 233.91 MB, 290.42 MB, 306.43 MB, 355.68 MB, 377.40 MB, 378.40 MB, 386.65 MB, 405.91 MB, 418.40 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.43 MB, 418.41 MB, 418.42 MB, 425.67 MB, 434.41 MB, 439.68 MB, 442.42 MB, 444.16 MB, 450.40 MB, 457.41 MB, 458.44 MB, 458.41 MB, 458.43 MB, 458.39 MB, 458.42 MB, 458.40 MB, 458.42 MB, 458.38 MB, 458.40 MB, 497.23 MB, 634.93 MB, 636.11 MB, 636.23 MB, 635.72 MB, 635.64 MB, 635.51 MB, 635.43 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.30 MB (680843958) - PerHostPeakMemUsage: 1.43 GB (1538772744) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 108.286ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.51K (3507) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s194ms - TotalThreadsUserTime: 8s728ms - TotalThreadsVoluntaryContextSwitches: 64.31K (64313) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m36s - ExecTreeOpenTime: 10m36s - PrepareTime: 47.971ms - ExecTreePrepareTime: 905.224us DataStreamSender (dst_id=26):(Total: 708.473us, non-child: 708.473us, % non-child: 100.00%) - BytesSent: 10.30 KB (10548) - OverallThroughput: 14.20 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 49 (49) - SerializeBatchTime: 514.057us - UncompressedRowBatchSize: 10.30 KB (10548) CodeGen:(Total: 697.421ms, non-child: 697.421ms, % non-child: 100.00%) - CodegenTime: 15.895ms - CompileTime: 226.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 445.285ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.439ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 616.689ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 72.040us - GetResultsTime: 105.699us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9929270) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - StreamingTime: 605.929ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.369ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 790.126us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9625270) - ProbeRows: 1.33K (1326) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 560.954us - RowsReturned: 1.33K (1326) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 123.593us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 413.439us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 172.576us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 532.767ms, non-child: 48.637us, % non-child: 0.01%) - ConvertRowBatchTime: 24.195us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 3.20 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 532.734ms - DataArrivalTimer: 532.719ms SenderSide: - DeserializeRowBatchTimer: 187.770us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.650ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 620.667us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9568950) - ProbeRows: 1.33K (1326) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 724.437us - RowsReturned: 1.33K (1326) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.603us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 346.907us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.601us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 163.639ms, non-child: 17.233us, % non-child: 0.01%) - ConvertRowBatchTime: 8.209us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.67 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 163.625ms - DataArrivalTimer: 163.623ms SenderSide: - DeserializeRowBatchTimer: 31.879us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s126ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1446558) - BuildTime: 1s782ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654446848) - ProbeRows: 36.92M (36916406) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s143ms - RowsReturned: 1.33K (1326) - RowsReturnedRate: 1.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s498ms - BuildRowsPartitioned: 1.45M (1446558) - GetNewBlockTime: 3.574ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.48K (3484) - HashTablesBuildTime: 271.933ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 205.470ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.451ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1446558) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.10 MB, 21.75 MB, 56.37 MB, 96.67 MB, 134.83 MB, 161.62 MB, 177.00 MB, 186.40 MB, 194.00 MB, 200.75 MB, 206.50 MB, 211.54 MB, 216.98 MB, 222.55 MB, 227.26 MB, 230.91 MB, 233.92 MB, 236.73 MB, 239.41 MB, 241.79 MB, 243.92 MB, 245.92 MB, 247.48 MB, 248.93 MB, 250.21 MB, 251.49 MB, 252.50 MB, 253.23 MB, 253.83 MB, 254.31 MB, 254.62 MB, 254.98 MB, 255.22 MB, 255.34 MB, 255.92 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB, 256.78 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 256.78 MB (269250119) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s961ms - NumBatchesAccepted: 12.98K (12978) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s316ms, % non-child: 1.10%) - ConvertRowBatchTime: 977.479ms - PeakMemoryUsage: 0 - RowsReturned: 36.92M (36916406) - RowsReturnedRate: 309.29 K/sec RecvrSide: BytesReceived(16s000ms): 6.47 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.71 MB, 125.90 MB, 390.52 MB, 504.10 MB, 567.22 MB, 613.01 MB, 643.37 MB, 658.13 MB - FirstBatchArrivalWaitTime: 3s087ms - TotalBytesReceived: 662.52 MB (694703631) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 3s961ms - NumBatchesAccepted: 56.44K (56436) - NumBatchesRejected: 47 (47) Instance 5f429df048b5534b:41bcce1800000275 (host=foo.232.21:22000):(Total: 12m38s, non-child: 121.440ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.15 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 31.52 MB, 162.38 MB, 162.41 MB, 232.42 MB, 290.40 MB, 302.38 MB, 344.42 MB, 382.89 MB, 388.90 MB, 395.66 MB, 410.39 MB, 415.13 MB, 418.40 MB, 418.41 MB, 418.37 MB, 418.39 MB, 418.39 MB, 425.13 MB, 426.40 MB, 428.38 MB, 434.40 MB, 441.65 MB, 443.40 MB, 450.40 MB, 450.40 MB, 450.40 MB, 450.39 MB, 450.38 MB, 450.38 MB, 450.38 MB, 450.35 MB, 450.43 MB, 450.38 MB, 450.43 MB, 480.92 MB, 637.84 MB, 637.88 MB, 638.12 MB, 637.75 MB, 637.98 MB, 638.14 MB, 637.79 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.28 MB (682919495) - PerHostPeakMemUsage: 1.39 GB (1494598744) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 14.469ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.72K (3717) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s225ms - TotalThreadsUserTime: 8s940ms - TotalThreadsVoluntaryContextSwitches: 64.75K (64752) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.063ms - ExecTreePrepareTime: 801.953us DataStreamSender (dst_id=26):(Total: 547.604us, non-child: 547.604us, % non-child: 100.00%) - BytesSent: 10.76 KB (11022) - OverallThroughput: 19.20 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 49 (49) - SerializeBatchTime: 413.827us - UncompressedRowBatchSize: 10.76 KB (11022) CodeGen:(Total: 606.763ms, non-child: 606.763ms, % non-child: 100.00%) - CodegenTime: 16.015ms - CompileTime: 198.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 381.211ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.114ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 686.954ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.828us - GetResultsTime: 129.574us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916586) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - StreamingTime: 673.222ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.030ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 869.558us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9620778) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.736us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 145.376us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 448.298us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.435us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s233ms, non-child: 84.536us, % non-child: 0.00%) - ConvertRowBatchTime: 53.609us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 762.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s233ms - DataArrivalTimer: 2s233ms SenderSide: - DeserializeRowBatchTimer: 164.998us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 4.826ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 631.641us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564458) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 146.084us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.352us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 381.724us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.013us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 261.224ms, non-child: 37.145us, % non-child: 0.01%) - ConvertRowBatchTime: 27.627us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.05 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 261.190ms - DataArrivalTimer: 261.187ms SenderSide: - DeserializeRowBatchTimer: 104.799us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s374ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1448643) - BuildTime: 1s728ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 37.01M (37005734) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s437ms - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s431ms - BuildRowsPartitioned: 1.45M (1448643) - GetNewBlockTime: 3.043ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.12K (4119) - HashTablesBuildTime: 283.903ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 202.094ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.889ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1448643) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.10 MB, 21.70 MB, 56.27 MB, 96.19 MB, 133.88 MB, 161.03 MB, 177.08 MB, 186.55 MB, 194.25 MB, 201.04 MB, 206.86 MB, 211.95 MB, 217.30 MB, 222.84 MB, 227.52 MB, 231.20 MB, 234.15 MB, 236.88 MB, 239.42 MB, 241.67 MB, 243.72 MB, 245.57 MB, 247.09 MB, 248.45 MB, 249.79 MB, 251.03 MB, 252.10 MB, 252.83 MB, 253.38 MB, 253.85 MB, 254.16 MB, 254.47 MB, 254.57 MB, 254.65 MB, 255.20 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB, 256.06 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 256.06 MB (268494317) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s674ms - NumBatchesAccepted: 13.00K (12999) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s360ms, % non-child: 1.15%) - ConvertRowBatchTime: 1s017ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37005734) - RowsReturnedRate: 313.64 K/sec RecvrSide: BytesReceived(16s000ms): 6.52 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.79 MB, 127.00 MB, 392.46 MB, 505.71 MB, 568.90 MB, 614.75 MB, 645.16 MB, 659.88 MB - FirstBatchArrivalWaitTime: 3s193ms - TotalBytesReceived: 664.25 MB (696520754) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s089ms - NumBatchesAccepted: 56.56K (56563) - NumBatchesRejected: 76 (76) Instance 5f429df048b5534b:41bcce1800000228 (host=foo.232.31:22000):(Total: 12m38s, non-child: 182.756ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.22 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 30.30 MB, 162.40 MB, 162.42 MB, 227.96 MB, 290.42 MB, 291.42 MB, 326.15 MB, 371.68 MB, 392.92 MB, 397.90 MB, 407.42 MB, 410.43 MB, 410.41 MB, 414.16 MB, 418.41 MB, 418.40 MB, 418.43 MB, 418.39 MB, 418.43 MB, 418.41 MB, 418.42 MB, 418.41 MB, 418.42 MB, 418.43 MB, 422.69 MB, 434.15 MB, 434.41 MB, 434.43 MB, 434.41 MB, 440.46 MB, 442.37 MB, 442.44 MB, 442.37 MB, 442.42 MB, 497.77 MB, 618.32 MB, 618.00 MB, 618.09 MB, 617.70 MB, 617.98 MB, 617.88 MB, 617.34 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.42 GB (1528772547) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 122.137ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.64K (3644) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s217ms - TotalThreadsUserTime: 8s907ms - TotalThreadsVoluntaryContextSwitches: 64.03K (64027) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 53.782ms - ExecTreePrepareTime: 940.550us DataStreamSender (dst_id=26):(Total: 397.985us, non-child: 397.985us, % non-child: 100.00%) - BytesSent: 10.66 KB (10917) - OverallThroughput: 26.16 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 50 (50) - SerializeBatchTime: 294.493us - UncompressedRowBatchSize: 10.66 KB (10917) CodeGen:(Total: 612.885ms, non-child: 612.885ms, % non-child: 100.00%) - CodegenTime: 21.983ms - CompileTime: 199.688ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 384.929ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.758ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 645.277ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 46.627us - GetResultsTime: 108.396us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 9 (9) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924157) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 633.185ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.100ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.341ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620157) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 113.623us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 158.214us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 611.462us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 214.949us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s520ms, non-child: 73.262us, % non-child: 0.00%) - ConvertRowBatchTime: 48.920us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.12 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s520ms - DataArrivalTimer: 1s520ms SenderSide: - DeserializeRowBatchTimer: 261.952us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.028ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 891.268us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563837) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.430us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.417us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 443.199us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.716us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 248.486ms, non-child: 18.173us, % non-child: 0.01%) - ConvertRowBatchTime: 8.000us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 248.471ms - DataArrivalTimer: 248.468ms SenderSide: - DeserializeRowBatchTimer: 148.603us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s327ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1413119) - BuildTime: 1s770ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635572970) - ProbeRows: 37.28M (37277964) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s348ms - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s481ms - BuildRowsPartitioned: 1.41M (1413119) - GetNewBlockTime: 3.117ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.84K (4842) - HashTablesBuildTime: 276.187ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 207.619ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.802ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1413119) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.07 MB, 21.18 MB, 55.19 MB, 94.49 MB, 131.39 MB, 157.56 MB, 173.05 MB, 182.35 MB, 189.97 MB, 196.61 MB, 202.30 MB, 207.27 MB, 212.59 MB, 217.95 MB, 222.60 MB, 226.22 MB, 229.13 MB, 231.93 MB, 234.41 MB, 236.57 MB, 238.55 MB, 240.50 MB, 241.93 MB, 243.36 MB, 244.63 MB, 245.97 MB, 246.89 MB, 247.82 MB, 248.46 MB, 248.85 MB, 249.21 MB, 249.58 MB, 249.84 MB, 249.93 MB, 250.53 MB, 251.35 MB, 251.35 MB, 251.35 MB, 251.35 MB, 251.35 MB, 251.35 MB, 251.35 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 251.35 MB (263556549) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s009ms - NumBatchesAccepted: 12.68K (12679) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s381ms, % non-child: 1.15%) - ConvertRowBatchTime: 1s020ms - PeakMemoryUsage: 0 - RowsReturned: 37.28M (37277964) - RowsReturnedRate: 309.26 K/sec RecvrSide: BytesReceived(16s000ms): 6.55 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.01 MB, 128.43 MB, 395.80 MB, 509.52 MB, 573.08 MB, 619.13 MB, 649.71 MB, 664.48 MB - FirstBatchArrivalWaitTime: 3s172ms - TotalBytesReceived: 668.87 MB (701359704) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s859ms - NumBatchesAccepted: 56.98K (56978) - NumBatchesRejected: 53 (53) Instance 5f429df048b5534b:41bcce1800000251 (host=foo.232.14:22000):(Total: 12m38s, non-child: 68.449ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.19 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.29 MB, 162.42 MB, 162.42 MB, 228.15 MB, 290.41 MB, 307.67 MB, 342.42 MB, 371.13 MB, 381.42 MB, 393.18 MB, 398.91 MB, 407.16 MB, 410.43 MB, 416.90 MB, 424.17 MB, 426.42 MB, 426.40 MB, 426.38 MB, 426.42 MB, 432.15 MB, 438.93 MB, 442.41 MB, 442.43 MB, 449.67 MB, 450.41 MB, 450.41 MB, 450.42 MB, 450.41 MB, 456.89 MB, 458.41 MB, 458.40 MB, 458.40 MB, 458.43 MB, 458.43 MB, 497.49 MB, 642.10 MB, 641.48 MB, 642.07 MB, 642.08 MB, 641.83 MB, 642.06 MB, 642.20 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 655.30 MB (687135414) - PerHostPeakMemUsage: 1.35 GB (1446295791) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 13.098ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.52K (3522) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s232ms - TotalThreadsUserTime: 9s563ms - TotalThreadsVoluntaryContextSwitches: 64.27K (64268) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 53.994ms - ExecTreePrepareTime: 1.135ms DataStreamSender (dst_id=26):(Total: 539.278us, non-child: 539.278us, % non-child: 100.00%) - BytesSent: 10.41 KB (10657) - OverallThroughput: 18.85 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 45 (45) - SerializeBatchTime: 396.598us - UncompressedRowBatchSize: 10.41 KB (10657) CodeGen:(Total: 649.010ms, non-child: 649.010ms, % non-child: 100.00%) - CodegenTime: 15.938ms - CompileTime: 195.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 422.937ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.225ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 672.497ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 49.439us - GetResultsTime: 144.604us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916311) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 658.857ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.509ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 996.256us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.702us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 167.717us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 504.024us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 154.252us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s042ms, non-child: 66.428us, % non-child: 0.00%) - ConvertRowBatchTime: 44.560us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 834.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s042ms - DataArrivalTimer: 2s042ms SenderSide: - DeserializeRowBatchTimer: 387.484us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.519ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 534.738us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 140.647us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.172us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 350.823us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.206us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 271.025ms, non-child: 20.061us, % non-child: 0.01%) - ConvertRowBatchTime: 8.249us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.01 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 271.009ms - DataArrivalTimer: 271.006ms SenderSide: - DeserializeRowBatchTimer: 106.182us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s778ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1440951) - BuildTime: 1s740ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 630.13 MB (660738304) - ProbeRows: 37.04M (37042077) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s809ms - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s437ms - BuildRowsPartitioned: 1.44M (1440951) - GetNewBlockTime: 3.137ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.88K (3882) - HashTablesBuildTime: 290.464ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 630.06 MB (660666496) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 204.202ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.365ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1440951) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.12 MB, 21.54 MB, 55.68 MB, 95.28 MB, 132.70 MB, 159.71 MB, 175.78 MB, 185.14 MB, 192.81 MB, 199.56 MB, 205.22 MB, 210.26 MB, 215.52 MB, 220.87 MB, 225.41 MB, 229.00 MB, 231.94 MB, 234.68 MB, 237.26 MB, 239.59 MB, 241.67 MB, 243.68 MB, 245.24 MB, 246.87 MB, 248.26 MB, 249.69 MB, 250.66 MB, 251.63 MB, 252.32 MB, 252.64 MB, 252.89 MB, 253.30 MB, 253.62 MB, 253.75 MB, 254.36 MB, 255.14 MB, 255.14 MB, 255.14 MB, 255.14 MB, 255.14 MB, 255.14 MB, 255.14 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.14 MB (267530034) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s964ms - NumBatchesAccepted: 12.93K (12931) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s442ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s071ms - PeakMemoryUsage: 0 - RowsReturned: 37.04M (37042077) - RowsReturnedRate: 313.07 K/sec RecvrSide: BytesReceived(16s000ms): 6.54 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.85 MB, 127.35 MB, 393.01 MB, 506.14 MB, 569.42 MB, 615.27 MB, 645.71 MB, 660.42 MB - FirstBatchArrivalWaitTime: 3s215ms - TotalBytesReceived: 664.79 MB (697078557) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s684ms - NumBatchesAccepted: 56.62K (56621) - NumBatchesRejected: 54 (54) Instance 5f429df048b5534b:41bcce180000027e (host=foo.232.17:22000):(Total: 12m38s, non-child: 158.886ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.32 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.95 MB, 162.41 MB, 162.44 MB, 228.18 MB, 290.17 MB, 299.67 MB, 339.90 MB, 358.64 MB, 376.89 MB, 394.41 MB, 402.42 MB, 402.41 MB, 407.43 MB, 418.42 MB, 418.41 MB, 418.41 MB, 418.40 MB, 418.42 MB, 418.41 MB, 425.67 MB, 426.93 MB, 440.90 MB, 442.41 MB, 442.41 MB, 448.43 MB, 456.40 MB, 466.41 MB, 466.42 MB, 466.40 MB, 466.40 MB, 466.43 MB, 466.40 MB, 466.35 MB, 466.41 MB, 491.80 MB, 640.77 MB, 640.47 MB, 639.86 MB, 639.74 MB, 640.18 MB, 640.28 MB, 640.44 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 653.30 MB (685038262) - PerHostPeakMemUsage: 1.41 GB (1512670434) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 16.739ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.74K (3738) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s209ms - TotalThreadsUserTime: 8s876ms - TotalThreadsVoluntaryContextSwitches: 64.95K (64950) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 53.411ms - ExecTreePrepareTime: 893.291us DataStreamSender (dst_id=26):(Total: 689.788us, non-child: 689.788us, % non-child: 100.00%) - BytesSent: 12.53 KB (12832) - OverallThroughput: 17.74 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 53 (53) - SerializeBatchTime: 494.954us - UncompressedRowBatchSize: 12.53 KB (12832) CodeGen:(Total: 632.856ms, non-child: 632.856ms, % non-child: 100.00%) - CodegenTime: 15.734ms - CompileTime: 204.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 396.695ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.051ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 694.195ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 55.801us - GetResultsTime: 144.183us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923161) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - StreamingTime: 681.461ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.123ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.291ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623257) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 147.162us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 241.844us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 459.265us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 344.373us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s615ms, non-child: 90.137us, % non-child: 0.01%) - ConvertRowBatchTime: 66.487us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.05 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s614ms - DataArrivalTimer: 1s614ms SenderSide: - DeserializeRowBatchTimer: 280.329us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.150ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 781.969us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566937) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.471us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.054us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 345.003us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 91.998us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 121.829ms, non-child: 18.853us, % non-child: 0.02%) - ConvertRowBatchTime: 8.346us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 121.814ms - DataArrivalTimer: 121.811ms SenderSide: - DeserializeRowBatchTimer: 106.245us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s184ms, % non-child: 0.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1414482) - BuildTime: 1s678ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 628.13 MB (658641152) - ProbeRows: 37.09M (37089071) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s299ms - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s370ms - BuildRowsPartitioned: 1.41M (1414482) - GetNewBlockTime: 2.688ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.22K (3224) - HashTablesBuildTime: 296.533ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 628.06 MB (658569344) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 194.997ms, % non-child: 0.03%) - ConvertRowBatchTime: 89.321ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1414482) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.19 MB, 21.79 MB, 55.81 MB, 94.89 MB, 131.87 MB, 158.14 MB, 173.59 MB, 182.75 MB, 190.24 MB, 196.88 MB, 202.50 MB, 207.38 MB, 212.67 MB, 217.94 MB, 222.40 MB, 226.01 MB, 228.94 MB, 231.70 MB, 234.25 MB, 236.55 MB, 238.63 MB, 240.68 MB, 242.29 MB, 243.77 MB, 245.18 MB, 246.57 MB, 247.67 MB, 248.49 MB, 249.18 MB, 249.70 MB, 249.95 MB, 250.27 MB, 250.47 MB, 250.55 MB, 251.19 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB, 252.07 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.07 MB (264311176) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s764ms - NumBatchesAccepted: 12.69K (12693) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s373ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s022ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37089071) - RowsReturnedRate: 315.46 K/sec RecvrSide: BytesReceived(16s000ms): 6.61 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.99 MB, 129.37 MB, 395.49 MB, 507.39 MB, 570.60 MB, 616.40 MB, 646.76 MB, 661.30 MB - FirstBatchArrivalWaitTime: 3s052ms - TotalBytesReceived: 665.62 MB (697951207) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s260ms - NumBatchesAccepted: 56.69K (56687) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce180000024a (host=foo.232.32:22000):(Total: 12m38s, non-child: 68.743ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.16 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.30 MB, 162.40 MB, 162.42 MB, 228.40 MB, 290.41 MB, 315.42 MB, 352.41 MB, 362.16 MB, 381.66 MB, 400.66 MB, 402.45 MB, 406.41 MB, 410.39 MB, 414.65 MB, 419.90 MB, 428.16 MB, 435.91 MB, 442.41 MB, 443.41 MB, 450.41 MB, 450.41 MB, 450.40 MB, 451.92 MB, 458.41 MB, 465.92 MB, 466.42 MB, 466.42 MB, 466.41 MB, 466.41 MB, 466.36 MB, 466.44 MB, 473.92 MB, 474.40 MB, 474.46 MB, 514.07 MB, 650.04 MB, 650.04 MB, 649.89 MB, 650.02 MB, 649.69 MB, 649.75 MB, 650.16 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 663.30 MB (695524022) - PerHostPeakMemUsage: 1.42 GB (1522909179) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m34s - TotalNetworkSendTime: 12.576ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.56K (3559) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s171ms - TotalThreadsUserTime: 8s804ms - TotalThreadsVoluntaryContextSwitches: 64.50K (64498) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 55.718ms - ExecTreePrepareTime: 719.761us DataStreamSender (dst_id=26):(Total: 716.838us, non-child: 716.838us, % non-child: 100.00%) - BytesSent: 9.86 KB (10098) - OverallThroughput: 13.43 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 47 (47) - SerializeBatchTime: 558.030us - UncompressedRowBatchSize: 9.86 KB (10098) CodeGen:(Total: 617.055ms, non-child: 617.055ms, % non-child: 100.00%) - CodegenTime: 16.062ms - CompileTime: 195.448ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 392.223ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.842ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 631.825ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 109.905us - GetResultsTime: 176.312us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9926253) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 616.914ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.985ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.149ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9630445) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 112.675us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 205.257us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 470.266us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 223.367us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s721ms, non-child: 72.033us, % non-child: 0.00%) - ConvertRowBatchTime: 51.755us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 990.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s721ms - DataArrivalTimer: 1s721ms SenderSide: - DeserializeRowBatchTimer: 351.594us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 20.516ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 535.514us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9574125) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 112.550us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62.951us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 304.098us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 105.678us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 321.641ms, non-child: 12.814us, % non-child: 0.00%) - ConvertRowBatchTime: 4.406us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 851.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 321.631ms - DataArrivalTimer: 321.629ms SenderSide: - DeserializeRowBatchTimer: 92.149us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s152ms, % non-child: 0.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1463369) - BuildTime: 1s676ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 638.13 MB (669127202) - ProbeRows: 37.14M (37137658) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s265ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s407ms - BuildRowsPartitioned: 1.46M (1463369) - GetNewBlockTime: 3.233ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.42K (4419) - HashTablesBuildTime: 257.195ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 638.06 MB (669055104) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 191.855ms, % non-child: 0.03%) - ConvertRowBatchTime: 89.666ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1463369) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.10 MB, 21.60 MB, 55.84 MB, 95.58 MB, 134.18 MB, 162.70 MB, 179.22 MB, 188.55 MB, 196.20 MB, 202.98 MB, 208.77 MB, 213.85 MB, 219.19 MB, 224.60 MB, 229.30 MB, 232.94 MB, 235.94 MB, 238.73 MB, 241.34 MB, 243.60 MB, 245.75 MB, 247.77 MB, 249.24 MB, 250.79 MB, 252.12 MB, 253.43 MB, 254.44 MB, 255.32 MB, 255.92 MB, 256.40 MB, 256.62 MB, 256.92 MB, 257.12 MB, 257.20 MB, 257.78 MB, 258.66 MB, 258.66 MB, 258.66 MB, 258.66 MB, 258.66 MB, 258.66 MB, 258.66 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 258.66 MB (271227162) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s987ms - NumBatchesAccepted: 13.13K (13129) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s366ms, % non-child: 1.15%) - ConvertRowBatchTime: 1s017ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37137658) - RowsReturnedRate: 311.37 K/sec RecvrSide: BytesReceived(16s000ms): 6.52 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.89 MB, 127.65 MB, 393.90 MB, 507.40 MB, 570.77 MB, 616.73 MB, 647.22 MB, 661.94 MB - FirstBatchArrivalWaitTime: 3s155ms - TotalBytesReceived: 666.32 MB (698683501) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s123ms - NumBatchesAccepted: 56.77K (56765) - NumBatchesRejected: 60 (60) Instance 5f429df048b5534b:41bcce180000021f (host=foo.232.34:22000):(Total: 12m38s, non-child: 105.073ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.94 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.06 MB, 162.40 MB, 162.40 MB, 232.41 MB, 290.41 MB, 309.17 MB, 344.88 MB, 379.64 MB, 390.41 MB, 395.91 MB, 406.94 MB, 410.43 MB, 415.40 MB, 418.40 MB, 423.66 MB, 426.40 MB, 429.44 MB, 434.42 MB, 441.18 MB, 442.41 MB, 442.42 MB, 442.40 MB, 442.40 MB, 449.92 MB, 450.41 MB, 456.87 MB, 458.41 MB, 458.40 MB, 458.45 MB, 458.35 MB, 458.44 MB, 458.41 MB, 458.41 MB, 458.44 MB, 518.13 MB, 647.39 MB, 647.34 MB, 648.01 MB, 648.12 MB, 647.73 MB, 648.17 MB, 648.12 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 661.30 MB (693426870) - PerHostPeakMemUsage: 1.42 GB (1529787983) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 38.980ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.64K (3641) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s282ms - TotalThreadsUserTime: 8s873ms - TotalThreadsVoluntaryContextSwitches: 64.56K (64563) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 54.579ms - ExecTreePrepareTime: 1.294ms DataStreamSender (dst_id=26):(Total: 488.727us, non-child: 488.727us, % non-child: 100.00%) - BytesSent: 12.08 KB (12372) - OverallThroughput: 24.14 MB/sec - PeakMemoryUsage: 272.66 KB (279200) - RowsReturned: 56 (56) - SerializeBatchTime: 361.206us - UncompressedRowBatchSize: 12.08 KB (12372) CodeGen:(Total: 619.497ms, non-child: 619.497ms, % non-child: 100.00%) - CodegenTime: 15.975ms - CompileTime: 206.521ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 381.214ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.220ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 671.920ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 124.456us - GetResultsTime: 103.978us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924457) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 661.739ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 3.043ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.167ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620457) - ProbeRows: 726 (726) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 404.898us - RowsReturned: 726 (726) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 236.133us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 668.014us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 145.842us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 346.783ms, non-child: 72.005us, % non-child: 0.02%) - ConvertRowBatchTime: 51.028us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 4.91 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 346.718ms - DataArrivalTimer: 346.712ms SenderSide: - DeserializeRowBatchTimer: 193.820us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.710ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.010ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564137) - ProbeRows: 726 (726) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 462.916us - RowsReturned: 726 (726) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56.848us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 666.227us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 122.125us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 207.744ms, non-child: 26.073us, % non-child: 0.01%) - ConvertRowBatchTime: 10.594us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.32 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 207.723ms - DataArrivalTimer: 207.719ms SenderSide: - DeserializeRowBatchTimer: 57.002us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s339ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1463573) - BuildTime: 1s789ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 636.13 MB (667029760) - ProbeRows: 37.13M (37131228) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s341ms - RowsReturned: 726 (726) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s488ms - BuildRowsPartitioned: 1.46M (1463573) - GetNewBlockTime: 3.077ms - HashBuckets: 3.80M (3801088) - HashCollisions: 4.44K (4439) - HashTablesBuildTime: 290.049ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 636.06 MB (666957952) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 213.974ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.658ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1463573) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.05 MB, 21.60 MB, 56.24 MB, 96.53 MB, 135.05 MB, 162.52 MB, 178.65 MB, 188.07 MB, 195.73 MB, 202.55 MB, 208.32 MB, 213.47 MB, 218.87 MB, 224.36 MB, 229.06 MB, 232.82 MB, 235.88 MB, 238.72 MB, 241.37 MB, 243.81 MB, 245.96 MB, 247.99 MB, 249.62 MB, 251.09 MB, 252.39 MB, 253.68 MB, 254.72 MB, 255.52 MB, 256.05 MB, 256.46 MB, 256.69 MB, 257.04 MB, 257.24 MB, 257.31 MB, 257.89 MB, 258.74 MB, 258.74 MB, 258.74 MB, 258.74 MB, 258.74 MB, 258.74 MB, 258.74 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 258.74 MB (271309708) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s035ms - NumBatchesAccepted: 13.13K (13131) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s364ms, % non-child: 1.13%) - ConvertRowBatchTime: 1s018ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37131228) - RowsReturnedRate: 307.68 K/sec RecvrSide: BytesReceived(16s000ms): 6.45 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.65 MB, 125.66 MB, 391.76 MB, 506.65 MB, 570.21 MB, 616.35 MB, 646.95 MB, 661.89 MB - FirstBatchArrivalWaitTime: 3s133ms - TotalBytesReceived: 666.32 MB (698689750) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTimer: 3s743ms - NumBatchesAccepted: 56.76K (56755) - NumBatchesRejected: 38 (38) Instance 5f429df048b5534b:41bcce180000028b (host=foo.232.39:22000):(Total: 12m38s, non-child: 97.301ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.45 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 32.46 MB, 162.41 MB, 162.44 MB, 230.18 MB, 290.42 MB, 299.67 MB, 328.93 MB, 366.92 MB, 392.18 MB, 394.44 MB, 402.90 MB, 410.43 MB, 410.42 MB, 415.94 MB, 418.41 MB, 418.41 MB, 418.42 MB, 418.43 MB, 418.42 MB, 421.92 MB, 434.67 MB, 442.42 MB, 442.42 MB, 442.42 MB, 442.42 MB, 442.44 MB, 442.43 MB, 442.41 MB, 442.43 MB, 442.41 MB, 442.42 MB, 442.43 MB, 442.43 MB, 448.95 MB, 478.67 MB, 629.21 MB, 630.49 MB, 629.99 MB, 630.07 MB, 630.05 MB, 629.88 MB, 630.11 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 643.31 MB (674560822) - PerHostPeakMemUsage: 1.33 GB (1428372172) - RowsProduced: 42 (42) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 12.397ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.52K (3524) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s234ms - TotalThreadsUserTime: 9s075ms - TotalThreadsVoluntaryContextSwitches: 64.17K (64175) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.429ms - ExecTreePrepareTime: 793.444us DataStreamSender (dst_id=26):(Total: 451.844us, non-child: 451.844us, % non-child: 100.00%) - BytesSent: 9.39 KB (9613) - OverallThroughput: 20.29 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 42 (42) - SerializeBatchTime: 323.775us - UncompressedRowBatchSize: 9.39 KB (9613) CodeGen:(Total: 705.786ms, non-child: 705.786ms, % non-child: 100.00%) - CodegenTime: 16.364ms - CompileTime: 228.693ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 450.522ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.063ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 617.963ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.188us - GetResultsTime: 164.334us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9918965) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 42 (42) - RowsReturnedRate: 0 - StreamingTime: 602.958ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.351ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.160ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 365.925us - RowsReturned: 698 (698) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 297.635us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 380.924us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 165.168us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 582.996ms, non-child: 57.907us, % non-child: 0.01%) - ConvertRowBatchTime: 42.324us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.92 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 582.945ms - DataArrivalTimer: 582.939ms SenderSide: - DeserializeRowBatchTimer: 169.423us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.404ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 575.994us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 482.068us - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.016us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 351.057us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.692us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.430us, non-child: 14.430us, % non-child: 100.00%) - ConvertRowBatchTime: 7.901us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.99 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.098us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 49.758us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s391ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1435473) - BuildTime: 1s782ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.14M (37143521) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s403ms - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s475ms - BuildRowsPartitioned: 1.44M (1435473) - GetNewBlockTime: 2.925ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.18K (3176) - HashTablesBuildTime: 294.742ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 203.576ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.528ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1435473) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.20 MB, 21.76 MB, 56.06 MB, 95.49 MB, 132.24 MB, 158.31 MB, 173.82 MB, 183.17 MB, 190.94 MB, 197.68 MB, 203.49 MB, 208.66 MB, 214.05 MB, 219.58 MB, 224.30 MB, 228.00 MB, 231.01 MB, 233.74 MB, 236.24 MB, 238.46 MB, 240.54 MB, 242.49 MB, 243.94 MB, 245.46 MB, 246.75 MB, 248.15 MB, 249.10 MB, 250.08 MB, 250.72 MB, 251.00 MB, 251.32 MB, 251.74 MB, 251.97 MB, 252.13 MB, 252.66 MB, 253.42 MB, 253.42 MB, 253.42 MB, 253.42 MB, 253.42 MB, 253.42 MB, 253.42 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 253.42 MB (265731536) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s873ms - NumBatchesAccepted: 12.88K (12885) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s383ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s038ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37143521) - RowsReturnedRate: 316.43 K/sec RecvrSide: BytesReceived(16s000ms): 6.68 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.16 MB, 131.02 MB, 397.70 MB, 508.71 MB, 571.84 MB, 617.49 MB, 647.81 MB, 662.22 MB - FirstBatchArrivalWaitTime: 2s887ms - TotalBytesReceived: 666.49 MB (698864269) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s016ms - NumBatchesAccepted: 56.78K (56776) - NumBatchesRejected: 91 (91) Instance 5f429df048b5534b:41bcce180000027c (host=foo.232.48:22000):(Total: 12m38s, non-child: 144.694ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.52 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.46 MB, 162.43 MB, 162.43 MB, 230.91 MB, 290.40 MB, 313.17 MB, 338.17 MB, 353.18 MB, 383.65 MB, 399.18 MB, 405.17 MB, 418.43 MB, 418.41 MB, 418.40 MB, 422.15 MB, 426.42 MB, 426.41 MB, 426.91 MB, 441.91 MB, 442.41 MB, 448.16 MB, 450.40 MB, 450.40 MB, 452.15 MB, 458.43 MB, 458.41 MB, 458.42 MB, 458.38 MB, 458.40 MB, 458.44 MB, 458.42 MB, 458.40 MB, 458.40 MB, 458.49 MB, 485.15 MB, 631.70 MB, 631.47 MB, 631.93 MB, 632.05 MB, 632.01 MB, 631.71 MB, 632.19 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.35 GB (1451278507) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 17.389ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.90K (3901) - TotalThreadsTotalWallClockTime: 23m18s - TotalThreadsSysTime: 1s234ms - TotalThreadsUserTime: 9s587ms - TotalThreadsVoluntaryContextSwitches: 63.49K (63491) Fragment Instance Lifecycle Timings: - ExecTime: 1m52s - ExecTreeExecTime: 1m52s - OpenTime: 10m45s - ExecTreeOpenTime: 10m44s - PrepareTime: 48.598ms - ExecTreePrepareTime: 738.987us DataStreamSender (dst_id=26):(Total: 619.825us, non-child: 619.825us, % non-child: 100.00%) - BytesSent: 10.36 KB (10608) - OverallThroughput: 16.32 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 50 (50) - SerializeBatchTime: 478.835us - UncompressedRowBatchSize: 10.36 KB (10608) CodeGen:(Total: 688.428ms, non-child: 688.428ms, % non-child: 100.00%) - CodegenTime: 17.213ms - CompileTime: 229.266ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 433.283ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.303ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 552.882ms, % non-child: 0.07%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.969us - GetResultsTime: 102.233us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916286) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 540.737ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.803ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.194ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620478) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.639us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 186.400us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 721.629us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.297us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s597ms, non-child: 62.218us, % non-child: 0.00%) - ConvertRowBatchTime: 44.335us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 656.00 /sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s597ms - DataArrivalTimer: 2s597ms SenderSide: - DeserializeRowBatchTimer: 260.797us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 74.649ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 601.726us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564158) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 135.816us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.195us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 319.502us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.308us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.591us, non-child: 15.591us, % non-child: 100.00%) - ConvertRowBatchTime: 8.239us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.57 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.035us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 43.939us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s721ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1447011) - BuildTime: 1s848ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 37.11M (37113714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s668ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s514ms - BuildRowsPartitioned: 1.45M (1447011) - GetNewBlockTime: 2.993ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.40K (4398) - HashTablesBuildTime: 321.539ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 217.581ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.367ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1447011) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.32 MB, 22.22 MB, 56.44 MB, 96.03 MB, 133.54 MB, 160.50 MB, 176.54 MB, 185.83 MB, 193.51 MB, 200.36 MB, 206.20 MB, 211.33 MB, 216.79 MB, 222.32 MB, 227.09 MB, 230.78 MB, 233.79 MB, 236.58 MB, 239.13 MB, 241.39 MB, 243.42 MB, 245.41 MB, 246.97 MB, 248.37 MB, 249.77 MB, 250.94 MB, 252.00 MB, 252.83 MB, 253.47 MB, 253.93 MB, 254.16 MB, 254.44 MB, 254.64 MB, 254.73 MB, 255.31 MB, 256.14 MB, 256.14 MB, 256.14 MB, 256.14 MB, 256.14 MB, 256.14 MB, 256.14 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 256.14 MB (268579483) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 2s095ms - NumBatchesAccepted: 12.98K (12982) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s417ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s055ms - PeakMemoryUsage: 0 - RowsReturned: 37.11M (37113714) - RowsReturnedRate: 317.03 K/sec RecvrSide: BytesReceived(16s000ms): 6.79 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.48 MB, 132.94 MB, 399.40 MB, 508.87 MB, 571.86 MB, 617.31 MB, 647.53 MB, 661.78 MB - FirstBatchArrivalWaitTime: 2s869ms - TotalBytesReceived: 666.00 MB (698350515) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s248ms - NumBatchesAccepted: 56.73K (56726) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce1800000260 (host=foo.232.42:22000):(Total: 12m38s, non-child: 163.881ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.21 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 33.43 MB, 162.37 MB, 163.12 MB, 237.64 MB, 292.90 MB, 309.64 MB, 349.87 MB, 380.15 MB, 400.40 MB, 402.38 MB, 402.42 MB, 406.39 MB, 410.89 MB, 418.40 MB, 424.14 MB, 434.39 MB, 434.39 MB, 434.40 MB, 434.42 MB, 434.38 MB, 434.38 MB, 434.38 MB, 434.38 MB, 434.41 MB, 434.40 MB, 440.90 MB, 442.40 MB, 445.38 MB, 450.39 MB, 450.39 MB, 450.38 MB, 450.38 MB, 450.43 MB, 450.43 MB, 487.51 MB, 638.53 MB, 637.90 MB, 637.66 MB, 637.98 MB, 637.33 MB, 638.08 MB, 637.19 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.28 MB (682919495) - PerHostPeakMemUsage: 1.22 GB (1314224634) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 109.838ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.53K (3527) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s244ms - TotalThreadsUserTime: 9s736ms - TotalThreadsVoluntaryContextSwitches: 63.49K (63494) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 48.574ms - ExecTreePrepareTime: 1.022ms DataStreamSender (dst_id=26):(Total: 890.585us, non-child: 890.585us, % non-child: 100.00%) - BytesSent: 11.83 KB (12119) - OverallThroughput: 12.98 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 56 (56) - SerializeBatchTime: 710.520us - UncompressedRowBatchSize: 11.83 KB (12119) CodeGen:(Total: 718.133ms, non-child: 718.133ms, % non-child: 100.00%) - CodegenTime: 15.978ms - CompileTime: 251.920ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 439.218ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.487ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 624.394ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 65.556us - GetResultsTime: 106.242us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9917211) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 610.659ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.146ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 917.143us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 165.708us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 121.541us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 463.796us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 170.899us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s488ms, non-child: 34.594us, % non-child: 0.00%) - ConvertRowBatchTime: 22.565us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 684.00 /sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s488ms - DataArrivalTimer: 2s488ms SenderSide: - DeserializeRowBatchTimer: 423.575us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 3.006ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 474.490us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 163.110us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20.988us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 259.125us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.070us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 24.366us, non-child: 24.366us, % non-child: 100.00%) - ConvertRowBatchTime: 17.514us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 11.25 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.404us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 116.762us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s893ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1464482) - BuildTime: 1s803ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 36.94M (36938923) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s862ms - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s503ms - BuildRowsPartitioned: 1.46M (1464482) - GetNewBlockTime: 2.671ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.84K (3836) - HashTablesBuildTime: 288.112ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 204.498ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.207ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1464482) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.22 MB, 22.60 MB, 58.07 MB, 98.78 MB, 137.02 MB, 163.72 MB, 179.48 MB, 188.85 MB, 196.56 MB, 203.33 MB, 209.14 MB, 214.30 MB, 219.73 MB, 225.16 MB, 229.83 MB, 233.55 MB, 236.42 MB, 239.14 MB, 241.69 MB, 244.06 MB, 246.11 MB, 248.12 MB, 249.69 MB, 251.17 MB, 252.55 MB, 254.00 MB, 255.08 MB, 256.06 MB, 256.74 MB, 257.24 MB, 257.53 MB, 257.90 MB, 258.20 MB, 258.29 MB, 258.86 MB, 259.66 MB, 259.66 MB, 259.66 MB, 259.66 MB, 259.66 MB, 259.66 MB, 259.66 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 259.66 MB (272276911) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s838ms - NumBatchesAccepted: 13.14K (13143) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s455ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s078ms - PeakMemoryUsage: 0 - RowsReturned: 36.94M (36938923) - RowsReturnedRate: 313.85 K/sec RecvrSide: BytesReceived(16s000ms): 6.61 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 11.97 MB, 128.45 MB, 393.56 MB, 505.36 MB, 568.33 MB, 613.89 MB, 644.15 MB, 658.67 MB - FirstBatchArrivalWaitTime: 2s827ms - TotalBytesReceived: 662.99 MB (695193062) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s632ms - NumBatchesAccepted: 56.46K (56460) - NumBatchesRejected: 53 (53) Instance 5f429df048b5534b:41bcce1800000261 (host=foo.232.45:22000):(Total: 12m38s, non-child: 141.617ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.14 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.30 MB, 162.39 MB, 162.44 MB, 232.65 MB, 291.43 MB, 310.92 MB, 342.68 MB, 362.18 MB, 377.69 MB, 401.67 MB, 402.43 MB, 410.92 MB, 422.66 MB, 426.43 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.42 MB, 426.41 MB, 430.41 MB, 434.41 MB, 434.43 MB, 440.65 MB, 442.40 MB, 442.41 MB, 446.68 MB, 450.42 MB, 450.41 MB, 454.41 MB, 458.43 MB, 458.41 MB, 458.46 MB, 458.38 MB, 458.44 MB, 491.71 MB, 632.82 MB, 632.52 MB, 631.83 MB, 631.78 MB, 631.42 MB, 631.86 MB, 632.30 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.33 GB (1424343503) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 13.117ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.64K (3642) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s134ms - TotalThreadsUserTime: 9s179ms - TotalThreadsVoluntaryContextSwitches: 64.69K (64691) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 48.236ms - ExecTreePrepareTime: 645.651us DataStreamSender (dst_id=26):(Total: 506.623us, non-child: 506.623us, % non-child: 100.00%) - BytesSent: 11.54 KB (11815) - OverallThroughput: 22.24 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 55 (55) - SerializeBatchTime: 307.072us - UncompressedRowBatchSize: 11.54 KB (11815) CodeGen:(Total: 689.631ms, non-child: 689.631ms, % non-child: 100.00%) - CodegenTime: 15.824ms - CompileTime: 231.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 431.960ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 25.861ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 643.558ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 92.016us - GetResultsTime: 85.767us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925124) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - StreamingTime: 632.789ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.743ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.219ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624124) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.086us - RowsReturned: 110 (110) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 227.340us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 525.120us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 300.089us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s434ms, non-child: 99.636us, % non-child: 0.01%) - ConvertRowBatchTime: 47.099us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.19 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s434ms - DataArrivalTimer: 1s434ms SenderSide: - DeserializeRowBatchTimer: 149.057us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 8.725ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 794.264us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567804) - ProbeRows: 116 (116) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.547us - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.239us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 446.878us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 116.837us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 32.236ms, non-child: 16.746us, % non-child: 0.05%) - ConvertRowBatchTime: 7.708us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 8.50 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 32.222ms - DataArrivalTimer: 32.220ms SenderSide: - DeserializeRowBatchTimer: 65.257us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s410ms, % non-child: 0.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1438232) - BuildTime: 1s757ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 37.10M (37102889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s444ms - RowsReturned: 116 (116) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s463ms - BuildRowsPartitioned: 1.44M (1438232) - GetNewBlockTime: 3.567ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.76K (4760) - HashTablesBuildTime: 280.256ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 201.336ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.860ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1438232) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.14 MB, 21.90 MB, 56.61 MB, 96.59 MB, 134.77 MB, 161.53 MB, 177.16 MB, 186.52 MB, 194.10 MB, 200.75 MB, 206.39 MB, 211.37 MB, 216.57 MB, 221.89 MB, 226.38 MB, 229.92 MB, 232.80 MB, 235.59 MB, 238.27 MB, 240.59 MB, 242.61 MB, 244.46 MB, 246.15 MB, 247.37 MB, 248.79 MB, 250.00 MB, 251.12 MB, 251.88 MB, 252.47 MB, 252.97 MB, 253.24 MB, 253.63 MB, 253.82 MB, 253.89 MB, 254.46 MB, 255.27 MB, 255.27 MB, 255.27 MB, 255.27 MB, 255.27 MB, 255.27 MB, 255.27 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 255.27 MB (267666762) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s684ms - NumBatchesAccepted: 12.91K (12908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s385ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s027ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37102889) - RowsReturnedRate: 314.03 K/sec RecvrSide: BytesReceived(16s000ms): 6.56 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.02 MB, 129.01 MB, 395.30 MB, 507.49 MB, 570.72 MB, 616.49 MB, 646.89 MB, 661.46 MB - FirstBatchArrivalWaitTime: 2s870ms - TotalBytesReceived: 665.79 MB (698135279) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s074ms - NumBatchesAccepted: 56.71K (56714) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce1800000276 (host=foo.232.46:22000):(Total: 12m37s, non-child: 66.185ms, % non-child: 0.01%) MemoryUsage(16s000ms): 14.92 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.29 MB, 162.17 MB, 162.40 MB, 231.43 MB, 290.43 MB, 303.91 MB, 338.17 MB, 364.68 MB, 386.42 MB, 393.91 MB, 394.41 MB, 395.67 MB, 409.18 MB, 417.65 MB, 418.42 MB, 418.41 MB, 423.17 MB, 431.66 MB, 434.42 MB, 434.42 MB, 434.42 MB, 434.43 MB, 434.42 MB, 434.41 MB, 434.42 MB, 446.92 MB, 450.41 MB, 450.43 MB, 450.45 MB, 450.41 MB, 450.44 MB, 450.39 MB, 450.35 MB, 450.38 MB, 480.83 MB, 633.85 MB, 633.25 MB, 633.84 MB, 634.02 MB, 633.68 MB, 634.26 MB, 634.28 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.30 MB (678746806) - PerHostPeakMemUsage: 1.27 GB (1359098584) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 12.803ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.58K (3580) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s226ms - TotalThreadsUserTime: 9s475ms - TotalThreadsVoluntaryContextSwitches: 64.07K (64072) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 50.955ms - ExecTreePrepareTime: 785.680us DataStreamSender (dst_id=26):(Total: 722.725us, non-child: 722.725us, % non-child: 100.00%) - BytesSent: 11.68 KB (11965) - OverallThroughput: 15.79 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 53 (53) - SerializeBatchTime: 510.480us - UncompressedRowBatchSize: 11.68 KB (11965) CodeGen:(Total: 658.891ms, non-child: 658.891ms, % non-child: 100.00%) - CodegenTime: 15.575ms - CompileTime: 219.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 412.766ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.065ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 640.015ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 56.405us - GetResultsTime: 122.750us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923261) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - StreamingTime: 627.031ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.939ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.287ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619261) - ProbeRows: 108 (108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 149.957us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 208.092us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 606.003us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 284.796us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 626.471ms, non-child: 54.220us, % non-child: 0.01%) - ConvertRowBatchTime: 41.996us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.72 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 626.422ms - DataArrivalTimer: 626.418ms SenderSide: - DeserializeRowBatchTimer: 216.523us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 10.213ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 601.022us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562941) - ProbeRows: 108 (108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 166.473us - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 24.309us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 391.554us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.187us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 4.934ms, non-child: 14.407us, % non-child: 0.29%) - ConvertRowBatchTime: 7.438us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 55.53 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 4.922ms - DataArrivalTimer: 4.920ms SenderSide: - DeserializeRowBatchTimer: 61.091us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s690ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1416962) - BuildTime: 1s706ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 37.09M (37093485) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s770ms - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s389ms - BuildRowsPartitioned: 1.42M (1416962) - GetNewBlockTime: 2.389ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.15K (3146) - HashTablesBuildTime: 304.283ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 195.147ms, % non-child: 0.03%) - ConvertRowBatchTime: 89.375ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1416962) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.11 MB, 21.78 MB, 56.40 MB, 96.00 MB, 133.42 MB, 159.18 MB, 174.48 MB, 183.87 MB, 191.49 MB, 198.23 MB, 203.98 MB, 208.98 MB, 214.21 MB, 219.51 MB, 224.09 MB, 227.69 MB, 230.54 MB, 233.23 MB, 235.65 MB, 237.77 MB, 239.78 MB, 241.75 MB, 243.30 MB, 244.73 MB, 246.06 MB, 247.36 MB, 248.45 MB, 249.18 MB, 249.82 MB, 250.18 MB, 250.45 MB, 250.77 MB, 251.04 MB, 251.10 MB, 251.70 MB, 252.53 MB, 252.53 MB, 252.53 MB, 252.53 MB, 252.53 MB, 252.53 MB, 252.53 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 252.53 MB (264794114) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s794ms - NumBatchesAccepted: 12.72K (12718) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s436ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s058ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37093485) - RowsReturnedRate: 315.99 K/sec RecvrSide: BytesReceived(16s000ms): 6.50 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.73 MB, 126.76 MB, 392.61 MB, 506.50 MB, 569.91 MB, 615.86 MB, 646.37 MB, 661.18 MB - FirstBatchArrivalWaitTime: 2s937ms - TotalBytesReceived: 665.58 MB (697914420) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s604ms - NumBatchesAccepted: 56.70K (56695) - NumBatchesRejected: 81 (81) Instance 5f429df048b5534b:41bcce1800000265 (host=foo.232.41:22000):(Total: 12m37s, non-child: 163.656ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.00 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.05 MB, 162.40 MB, 162.43 MB, 235.39 MB, 290.41 MB, 302.18 MB, 342.92 MB, 368.93 MB, 400.43 MB, 410.43 MB, 410.64 MB, 418.42 MB, 418.40 MB, 418.41 MB, 418.43 MB, 418.41 MB, 418.42 MB, 424.67 MB, 434.41 MB, 438.17 MB, 442.40 MB, 442.41 MB, 442.41 MB, 445.16 MB, 450.42 MB, 453.44 MB, 458.41 MB, 458.41 MB, 458.41 MB, 458.40 MB, 458.36 MB, 458.43 MB, 462.91 MB, 466.42 MB, 500.21 MB, 645.97 MB, 645.61 MB, 646.10 MB, 646.40 MB, 645.74 MB, 646.27 MB, 646.40 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 659.30 MB (691329718) - PerHostPeakMemUsage: 1.24 GB (1330584364) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 14.565ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.96K (3964) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s277ms - TotalThreadsUserTime: 9s733ms - TotalThreadsVoluntaryContextSwitches: 63.65K (63651) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 55.052ms - ExecTreePrepareTime: 1.280ms DataStreamSender (dst_id=26):(Total: 539.240us, non-child: 539.240us, % non-child: 100.00%) - BytesSent: 8.23 KB (8425) - OverallThroughput: 14.90 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 41 (41) - SerializeBatchTime: 378.008us - UncompressedRowBatchSize: 8.23 KB (8425) CodeGen:(Total: 739.141ms, non-child: 739.141ms, % non-child: 100.00%) - CodegenTime: 17.162ms - CompileTime: 289.964ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 419.513ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.124ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 647.280ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 55.553us - GetResultsTime: 177.345us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921553) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - StreamingTime: 632.477ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.232ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.128ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622103) - ProbeRows: 84 (84) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 113.786us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 166.564us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 515.828us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 194.120us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s083ms, non-child: 66.240us, % non-child: 0.01%) - ConvertRowBatchTime: 49.695us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.57 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s083ms - DataArrivalTimer: 1s083ms SenderSide: - DeserializeRowBatchTimer: 258.709us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 4.586ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 792.093us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565783) - ProbeRows: 84 (84) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.494us - RowsReturned: 84 (84) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.774us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 472.920us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.195us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 19.598us, non-child: 19.598us, % non-child: 100.00%) - ConvertRowBatchTime: 12.702us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 13.98 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.814us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 147.560us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s841ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1452675) - BuildTime: 1s811ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 634.13 MB (664932608) - ProbeRows: 37.08M (37081852) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s806ms - RowsReturned: 84 (84) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s471ms - BuildRowsPartitioned: 1.45M (1452675) - GetNewBlockTime: 2.328ms - HashBuckets: 3.67M (3670016) - HashCollisions: 2.85K (2850) - HashTablesBuildTime: 328.389ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 634.06 MB (664860800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 205.702ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.052ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1452675) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.14 MB, 22.01 MB, 56.98 MB, 97.05 MB, 134.84 MB, 161.76 MB, 177.73 MB, 187.25 MB, 194.98 MB, 201.82 MB, 207.71 MB, 212.94 MB, 218.40 MB, 223.86 MB, 228.52 MB, 232.17 MB, 235.15 MB, 237.98 MB, 240.58 MB, 242.85 MB, 244.97 MB, 246.91 MB, 248.56 MB, 249.91 MB, 251.33 MB, 252.58 MB, 253.68 MB, 254.48 MB, 255.26 MB, 255.73 MB, 256.04 MB, 256.35 MB, 256.57 MB, 256.71 MB, 257.32 MB, 258.17 MB, 258.17 MB, 258.17 MB, 258.17 MB, 258.17 MB, 258.17 MB, 258.17 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 258.17 MB (270708654) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s666ms - NumBatchesAccepted: 13.03K (13032) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s441ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s077ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37081852) - RowsReturnedRate: 315.25 K/sec RecvrSide: BytesReceived(16s000ms): 6.55 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.85 MB, 127.43 MB, 393.25 MB, 506.50 MB, 569.86 MB, 615.79 MB, 646.28 MB, 661.01 MB - FirstBatchArrivalWaitTime: 2s765ms - TotalBytesReceived: 665.39 MB (697710359) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s436ms - NumBatchesAccepted: 56.68K (56684) - NumBatchesRejected: 73 (73) Instance 5f429df048b5534b:41bcce180000024b (host=foo.232.40:22000):(Total: 12m37s, non-child: 139.252ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.14 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 33.45 MB, 162.42 MB, 162.42 MB, 237.90 MB, 291.93 MB, 313.67 MB, 335.67 MB, 375.67 MB, 397.18 MB, 410.44 MB, 410.43 MB, 410.41 MB, 418.95 MB, 431.68 MB, 442.42 MB, 442.40 MB, 442.40 MB, 442.42 MB, 442.40 MB, 442.41 MB, 442.41 MB, 442.40 MB, 442.41 MB, 442.40 MB, 442.42 MB, 442.40 MB, 442.41 MB, 442.42 MB, 442.41 MB, 442.41 MB, 442.39 MB, 442.37 MB, 442.34 MB, 442.39 MB, 483.54 MB, 629.89 MB, 629.61 MB, 630.60 MB, 630.56 MB, 630.00 MB, 630.14 MB, 630.37 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.36 GB (1459154958) - RowsProduced: 59 (59) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 16.740ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.70K (3703) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s210ms - TotalThreadsUserTime: 9s681ms - TotalThreadsVoluntaryContextSwitches: 63.80K (63797) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 53.811ms - ExecTreePrepareTime: 885.029us DataStreamSender (dst_id=26):(Total: 560.461us, non-child: 560.461us, % non-child: 100.00%) - BytesSent: 12.50 KB (12798) - OverallThroughput: 21.78 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 59 (59) - SerializeBatchTime: 419.518us - UncompressedRowBatchSize: 12.50 KB (12798) CodeGen:(Total: 617.134ms, non-child: 617.134ms, % non-child: 100.00%) - CodegenTime: 16.579ms - CompileTime: 209.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 375.562ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.041ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 606.918ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.823us - GetResultsTime: 151.662us - HTResizeTime: 376.297us - HashBuckets: 30.72K (30720) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.69 MB (11208732) - PinTime: 0.000ns - ReductionFactorEstimate: 28846701.67 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 59 (59) - RowsReturnedRate: 0 - StreamingTime: 593.093ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.986ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 580.496us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 10.20 MB (10695836) - ProbeRows: 2.75K (2751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 781.766us - RowsReturned: 2.75K (2749) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 145.854us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 274.318us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.576us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s461ms, non-child: 70.450us, % non-child: 0.00%) - ConvertRowBatchTime: 54.633us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s461ms - DataArrivalTimer: 1s461ms SenderSide: - DeserializeRowBatchTimer: 162.244us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 3.000ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 403.248us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567804) - ProbeRows: 2.75K (2751) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 792.197us - RowsReturned: 2.75K (2751) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.947us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 216.994us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.291us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.122us, non-child: 17.122us, % non-child: 100.00%) - ConvertRowBatchTime: 8.039us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.00 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.668us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 52.270us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s918ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.48M (1478524) - BuildTime: 1s878ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.08M (37075797) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s810ms - RowsReturned: 2.75K (2751) - RowsReturnedRate: 3.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s526ms - BuildRowsPartitioned: 1.48M (1478524) - GetNewBlockTime: 3.041ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.10K (4099) - HashTablesBuildTime: 338.738ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 211.439ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.638ms - PeakMemoryUsage: 0 - RowsReturned: 1.48M (1478524) - RowsReturnedRate: 2.33 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.19 MB, 22.44 MB, 57.58 MB, 98.20 MB, 136.69 MB, 163.53 MB, 179.53 MB, 189.30 MB, 197.30 MB, 204.45 MB, 210.57 MB, 216.01 MB, 221.80 MB, 227.61 MB, 232.47 MB, 236.20 MB, 239.18 MB, 241.98 MB, 244.54 MB, 246.72 MB, 248.70 MB, 250.62 MB, 252.24 MB, 253.58 MB, 254.95 MB, 256.23 MB, 257.49 MB, 258.18 MB, 258.89 MB, 259.40 MB, 259.75 MB, 260.08 MB, 260.26 MB, 260.31 MB, 260.89 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB, 261.75 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.75 MB (274459585) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s812ms - NumBatchesAccepted: 13.26K (13259) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s450ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s073ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37075797) - RowsReturnedRate: 314.16 K/sec RecvrSide: BytesReceived(16s000ms): 6.57 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.96 MB, 128.51 MB, 394.53 MB, 507.06 MB, 570.31 MB, 616.14 MB, 646.52 MB, 661.13 MB - FirstBatchArrivalWaitTime: 2s897ms - TotalBytesReceived: 665.46 MB (697790398) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s553ms - NumBatchesAccepted: 56.67K (56668) - NumBatchesRejected: 59 (59) Instance 5f429df048b5534b:41bcce1800000273 (host=foo.232.49:22000):(Total: 12m37s, non-child: 69.187ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.12 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 31.54 MB, 162.42 MB, 162.42 MB, 225.44 MB, 290.40 MB, 299.16 MB, 316.90 MB, 358.41 MB, 378.17 MB, 394.40 MB, 394.42 MB, 404.43 MB, 418.43 MB, 418.37 MB, 423.92 MB, 426.40 MB, 426.41 MB, 426.41 MB, 426.41 MB, 426.42 MB, 426.42 MB, 426.42 MB, 426.43 MB, 426.42 MB, 432.66 MB, 434.41 MB, 434.45 MB, 434.39 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.44 MB, 434.45 MB, 434.35 MB, 468.07 MB, 613.91 MB, 614.11 MB, 613.74 MB, 613.79 MB, 613.36 MB, 614.12 MB, 614.23 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 627.30 MB (657775286) - PerHostPeakMemUsage: 1.41 GB (1511109593) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 11.518ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.58K (3585) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s165ms - TotalThreadsUserTime: 9s021ms - TotalThreadsVoluntaryContextSwitches: 64.30K (64295) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 60.257ms - ExecTreePrepareTime: 1.130ms DataStreamSender (dst_id=26):(Total: 538.453us, non-child: 538.453us, % non-child: 100.00%) - BytesSent: 10.20 KB (10444) - OverallThroughput: 18.50 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 46 (46) - SerializeBatchTime: 353.964us - UncompressedRowBatchSize: 10.20 KB (10444) CodeGen:(Total: 718.381ms, non-child: 718.381ms, % non-child: 100.00%) - CodegenTime: 19.419ms - CompileTime: 239.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 446.410ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.839ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 638.711ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 1.196ms - GetResultsTime: 98.757us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9925353) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 626.866ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.496ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.527ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9625449) - ProbeRows: 706 (706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 439.360us - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 199.010us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.032ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 126.819us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s111ms, non-child: 78.394us, % non-child: 0.01%) - ConvertRowBatchTime: 56.534us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.53 K/sec RecvrSide: BytesReceived(16s000ms): 22.98 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s111ms - DataArrivalTimer: 1s111ms SenderSide: - DeserializeRowBatchTimer: 259.584us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.465ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.383ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9569129) - ProbeRows: 706 (706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 498.395us - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46.093us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 907.422us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.606us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 36.461us, non-child: 36.461us, % non-child: 100.00%) - ConvertRowBatchTime: 24.503us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 7.51 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.789us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 89.275us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s317ms, % non-child: 0.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1415865) - BuildTime: 1s693ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 602.13 MB (631378176) - ProbeRows: 37.12M (37122788) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s412ms - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s449ms - BuildRowsPartitioned: 1.42M (1415865) - GetNewBlockTime: 2.995ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.56K (3556) - HashTablesBuildTime: 232.365ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 602.06 MB (631306368) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 204.104ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.608ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1415865) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.11 MB, 21.37 MB, 55.14 MB, 93.92 MB, 130.55 MB, 156.23 MB, 171.57 MB, 180.79 MB, 188.24 MB, 194.83 MB, 200.48 MB, 205.45 MB, 210.66 MB, 216.02 MB, 220.57 MB, 224.17 MB, 227.09 MB, 229.83 MB, 232.38 MB, 234.59 MB, 236.62 MB, 238.61 MB, 240.26 MB, 241.81 MB, 243.16 MB, 244.56 MB, 245.62 MB, 246.39 MB, 247.12 MB, 247.60 MB, 247.96 MB, 248.17 MB, 248.32 MB, 248.37 MB, 249.04 MB, 249.96 MB, 249.96 MB, 249.96 MB, 249.96 MB, 249.96 MB, 249.96 MB, 249.96 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 249.96 MB (262102811) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s926ms - NumBatchesAccepted: 12.70K (12701) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s388ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s034ms - PeakMemoryUsage: 0 - RowsReturned: 37.12M (37122788) - RowsReturnedRate: 314.80 K/sec RecvrSide: BytesReceived(16s000ms): 6.55 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.88 MB, 128.12 MB, 394.40 MB, 507.38 MB, 570.70 MB, 616.60 MB, 647.06 MB, 661.76 MB - FirstBatchArrivalWaitTime: 2s818ms - TotalBytesReceived: 666.13 MB (698485648) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 3s953ms - NumBatchesAccepted: 56.74K (56744) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce180000025b (host=foo.232.37:22000):(Total: 12m37s, non-child: 63.741ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.50 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 34.38 MB, 162.44 MB, 162.42 MB, 225.21 MB, 291.42 MB, 300.42 MB, 324.15 MB, 350.94 MB, 376.93 MB, 400.17 MB, 402.41 MB, 402.41 MB, 409.42 MB, 412.16 MB, 418.41 MB, 418.41 MB, 425.90 MB, 426.41 MB, 426.43 MB, 426.41 MB, 426.39 MB, 426.41 MB, 426.67 MB, 434.42 MB, 434.39 MB, 434.43 MB, 434.42 MB, 434.40 MB, 434.42 MB, 434.45 MB, 434.42 MB, 434.42 MB, 434.43 MB, 434.45 MB, 475.39 MB, 615.29 MB, 616.36 MB, 615.87 MB, 616.01 MB, 615.80 MB, 616.14 MB, 615.88 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 629.30 MB (659872438) - PerHostPeakMemUsage: 1.34 GB (1437776842) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 11.064ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.77K (3772) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s254ms - TotalThreadsUserTime: 9s601ms - TotalThreadsVoluntaryContextSwitches: 62.62K (62618) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 46.023ms - ExecTreePrepareTime: 1.797ms DataStreamSender (dst_id=26):(Total: 500.415us, non-child: 500.415us, % non-child: 100.00%) - BytesSent: 9.75 KB (9980) - OverallThroughput: 19.02 MB/sec - PeakMemoryUsage: 224.66 KB (230048) - RowsReturned: 44 (44) - SerializeBatchTime: 381.504us - UncompressedRowBatchSize: 9.75 KB (9980) CodeGen:(Total: 655.155ms, non-child: 655.155ms, % non-child: 100.00%) - CodegenTime: 16.332ms - CompileTime: 230.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 401.774ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 22.633ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 593.677ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 75.238us - GetResultsTime: 108.065us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 581.862ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.471ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 2.364ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.996us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 215.176us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.431ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 186.275us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 582.102ms, non-child: 86.269us, % non-child: 0.01%) - ConvertRowBatchTime: 54.509us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.93 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 582.027ms - DataArrivalTimer: 582.017ms SenderSide: - DeserializeRowBatchTimer: 249.124us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 20.833ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.898ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.074us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.724us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.168ms - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 94.356us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 18.653us, non-child: 18.653us, % non-child: 100.00%) - ConvertRowBatchTime: 9.355us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.69 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.098us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 126.010us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s829ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1395764) - BuildTime: 1s748ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 604.13 MB (633475443) - ProbeRows: 37.01M (37014361) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s850ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s417ms - BuildRowsPartitioned: 1.40M (1395764) - GetNewBlockTime: 3.170ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.56K (2558) - HashTablesBuildTime: 317.517ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 604.06 MB (633403520) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 199.549ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.353ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1395764) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.27 MB, 21.86 MB, 55.56 MB, 94.51 MB, 131.25 MB, 156.76 MB, 171.79 MB, 180.85 MB, 188.26 MB, 194.78 MB, 200.29 MB, 205.17 MB, 210.46 MB, 215.71 MB, 220.17 MB, 223.76 MB, 226.62 MB, 229.23 MB, 231.66 MB, 233.85 MB, 235.79 MB, 237.66 MB, 239.12 MB, 240.51 MB, 241.75 MB, 243.00 MB, 244.01 MB, 244.80 MB, 245.41 MB, 245.81 MB, 246.08 MB, 246.30 MB, 246.48 MB, 246.56 MB, 247.25 MB, 248.08 MB, 248.08 MB, 248.08 MB, 248.08 MB, 248.08 MB, 248.08 MB, 248.08 MB - FirstBatchArrivalWaitTime: 1m31s - TotalBytesReceived: 248.08 MB (260132193) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s676ms - NumBatchesAccepted: 12.53K (12526) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s434ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37014361) - RowsReturnedRate: 314.34 K/sec RecvrSide: BytesReceived(16s000ms): 6.77 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.47 MB, 132.41 MB, 398.14 MB, 507.42 MB, 570.24 MB, 615.56 MB, 645.71 MB, 659.94 MB - FirstBatchArrivalWaitTime: 2s894ms - TotalBytesReceived: 664.15 MB (696414295) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s377ms - NumBatchesAccepted: 56.58K (56576) - NumBatchesRejected: 63 (63) Instance 5f429df048b5534b:41bcce180000021a (host=foo.232.44:22000):(Total: 12m37s, non-child: 105.011ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.40 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 35.18 MB, 162.15 MB, 164.40 MB, 236.90 MB, 293.64 MB, 312.41 MB, 345.63 MB, 374.91 MB, 388.40 MB, 406.37 MB, 416.88 MB, 418.37 MB, 418.39 MB, 418.38 MB, 418.40 MB, 418.41 MB, 424.40 MB, 426.39 MB, 431.42 MB, 449.13 MB, 450.40 MB, 450.37 MB, 450.42 MB, 450.39 MB, 450.39 MB, 450.38 MB, 450.38 MB, 450.39 MB, 450.43 MB, 457.37 MB, 458.44 MB, 458.40 MB, 458.33 MB, 458.47 MB, 520.49 MB, 634.36 MB, 634.08 MB, 633.72 MB, 633.73 MB, 634.00 MB, 633.59 MB, 633.97 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.28 MB (678725191) - PerHostPeakMemUsage: 1.36 GB (1459149788) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 34.128ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.63K (3628) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s192ms - TotalThreadsUserTime: 9s487ms - TotalThreadsVoluntaryContextSwitches: 63.18K (63184) Fragment Instance Lifecycle Timings: - ExecTime: 2m3s - ExecTreeExecTime: 2m2s - OpenTime: 10m34s - ExecTreeOpenTime: 10m34s - PrepareTime: 48.435ms - ExecTreePrepareTime: 924.730us DataStreamSender (dst_id=26):(Total: 791.509us, non-child: 791.509us, % non-child: 100.00%) - BytesSent: 8.79 KB (9006) - OverallThroughput: 10.85 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 41 (41) - SerializeBatchTime: 623.819us - UncompressedRowBatchSize: 8.79 KB (9006) CodeGen:(Total: 626.253ms, non-child: 626.253ms, % non-child: 100.00%) - CodegenTime: 15.428ms - CompileTime: 199.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 399.934ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.663ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 610.823ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.320us - GetResultsTime: 97.401us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921686) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - StreamingTime: 597.871ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.707ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 796.265us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621782) - ProbeRows: 698 (698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 293.205us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 170.080us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 383.229us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 171.665us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s914ms, non-child: 31.366us, % non-child: 0.00%) - ConvertRowBatchTime: 20.877us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 890.00 /sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s914ms - DataArrivalTimer: 1s914ms SenderSide: - DeserializeRowBatchTimer: 268.435us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.676ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 567.902us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565462) - ProbeRows: 698 (698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 552.384us - RowsReturned: 698 (698) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.009us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 311.885us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.090us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 46.765us, non-child: 46.765us, % non-child: 100.00%) - ConvertRowBatchTime: 39.899us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 5.86 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.781us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 121.149us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s738ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1449627) - BuildTime: 1s746ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349696) - ProbeRows: 36.85M (36846776) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s760ms - RowsReturned: 698 (698) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s457ms - BuildRowsPartitioned: 1.45M (1449627) - GetNewBlockTime: 2.891ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.81K (3814) - HashTablesBuildTime: 276.253ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 199.212ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.477ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1449627) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.26 MB, 22.78 MB, 58.24 MB, 98.71 MB, 136.47 MB, 163.59 MB, 179.53 MB, 188.86 MB, 196.38 MB, 203.05 MB, 208.70 MB, 213.68 MB, 218.93 MB, 224.36 MB, 229.01 MB, 232.63 MB, 235.49 MB, 238.21 MB, 240.77 MB, 242.99 MB, 244.99 MB, 246.87 MB, 248.38 MB, 249.74 MB, 251.04 MB, 252.24 MB, 253.36 MB, 254.09 MB, 254.77 MB, 255.27 MB, 255.64 MB, 255.90 MB, 256.15 MB, 256.24 MB, 256.80 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB, 257.60 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 257.60 MB (270113307) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s990ms - NumBatchesAccepted: 13.00K (13004) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 2m, non-child: 1s436ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 36.85M (36846776) - RowsReturnedRate: 306.36 K/sec RecvrSide: BytesReceived(16s000ms): 6.66 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.19 MB, 129.63 MB, 394.25 MB, 504.61 MB, 567.18 MB, 612.50 MB, 642.65 MB, 657.00 MB - FirstBatchArrivalWaitTime: 2s910ms - TotalBytesReceived: 661.26 MB (693378383) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s489ms - NumBatchesAccepted: 56.32K (56321) - NumBatchesRejected: 15 (15) Instance 5f429df048b5534b:41bcce1800000236 (host=foo.232.36:22000):(Total: 12m37s, non-child: 88.274ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.55 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.20 MB, 162.42 MB, 162.89 MB, 237.88 MB, 292.42 MB, 312.91 MB, 331.68 MB, 368.65 MB, 395.43 MB, 410.43 MB, 410.39 MB, 418.38 MB, 422.18 MB, 428.93 MB, 434.42 MB, 434.40 MB, 434.42 MB, 438.90 MB, 442.41 MB, 442.42 MB, 442.40 MB, 442.41 MB, 442.41 MB, 442.42 MB, 442.40 MB, 442.44 MB, 442.42 MB, 442.39 MB, 442.43 MB, 442.42 MB, 442.42 MB, 442.43 MB, 442.45 MB, 446.41 MB, 500.31 MB, 627.55 MB, 628.08 MB, 627.96 MB, 627.89 MB, 628.03 MB, 628.13 MB, 628.36 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.30 MB (672455350) - PerHostPeakMemUsage: 1.26 GB (1351808176) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 25.256ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3825) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s216ms - TotalThreadsUserTime: 9s546ms - TotalThreadsVoluntaryContextSwitches: 64.07K (64071) Fragment Instance Lifecycle Timings: - ExecTime: 1m55s - ExecTreeExecTime: 1m55s - OpenTime: 10m42s - ExecTreeOpenTime: 10m42s - PrepareTime: 48.550ms - ExecTreePrepareTime: 846.019us DataStreamSender (dst_id=26):(Total: 472.684us, non-child: 472.684us, % non-child: 100.00%) - BytesSent: 8.72 KB (8927) - OverallThroughput: 18.01 MB/sec - PeakMemoryUsage: 228.66 KB (234144) - RowsReturned: 40 (40) - SerializeBatchTime: 358.620us - UncompressedRowBatchSize: 8.72 KB (8927) CodeGen:(Total: 595.779ms, non-child: 595.779ms, % non-child: 100.00%) - CodegenTime: 16.575ms - CompileTime: 201.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 369.097ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.204ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 598.268ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 46.488us - GetResultsTime: 105.513us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919540) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 584.283ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.193ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 777.252us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619636) - ProbeRows: 84 (84) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.750us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 142.031us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 405.007us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 125.367us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s492ms, non-child: 62.003us, % non-child: 0.00%) - ConvertRowBatchTime: 42.886us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s492ms - DataArrivalTimer: 1s492ms SenderSide: - DeserializeRowBatchTimer: 204.810us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 51.889ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 531.864us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563316) - ProbeRows: 84 (84) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 146.073us - RowsReturned: 84 (84) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.749us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 339.108us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.620us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 16.280ms, non-child: 18.633us, % non-child: 0.11%) - ConvertRowBatchTime: 8.430us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.83 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 16.265ms - DataArrivalTimer: 16.262ms SenderSide: - DeserializeRowBatchTimer: 50.403us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s752ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.48M (1475095) - BuildTime: 1s747ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058655) - ProbeRows: 37.06M (37057530) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s793ms - RowsReturned: 84 (84) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s436ms - BuildRowsPartitioned: 1.48M (1475095) - GetNewBlockTime: 2.689ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.12K (4122) - HashTablesBuildTime: 298.648ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 199.826ms, % non-child: 0.03%) - ConvertRowBatchTime: 92.454ms - PeakMemoryUsage: 0 - RowsReturned: 1.48M (1475095) - RowsReturnedRate: 2.33 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.37 MB, 22.89 MB, 58.19 MB, 98.70 MB, 136.84 MB, 163.30 MB, 179.31 MB, 188.88 MB, 196.59 MB, 203.42 MB, 209.23 MB, 214.42 MB, 219.94 MB, 225.42 MB, 230.13 MB, 233.70 MB, 236.61 MB, 239.43 MB, 242.00 MB, 244.31 MB, 246.44 MB, 248.43 MB, 250.08 MB, 251.69 MB, 252.99 MB, 254.46 MB, 255.48 MB, 256.49 MB, 257.10 MB, 257.48 MB, 257.77 MB, 258.11 MB, 258.33 MB, 258.47 MB, 259.14 MB, 259.94 MB, 259.94 MB, 259.94 MB, 259.94 MB, 259.94 MB, 259.94 MB, 259.94 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 259.94 MB (272566816) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s005ms - NumBatchesAccepted: 13.24K (13237) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s425ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s053ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37057530) - RowsReturnedRate: 311.61 K/sec RecvrSide: BytesReceived(16s000ms): 6.81 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.58 MB, 132.82 MB, 398.91 MB, 508.14 MB, 571.00 MB, 616.38 MB, 646.54 MB, 660.77 MB - FirstBatchArrivalWaitTime: 2s932ms - TotalBytesReceived: 664.98 MB (697276836) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s465ms - NumBatchesAccepted: 56.64K (56642) - NumBatchesRejected: 42 (42) Instance 5f429df048b5534b:41bcce1800000292 (host=foo.234.36:22000):(Total: 12m37s, non-child: 62.320ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.06 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 32.55 MB, 162.41 MB, 162.43 MB, 228.90 MB, 290.40 MB, 302.67 MB, 334.65 MB, 361.43 MB, 389.17 MB, 400.64 MB, 416.89 MB, 418.39 MB, 418.42 MB, 418.44 MB, 423.91 MB, 426.40 MB, 426.42 MB, 429.42 MB, 434.40 MB, 434.41 MB, 434.40 MB, 434.41 MB, 434.42 MB, 434.43 MB, 434.41 MB, 434.44 MB, 434.43 MB, 434.39 MB, 434.44 MB, 434.42 MB, 434.40 MB, 434.42 MB, 434.37 MB, 434.42 MB, 458.36 MB, 610.34 MB, 609.69 MB, 610.02 MB, 610.32 MB, 609.89 MB, 609.73 MB, 609.97 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 623.30 MB (653580982) - PerHostPeakMemUsage: 1.21 GB (1300992377) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 13.144ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.17K (4166) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s214ms - TotalThreadsUserTime: 9s608ms - TotalThreadsVoluntaryContextSwitches: 63.32K (63321) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 44.600ms - ExecTreePrepareTime: 746.524us DataStreamSender (dst_id=26):(Total: 651.897us, non-child: 651.897us, % non-child: 100.00%) - BytesSent: 9.91 KB (10147) - OverallThroughput: 14.84 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 48 (48) - SerializeBatchTime: 499.702us - UncompressedRowBatchSize: 9.91 KB (10147) CodeGen:(Total: 704.145ms, non-child: 704.145ms, % non-child: 100.00%) - CodegenTime: 14.547ms - CompileTime: 229.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 450.128ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.342ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 614.988ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 67.678us - GetResultsTime: 204.828us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 599.896ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.646ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 866.403us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619486) - ProbeRows: 710 (710) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 402.185us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 205.589us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 327.389us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 175.263us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s228ms, non-child: 64.772us, % non-child: 0.01%) - ConvertRowBatchTime: 46.420us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.39 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s228ms - DataArrivalTimer: 1s228ms SenderSide: - DeserializeRowBatchTimer: 232.134us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.729ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 492.074us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563166) - ProbeRows: 710 (710) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 537.877us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.794us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 304.734us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.243us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.239us, non-child: 14.239us, % non-child: 100.00%) - ConvertRowBatchTime: 7.707us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 19.24 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.665us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 83.472us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s641ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1430902) - BuildTime: 1s768ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 37.02M (37023728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s666ms - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s447ms - BuildRowsPartitioned: 1.43M (1430902) - GetNewBlockTime: 2.766ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.85K (3852) - HashTablesBuildTime: 307.546ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 206.451ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.630ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1430902) - RowsReturnedRate: 2.25 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.16 MB, 21.58 MB, 55.59 MB, 95.24 MB, 133.23 MB, 160.12 MB, 175.99 MB, 185.13 MB, 192.55 MB, 199.24 MB, 204.87 MB, 209.78 MB, 215.01 MB, 220.39 MB, 224.95 MB, 228.55 MB, 231.33 MB, 233.95 MB, 236.36 MB, 238.57 MB, 240.63 MB, 242.60 MB, 244.08 MB, 245.51 MB, 246.94 MB, 248.14 MB, 249.35 MB, 250.16 MB, 250.62 MB, 250.99 MB, 251.45 MB, 251.89 MB, 252.13 MB, 252.21 MB, 252.70 MB, 253.48 MB, 253.48 MB, 253.48 MB, 253.48 MB, 253.48 MB, 253.48 MB, 253.48 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 253.48 MB (265788843) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s841ms - NumBatchesAccepted: 12.84K (12844) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s436ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s055ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37023728) - RowsReturnedRate: 316.48 K/sec RecvrSide: BytesReceived(16s000ms): 6.58 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.91 MB, 128.47 MB, 394.09 MB, 506.26 MB, 569.38 MB, 615.09 MB, 645.43 MB, 660.03 MB - FirstBatchArrivalWaitTime: 2s669ms - TotalBytesReceived: 664.37 MB (696644158) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s157ms - NumBatchesAccepted: 56.59K (56585) - NumBatchesRejected: 87 (87) Instance 5f429df048b5534b:41bcce1800000222 (host=foo.232.43:22000):(Total: 12m37s, non-child: 187.932ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.28 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 33.44 MB, 162.42 MB, 162.42 MB, 230.90 MB, 291.89 MB, 305.65 MB, 334.37 MB, 356.63 MB, 371.89 MB, 400.65 MB, 413.39 MB, 418.40 MB, 424.90 MB, 428.63 MB, 434.40 MB, 434.40 MB, 434.37 MB, 434.40 MB, 434.39 MB, 434.39 MB, 434.40 MB, 434.38 MB, 434.38 MB, 434.40 MB, 434.39 MB, 434.40 MB, 434.39 MB, 434.38 MB, 434.39 MB, 434.39 MB, 434.39 MB, 434.39 MB, 434.37 MB, 434.42 MB, 493.17 MB, 612.23 MB, 612.26 MB, 611.87 MB, 611.55 MB, 612.03 MB, 612.05 MB, 612.35 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 625.28 MB (655656519) - PerHostPeakMemUsage: 1.43 GB (1530522299) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 29.511ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.58K (3580) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s173ms - TotalThreadsUserTime: 9s200ms - TotalThreadsVoluntaryContextSwitches: 65.32K (65321) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 44.664ms - ExecTreePrepareTime: 573.022us DataStreamSender (dst_id=26):(Total: 573.045us, non-child: 573.045us, % non-child: 100.00%) - BytesSent: 9.58 KB (9814) - OverallThroughput: 16.33 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 45 (45) - SerializeBatchTime: 458.260us - UncompressedRowBatchSize: 9.58 KB (9814) CodeGen:(Total: 632.741ms, non-child: 632.741ms, % non-child: 100.00%) - CodegenTime: 19.714ms - CompileTime: 212.976ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 397.993ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 21.218ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 678.568ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 66.419us - GetResultsTime: 206.224us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9931374) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 664.727ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.920ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 802.462us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9627374) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 108.795us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 131.708us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 471.402us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 91.172us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s681ms, non-child: 59.756us, % non-child: 0.00%) - ConvertRowBatchTime: 45.426us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.01 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s681ms - DataArrivalTimer: 1s681ms SenderSide: - DeserializeRowBatchTimer: 138.592us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 1.892ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 692.688us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9571054) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 139.946us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.614us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 363.960us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.397us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.671us, non-child: 17.671us, % non-child: 100.00%) - ConvertRowBatchTime: 7.691us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.51 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.016us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 78.832us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s494ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1447435) - BuildTime: 1s762ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 600.13 MB (629281024) - ProbeRows: 37.07M (37068282) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s522ms - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s453ms - BuildRowsPartitioned: 1.45M (1447435) - GetNewBlockTime: 3.192ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.82K (3818) - HashTablesBuildTime: 295.541ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 600.06 MB (629209216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 206.460ms, % non-child: 0.03%) - ConvertRowBatchTime: 94.746ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1447435) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.19 MB, 21.76 MB, 56.03 MB, 95.75 MB, 133.33 MB, 160.22 MB, 175.95 MB, 185.38 MB, 193.06 MB, 199.84 MB, 205.56 MB, 210.62 MB, 216.09 MB, 221.47 MB, 226.09 MB, 229.68 MB, 232.58 MB, 235.27 MB, 237.88 MB, 240.16 MB, 242.22 MB, 244.17 MB, 245.74 MB, 247.05 MB, 248.35 MB, 249.60 MB, 250.66 MB, 251.40 MB, 252.11 MB, 252.58 MB, 252.96 MB, 253.40 MB, 253.73 MB, 253.80 MB, 254.44 MB, 255.22 MB, 255.22 MB, 255.22 MB, 255.22 MB, 255.22 MB, 255.22 MB, 255.22 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 255.22 MB (267619381) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s805ms - NumBatchesAccepted: 12.99K (12990) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s398ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s040ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37068282) - RowsReturnedRate: 309.09 K/sec RecvrSide: BytesReceived(16s000ms): 6.65 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.23 MB, 130.10 MB, 396.22 MB, 507.49 MB, 570.56 MB, 616.21 MB, 646.49 MB, 660.95 MB - FirstBatchArrivalWaitTime: 2s788ms - TotalBytesReceived: 665.24 MB (697552998) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s293ms - NumBatchesAccepted: 56.66K (56662) - NumBatchesRejected: 39 (39) Instance 5f429df048b5534b:41bcce180000028a (host=foo.234.42:22000):(Total: 12m37s, non-child: 66.147ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.57 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 33.95 MB, 162.40 MB, 162.39 MB, 225.65 MB, 290.41 MB, 297.63 MB, 327.63 MB, 355.66 MB, 376.15 MB, 386.37 MB, 390.65 MB, 394.39 MB, 409.35 MB, 418.38 MB, 418.38 MB, 424.39 MB, 426.40 MB, 426.38 MB, 426.40 MB, 426.40 MB, 426.38 MB, 426.39 MB, 426.39 MB, 437.64 MB, 442.41 MB, 442.39 MB, 442.39 MB, 442.41 MB, 442.43 MB, 442.37 MB, 442.40 MB, 445.15 MB, 450.40 MB, 450.40 MB, 477.24 MB, 623.46 MB, 624.41 MB, 623.53 MB, 623.85 MB, 623.74 MB, 624.08 MB, 623.60 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 637.28 MB (668239431) - PerHostPeakMemUsage: 1.31 GB (1403897182) - RowsProduced: 36 (36) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 10.313ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3833) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s178ms - TotalThreadsUserTime: 9s519ms - TotalThreadsVoluntaryContextSwitches: 63.57K (63572) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 61.307ms - ExecTreePrepareTime: 1.285ms DataStreamSender (dst_id=26):(Total: 376.264us, non-child: 376.264us, % non-child: 100.00%) - BytesSent: 7.98 KB (8174) - OverallThroughput: 20.72 MB/sec - PeakMemoryUsage: 204.66 KB (209568) - RowsReturned: 36 (36) - SerializeBatchTime: 212.784us - UncompressedRowBatchSize: 7.98 KB (8174) CodeGen:(Total: 695.976ms, non-child: 695.976ms, % non-child: 100.00%) - CodegenTime: 15.766ms - CompileTime: 258.981ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 400.547ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 35.293ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 628.586ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 67.495us - GetResultsTime: 86.953us - HTResizeTime: 0.000ns - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9914490) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 36 (36) - RowsReturnedRate: 0 - StreamingTime: 615.810ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.231ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.342ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623099) - ProbeRows: 76 (76) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 94.899us - RowsReturned: 72 (72) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 209.230us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 845.027us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.956us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s460ms, non-child: 73.352us, % non-child: 0.01%) - ConvertRowBatchTime: 49.169us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s460ms - DataArrivalTimer: 1s460ms SenderSide: - DeserializeRowBatchTimer: 165.719us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 7.088ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 991.807us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566779) - ProbeRows: 76 (76) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.683us - RowsReturned: 76 (76) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 30.296us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 611.457us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 111.324us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 32.563us, non-child: 32.563us, % non-child: 100.00%) - ConvertRowBatchTime: 20.564us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 8.41 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.706us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 70.783us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s648ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1413591) - BuildTime: 1s784ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 612.13 MB (641863936) - ProbeRows: 36.98M (36983027) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s651ms - RowsReturned: 76 (76) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s451ms - BuildRowsPartitioned: 1.41M (1413591) - GetNewBlockTime: 2.924ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.50K (4505) - HashTablesBuildTime: 319.220ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 612.06 MB (641792128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 206.776ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.190ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1413591) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.25 MB, 21.78 MB, 55.29 MB, 94.25 MB, 131.09 MB, 156.47 MB, 171.40 MB, 180.61 MB, 188.12 MB, 194.74 MB, 200.42 MB, 205.42 MB, 210.70 MB, 216.05 MB, 220.62 MB, 224.28 MB, 227.23 MB, 229.98 MB, 232.48 MB, 234.72 MB, 236.82 MB, 238.78 MB, 240.35 MB, 241.86 MB, 243.22 MB, 244.71 MB, 245.81 MB, 246.67 MB, 247.35 MB, 247.69 MB, 247.91 MB, 248.26 MB, 248.60 MB, 248.71 MB, 249.35 MB, 250.12 MB, 250.12 MB, 250.12 MB, 250.12 MB, 250.12 MB, 250.12 MB, 250.12 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 250.12 MB (262271661) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s745ms - NumBatchesAccepted: 12.69K (12688) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s413ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s057ms - PeakMemoryUsage: 0 - RowsReturned: 36.98M (36983027) - RowsReturnedRate: 316.49 K/sec RecvrSide: BytesReceived(16s000ms): 6.75 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.33 MB, 131.82 MB, 397.55 MB, 506.97 MB, 569.73 MB, 615.12 MB, 645.27 MB, 659.54 MB - FirstBatchArrivalWaitTime: 2s659ms - TotalBytesReceived: 663.77 MB (696008697) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s130ms - NumBatchesAccepted: 56.52K (56523) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce180000026b (host=foo.234.40:22000):(Total: 12m37s, non-child: 74.770ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.64 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 34.72 MB, 162.18 MB, 162.40 MB, 228.88 MB, 288.42 MB, 296.41 MB, 316.16 MB, 371.16 MB, 378.44 MB, 386.44 MB, 409.16 MB, 410.43 MB, 410.40 MB, 410.44 MB, 410.44 MB, 410.40 MB, 410.43 MB, 410.43 MB, 410.42 MB, 417.42 MB, 426.42 MB, 426.42 MB, 429.67 MB, 434.43 MB, 434.43 MB, 434.42 MB, 434.40 MB, 434.44 MB, 434.45 MB, 434.42 MB, 434.41 MB, 434.39 MB, 434.44 MB, 434.44 MB, 472.91 MB, 609.28 MB, 610.69 MB, 609.51 MB, 609.63 MB, 609.61 MB, 609.88 MB, 609.63 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 623.31 MB (653589334) - PerHostPeakMemUsage: 1.30 GB (1393390360) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 18.236ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.80K (3796) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s192ms - TotalThreadsUserTime: 9s544ms - TotalThreadsVoluntaryContextSwitches: 63.93K (63932) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 51.240ms - ExecTreePrepareTime: 837.780us DataStreamSender (dst_id=26):(Total: 652.930us, non-child: 652.930us, % non-child: 100.00%) - BytesSent: 12.18 KB (12471) - OverallThroughput: 18.22 MB/sec - PeakMemoryUsage: 276.66 KB (283296) - RowsReturned: 56 (56) - SerializeBatchTime: 510.570us - UncompressedRowBatchSize: 12.18 KB (12471) CodeGen:(Total: 696.686ms, non-child: 696.686ms, % non-child: 100.00%) - CodegenTime: 17.497ms - CompileTime: 239.845ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 119 (119) - NumInstructions: 7.22K (7221) - OptimizationTime: 428.447ms - PeakMemoryUsage: 3.53 MB (3697152) - PrepareTime: 27.826ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 656.678ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 221.917us - GetResultsTime: 123.274us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9928820) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 642.559ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.429ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.885ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624820) - ProbeRows: 728 (728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 432.049us - RowsReturned: 726 (726) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 175.751us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.328ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 189.335us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 358.785ms, non-child: 84.408us, % non-child: 0.02%) - ConvertRowBatchTime: 70.107us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 4.75 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 358.706ms - DataArrivalTimer: 358.701ms SenderSide: - DeserializeRowBatchTimer: 242.300us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 3.020ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.478ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9568500) - ProbeRows: 728 (728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 585.587us - RowsReturned: 728 (728) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 64.123us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 999.490us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 97.958us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 19.182us, non-child: 19.182us, % non-child: 100.00%) - ConvertRowBatchTime: 9.833us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.28 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.126us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 138.131us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s730ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1406893) - BuildTime: 1s755ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 36.99M (36986207) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s751ms - RowsReturned: 728 (728) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s456ms - BuildRowsPartitioned: 1.41M (1406893) - GetNewBlockTime: 3.159ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.90K (2895) - HashTablesBuildTime: 286.321ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 199.817ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.276ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1406893) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.30 MB, 21.98 MB, 55.92 MB, 94.66 MB, 131.31 MB, 156.39 MB, 171.01 MB, 179.92 MB, 187.21 MB, 193.74 MB, 199.26 MB, 204.17 MB, 209.37 MB, 214.55 MB, 219.02 MB, 222.45 MB, 225.17 MB, 227.76 MB, 230.36 MB, 232.66 MB, 234.74 MB, 236.68 MB, 238.22 MB, 239.63 MB, 241.02 MB, 242.26 MB, 243.36 MB, 244.14 MB, 244.70 MB, 245.14 MB, 245.44 MB, 245.80 MB, 246.04 MB, 246.13 MB, 246.73 MB, 247.52 MB, 247.52 MB, 247.52 MB, 247.52 MB, 247.52 MB, 247.52 MB, 247.52 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 247.52 MB (259540418) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s830ms - NumBatchesAccepted: 12.63K (12627) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s427ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s061ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36986207) - RowsReturnedRate: 314.47 K/sec RecvrSide: BytesReceived(16s000ms): 6.79 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.46 MB, 132.20 MB, 397.84 MB, 507.03 MB, 569.84 MB, 615.13 MB, 645.23 MB, 659.47 MB - FirstBatchArrivalWaitTime: 2s670ms - TotalBytesReceived: 663.69 MB (695928374) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s512ms - NumBatchesAccepted: 56.53K (56529) - NumBatchesRejected: 61 (61) Instance 5f429df048b5534b:41bcce1800000288 (host=foo.234.39:22000):(Total: 12m37s, non-child: 65.523ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.44 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 32.94 MB, 162.38 MB, 162.41 MB, 230.61 MB, 289.91 MB, 291.89 MB, 332.88 MB, 384.40 MB, 398.63 MB, 402.40 MB, 402.40 MB, 402.41 MB, 402.40 MB, 406.40 MB, 418.39 MB, 418.37 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.41 MB, 418.41 MB, 418.41 MB, 418.40 MB, 433.89 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.38 MB, 434.42 MB, 434.42 MB, 434.46 MB, 434.34 MB, 462.48 MB, 615.89 MB, 616.42 MB, 615.79 MB, 615.96 MB, 615.90 MB, 616.07 MB, 615.97 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 629.28 MB (659850823) - PerHostPeakMemUsage: 1.30 GB (1392426219) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 10.491ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.63K (3631) - TotalThreadsTotalWallClockTime: 23m17s - TotalThreadsSysTime: 1s198ms - TotalThreadsUserTime: 9s567ms - TotalThreadsVoluntaryContextSwitches: 63.98K (63980) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 59.710ms - ExecTreePrepareTime: 1.559ms DataStreamSender (dst_id=26):(Total: 516.520us, non-child: 516.520us, % non-child: 100.00%) - BytesSent: 10.52 KB (10777) - OverallThroughput: 19.90 MB/sec - PeakMemoryUsage: 228.66 KB (234144) - RowsReturned: 45 (45) - SerializeBatchTime: 341.294us - UncompressedRowBatchSize: 10.52 KB (10777) CodeGen:(Total: 716.364ms, non-child: 716.364ms, % non-child: 100.00%) - CodegenTime: 20.344ms - CompileTime: 235.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 447.402ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 32.868ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 658.863ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 101.693us - GetResultsTime: 93.116us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9915294) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 645.565ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.669ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.002ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619486) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 122.690us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 153.326us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 481.070us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 215.975us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s292ms, non-child: 63.262us, % non-child: 0.00%) - ConvertRowBatchTime: 42.241us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 743.00 /sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s292ms - DataArrivalTimer: 2s292ms SenderSide: - DeserializeRowBatchTimer: 227.842us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 7.485ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 535.545us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563166) - ProbeRows: 90 (90) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 143.344us - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.208us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 329.820us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.459us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.530us, non-child: 14.530us, % non-child: 100.00%) - ConvertRowBatchTime: 7.484us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.86 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.914us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 285.528us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s752ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1424476) - BuildTime: 1s784ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 604.13 MB (633475328) - ProbeRows: 37.02M (37021747) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s735ms - RowsReturned: 90 (90) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s487ms - BuildRowsPartitioned: 1.42M (1424476) - GetNewBlockTime: 3.242ms - HashBuckets: 3.80M (3801088) - HashCollisions: 4.80K (4803) - HashTablesBuildTime: 283.940ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 604.06 MB (633403520) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 206.871ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.222ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1424476) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.24 MB, 21.97 MB, 56.14 MB, 95.80 MB, 132.65 MB, 158.42 MB, 173.65 MB, 183.01 MB, 190.74 MB, 197.54 MB, 203.34 MB, 208.39 MB, 213.74 MB, 219.22 MB, 223.94 MB, 227.62 MB, 230.63 MB, 233.38 MB, 235.98 MB, 238.29 MB, 240.28 MB, 242.23 MB, 243.86 MB, 245.15 MB, 246.56 MB, 247.82 MB, 248.89 MB, 249.55 MB, 250.24 MB, 250.70 MB, 251.04 MB, 251.23 MB, 251.33 MB, 251.41 MB, 252.06 MB, 252.94 MB, 252.94 MB, 252.94 MB, 252.94 MB, 252.94 MB, 252.94 MB, 252.94 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 252.94 MB (265231658) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m35s SenderSide: - DeserializeRowBatchTimer: 1s807ms - NumBatchesAccepted: 12.78K (12779) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s444ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s079ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37021747) - RowsReturnedRate: 317.13 K/sec RecvrSide: BytesReceived(16s000ms): 6.74 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.29 MB, 131.55 MB, 397.51 MB, 507.32 MB, 570.17 MB, 615.60 MB, 645.79 MB, 660.14 MB - FirstBatchArrivalWaitTime: 2s645ms - TotalBytesReceived: 664.38 MB (696649386) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s520ms - NumBatchesAccepted: 56.58K (56583) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce1800000232 (host=foo.234.43:22000):(Total: 12m37s, non-child: 90.626ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.05 MB, 21.27 MB, 21.27 MB, 21.27 MB, 21.27 MB, 32.46 MB, 162.40 MB, 162.43 MB, 229.44 MB, 290.43 MB, 300.42 MB, 316.42 MB, 358.67 MB, 388.20 MB, 410.40 MB, 410.41 MB, 410.65 MB, 418.39 MB, 418.42 MB, 418.39 MB, 425.66 MB, 426.44 MB, 426.42 MB, 426.43 MB, 426.40 MB, 426.41 MB, 426.41 MB, 426.44 MB, 428.17 MB, 434.41 MB, 434.43 MB, 434.44 MB, 439.44 MB, 442.44 MB, 442.43 MB, 442.42 MB, 442.40 MB, 442.33 MB, 442.38 MB, 497.00 MB, 620.11 MB, 619.74 MB, 619.79 MB, 619.56 MB, 620.17 MB, 619.64 MB, 619.34 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 633.31 MB (664075062) - PerHostPeakMemUsage: 1.31 GB (1402606304) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 24.946ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.84K (3843) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s210ms - TotalThreadsUserTime: 9s476ms - TotalThreadsVoluntaryContextSwitches: 63.27K (63270) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m35s - ExecTreeOpenTime: 10m34s - PrepareTime: 58.571ms - ExecTreePrepareTime: 652.802us DataStreamSender (dst_id=26):(Total: 341.809us, non-child: 341.809us, % non-child: 100.00%) - BytesSent: 10.72 KB (10981) - OverallThroughput: 30.64 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 48 (48) - SerializeBatchTime: 233.658us - UncompressedRowBatchSize: 10.72 KB (10981) CodeGen:(Total: 696.340ms, non-child: 696.340ms, % non-child: 100.00%) - CodegenTime: 16.660ms - CompileTime: 252.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 413.188ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.077ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 608.161ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 106.398us - GetResultsTime: 105.438us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9924378) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 595.434ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.145ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.446ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620378) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 121.515us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 321.104us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 601.049us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 159.269us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 82.741us, non-child: 82.741us, % non-child: 100.00%) - ConvertRowBatchTime: 69.329us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 20.59 M/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 4.898us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 152.514us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.177ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 861.890us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564058) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.149us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.579us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 418.572us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 121.015us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 21.606us, non-child: 21.606us, % non-child: 100.00%) - ConvertRowBatchTime: 12.609us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 12.68 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.476us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 118.202us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s687ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1427842) - BuildTime: 1s806ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 608.13 MB (637669632) - ProbeRows: 36.92M (36915309) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s667ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s477ms - BuildRowsPartitioned: 1.43M (1427842) - GetNewBlockTime: 2.799ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.50K (4505) - HashTablesBuildTime: 315.416ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 608.06 MB (637597824) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 203.207ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.935ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1427842) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.15 MB, 21.48 MB, 55.67 MB, 95.33 MB, 132.61 MB, 158.46 MB, 173.72 MB, 182.91 MB, 190.45 MB, 197.13 MB, 202.77 MB, 207.77 MB, 212.99 MB, 218.40 MB, 222.97 MB, 226.59 MB, 229.50 MB, 232.22 MB, 234.71 MB, 236.88 MB, 238.87 MB, 240.82 MB, 242.36 MB, 243.68 MB, 245.03 MB, 246.37 MB, 247.41 MB, 248.22 MB, 248.90 MB, 249.27 MB, 249.61 MB, 249.91 MB, 250.15 MB, 250.24 MB, 250.89 MB, 251.70 MB, 251.70 MB, 251.70 MB, 251.70 MB, 251.70 MB, 251.70 MB, 251.70 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 251.70 MB (263923007) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s806ms - NumBatchesAccepted: 12.81K (12811) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s433ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s074ms - PeakMemoryUsage: 0 - RowsReturned: 36.92M (36915309) - RowsReturnedRate: 309.01 K/sec RecvrSide: BytesReceived(16s000ms): 6.57 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 11.99 MB, 127.92 MB, 392.85 MB, 504.85 MB, 567.79 MB, 613.37 MB, 643.63 MB, 658.21 MB - FirstBatchArrivalWaitTime: 2s684ms - TotalBytesReceived: 662.54 MB (694720158) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s283ms - NumBatchesAccepted: 56.43K (56427) - NumBatchesRejected: 39 (39) Instance 5f429df048b5534b:41bcce180000021c (host=foo.234.48:22000):(Total: 12m37s, non-child: 242.660ms, % non-child: 0.03%) MemoryUsage(16s000ms): 15.82 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 37.60 MB, 162.38 MB, 162.38 MB, 231.90 MB, 290.39 MB, 296.65 MB, 325.37 MB, 361.13 MB, 385.65 MB, 411.65 MB, 418.40 MB, 418.40 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.39 MB, 418.38 MB, 424.91 MB, 426.38 MB, 426.40 MB, 426.41 MB, 426.37 MB, 426.39 MB, 426.38 MB, 427.63 MB, 434.40 MB, 434.37 MB, 434.40 MB, 434.40 MB, 434.39 MB, 434.43 MB, 434.38 MB, 434.43 MB, 434.39 MB, 501.11 MB, 610.20 MB, 610.31 MB, 609.66 MB, 609.72 MB, 610.31 MB, 609.61 MB, 609.25 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 623.28 MB (653559367) - PerHostPeakMemUsage: 1.28 GB (1370121389) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 187.755ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3830) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s199ms - TotalThreadsUserTime: 9s479ms - TotalThreadsVoluntaryContextSwitches: 64.11K (64105) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m39s - ExecTreeOpenTime: 10m39s - PrepareTime: 58.281ms - ExecTreePrepareTime: 1.741ms DataStreamSender (dst_id=26):(Total: 680.585us, non-child: 680.585us, % non-child: 100.00%) - BytesSent: 11.46 KB (11731) - OverallThroughput: 16.44 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 51 (51) - SerializeBatchTime: 498.255us - UncompressedRowBatchSize: 11.46 KB (11731) CodeGen:(Total: 736.661ms, non-child: 736.661ms, % non-child: 100.00%) - CodegenTime: 16.392ms - CompileTime: 241.741ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 460.889ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.479ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 579.763ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 66.940us - GetResultsTime: 142.648us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9917140) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 568.029ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.244ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.172ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621332) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.502us - RowsReturned: 102 (102) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 166.557us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 563.485us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 246.212us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 798.321ms, non-child: 60.175us, % non-child: 0.01%) - ConvertRowBatchTime: 42.120us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.13 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 798.268ms - DataArrivalTimer: 798.261ms SenderSide: - DeserializeRowBatchTimer: 316.699us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 25.426ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 600.841us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565012) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 143.614us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.806us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 377.254us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.011us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 18.837us, non-child: 18.837us, % non-child: 100.00%) - ConvertRowBatchTime: 8.496us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.55 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.398us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 227.299us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s585ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1442085) - BuildTime: 1s754ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 598.13 MB (627183872) - ProbeRows: 36.92M (36922517) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s606ms - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s473ms - BuildRowsPartitioned: 1.44M (1442085) - GetNewBlockTime: 2.903ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.32K (2316) - HashTablesBuildTime: 267.651ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 598.06 MB (627112064) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 206.208ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.046ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1442085) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.41 MB, 22.57 MB, 56.87 MB, 96.00 MB, 132.57 MB, 159.16 MB, 174.65 MB, 183.86 MB, 191.39 MB, 198.10 MB, 203.82 MB, 208.82 MB, 214.20 MB, 219.57 MB, 224.31 MB, 227.99 MB, 230.94 MB, 233.66 MB, 236.15 MB, 238.37 MB, 240.40 MB, 242.34 MB, 243.80 MB, 245.18 MB, 246.53 MB, 247.80 MB, 248.88 MB, 249.61 MB, 250.22 MB, 250.64 MB, 250.96 MB, 251.15 MB, 251.35 MB, 251.44 MB, 252.07 MB, 252.87 MB, 252.87 MB, 252.87 MB, 252.87 MB, 252.87 MB, 252.87 MB, 252.87 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 252.87 MB (265155924) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m31s SenderSide: - DeserializeRowBatchTimer: 1s891ms - NumBatchesAccepted: 12.94K (12937) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s429ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 36.92M (36922517) - RowsReturnedRate: 307.95 K/sec RecvrSide: BytesReceived(16s000ms): 6.90 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.96 MB, 134.84 MB, 400.14 MB, 507.31 MB, 569.71 MB, 614.70 MB, 644.61 MB, 658.58 MB - FirstBatchArrivalWaitTime: 2s500ms - TotalBytesReceived: 662.71 MB (694902224) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s331ms - NumBatchesAccepted: 56.44K (56435) - NumBatchesRejected: 19 (19) Instance 5f429df048b5534b:41bcce1800000238 (host=foo.234.37:22000):(Total: 12m37s, non-child: 90.512ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.74 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.97 MB, 162.42 MB, 162.68 MB, 240.16 MB, 290.17 MB, 322.69 MB, 360.91 MB, 386.40 MB, 393.42 MB, 398.41 MB, 402.40 MB, 410.42 MB, 410.41 MB, 417.91 MB, 418.41 MB, 419.40 MB, 430.16 MB, 434.42 MB, 440.18 MB, 444.17 MB, 456.41 MB, 458.40 MB, 458.39 MB, 458.41 MB, 458.40 MB, 458.41 MB, 458.40 MB, 458.44 MB, 458.39 MB, 458.45 MB, 458.40 MB, 458.42 MB, 458.42 MB, 458.49 MB, 508.80 MB, 638.38 MB, 637.84 MB, 638.08 MB, 637.84 MB, 637.48 MB, 637.83 MB, 638.26 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.30 MB (682941110) - PerHostPeakMemUsage: 1.30 GB (1398836132) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m33s - TotalNetworkSendTime: 25.893ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.67K (3671) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s219ms - TotalThreadsUserTime: 9s502ms - TotalThreadsVoluntaryContextSwitches: 64.10K (64096) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 65.213ms - ExecTreePrepareTime: 716.060us DataStreamSender (dst_id=26):(Total: 406.213us, non-child: 406.213us, % non-child: 100.00%) - BytesSent: 11.16 KB (11427) - OverallThroughput: 26.83 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 50 (50) - SerializeBatchTime: 309.945us - UncompressedRowBatchSize: 11.16 KB (11427) CodeGen:(Total: 706.735ms, non-child: 706.735ms, % non-child: 100.00%) - CodegenTime: 16.040ms - CompileTime: 262.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 410.012ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.890ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 628.249ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 61.846us - GetResultsTime: 130.014us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921761) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 615.117ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.185ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 636.115us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 162.359us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 116.128us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 267.106us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 158.811us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s117ms, non-child: 31.787us, % non-child: 0.00%) - ConvertRowBatchTime: 20.985us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 804.00 /sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s117ms - DataArrivalTimer: 2s117ms SenderSide: - DeserializeRowBatchTimer: 299.682us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.047ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 513.337us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.390us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 34.426us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 273.468us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.477us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 19.529us, non-child: 19.529us, % non-child: 100.00%) - ConvertRowBatchTime: 10.995us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.03 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.956us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 66.043us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s711ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.49M (1487873) - BuildTime: 1s792ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 37.14M (37137439) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s696ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s475ms - BuildRowsPartitioned: 1.49M (1487873) - GetNewBlockTime: 2.914ms - HashBuckets: 3.67M (3670016) - HashCollisions: 1.94K (1943) - HashTablesBuildTime: 303.122ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 205.109ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.828ms - PeakMemoryUsage: 0 - RowsReturned: 1.49M (1487873) - RowsReturnedRate: 2.35 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.37 MB, 23.06 MB, 58.31 MB, 99.26 MB, 138.19 MB, 165.54 MB, 181.56 MB, 191.00 MB, 198.70 MB, 205.45 MB, 211.17 MB, 216.24 MB, 221.65 MB, 227.08 MB, 231.67 MB, 235.19 MB, 238.04 MB, 240.79 MB, 243.37 MB, 245.65 MB, 247.82 MB, 249.94 MB, 251.51 MB, 253.02 MB, 254.49 MB, 255.92 MB, 257.12 MB, 257.90 MB, 258.58 MB, 259.06 MB, 259.28 MB, 259.62 MB, 259.86 MB, 259.93 MB, 260.53 MB, 261.32 MB, 261.32 MB, 261.32 MB, 261.32 MB, 261.32 MB, 261.32 MB, 261.32 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.32 MB (274012021) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s857ms - NumBatchesAccepted: 13.35K (13349) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s418ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 37.14M (37137439) - RowsReturnedRate: 313.29 K/sec RecvrSide: BytesReceived(16s000ms): 6.85 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.74 MB, 133.99 MB, 400.59 MB, 509.54 MB, 572.44 MB, 617.82 MB, 647.98 MB, 662.18 MB - FirstBatchArrivalWaitTime: 2s655ms - TotalBytesReceived: 666.38 MB (698751717) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s306ms - NumBatchesAccepted: 56.77K (56766) - NumBatchesRejected: 45 (45) Instance 5f429df048b5534b:41bcce1800000240 (host=foo.234.38:22000):(Total: 12m37s, non-child: 75.894ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.70 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 36.95 MB, 162.41 MB, 162.42 MB, 236.38 MB, 290.67 MB, 317.64 MB, 341.65 MB, 364.63 MB, 384.39 MB, 408.65 MB, 410.39 MB, 410.36 MB, 410.38 MB, 418.39 MB, 439.13 MB, 442.38 MB, 442.39 MB, 443.87 MB, 450.39 MB, 450.37 MB, 450.39 MB, 450.38 MB, 450.63 MB, 458.38 MB, 458.39 MB, 458.38 MB, 458.38 MB, 458.41 MB, 458.39 MB, 458.37 MB, 458.41 MB, 458.39 MB, 458.40 MB, 458.40 MB, 507.31 MB, 633.95 MB, 633.76 MB, 633.80 MB, 634.07 MB, 634.00 MB, 633.72 MB, 633.62 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 647.28 MB (678725191) - PerHostPeakMemUsage: 1.22 GB (1311282730) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 21.122ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.90K (3897) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s087ms - TotalThreadsUserTime: 9s587ms - TotalThreadsVoluntaryContextSwitches: 64.06K (64065) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 51.482ms - ExecTreePrepareTime: 776.207us DataStreamSender (dst_id=26):(Total: 461.880us, non-child: 461.880us, % non-child: 100.00%) - BytesSent: 9.54 KB (9769) - OverallThroughput: 20.17 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 43 (43) - SerializeBatchTime: 301.726us - UncompressedRowBatchSize: 9.54 KB (9769) CodeGen:(Total: 635.285ms, non-child: 635.285ms, % non-child: 100.00%) - CodegenTime: 15.114ms - CompileTime: 207.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 398.617ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.241ms AGGREGATION_NODE (id=15):(Total: 12m37s, non-child: 605.615ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 108.994us - GetResultsTime: 148.395us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923536) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 592.525ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.112ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.034ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620228) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.695us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 144.210us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 528.008us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 168.588us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 165.271ms, non-child: 51.989us, % non-child: 0.03%) - ConvertRowBatchTime: 39.353us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 10.31 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 165.224ms - DataArrivalTimer: 165.220ms SenderSide: - DeserializeRowBatchTimer: 210.591us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.150ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 626.770us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563908) - ProbeRows: 88 (88) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.079us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.686us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 409.820us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.885us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 18.293us, non-child: 18.293us, % non-child: 100.00%) - ConvertRowBatchTime: 9.217us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.98 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.830us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 79.791us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s694ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1474247) - BuildTime: 1s860ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 622.13 MB (652349761) - ProbeRows: 36.99M (36993352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s624ms - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s594ms - BuildRowsPartitioned: 1.47M (1474247) - GetNewBlockTime: 2.644ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.14K (4139) - HashTablesBuildTime: 252.484ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 622.06 MB (652277888) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 211.756ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.837ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1474247) - RowsReturnedRate: 2.33 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.37 MB, 22.82 MB, 57.73 MB, 98.03 MB, 135.81 MB, 162.93 MB, 179.25 MB, 188.59 MB, 196.30 MB, 203.18 MB, 209.01 MB, 214.17 MB, 219.60 MB, 225.10 MB, 229.80 MB, 233.48 MB, 236.45 MB, 239.31 MB, 241.94 MB, 244.28 MB, 246.43 MB, 248.53 MB, 250.16 MB, 251.67 MB, 253.07 MB, 254.47 MB, 255.65 MB, 256.61 MB, 257.34 MB, 257.91 MB, 258.22 MB, 258.60 MB, 258.79 MB, 258.82 MB, 259.50 MB, 260.30 MB, 260.30 MB, 260.30 MB, 260.30 MB, 260.30 MB, 260.30 MB, 260.30 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 260.30 MB (272943694) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s768ms - NumBatchesAccepted: 13.23K (13227) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s404ms, % non-child: 1.18%) - ConvertRowBatchTime: 1s056ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36993352) - RowsReturnedRate: 311.60 K/sec RecvrSide: BytesReceived(16s000ms): 6.83 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.67 MB, 133.30 MB, 398.89 MB, 507.50 MB, 570.21 MB, 615.44 MB, 645.52 MB, 659.68 MB - FirstBatchArrivalWaitTime: 2s726ms - TotalBytesReceived: 663.88 MB (696127610) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s207ms - NumBatchesAccepted: 56.54K (56539) - NumBatchesRejected: 34 (34) Instance 5f429df048b5534b:41bcce1800000243 (host=foo.234.41:22000):(Total: 12m37s, non-child: 71.145ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.74 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.45 MB, 162.42 MB, 162.42 MB, 228.66 MB, 290.41 MB, 297.67 MB, 322.14 MB, 360.16 MB, 375.42 MB, 383.67 MB, 390.17 MB, 404.91 MB, 414.90 MB, 418.40 MB, 418.45 MB, 418.42 MB, 423.91 MB, 426.42 MB, 426.41 MB, 428.16 MB, 434.42 MB, 434.42 MB, 434.41 MB, 434.68 MB, 442.40 MB, 442.41 MB, 449.90 MB, 450.39 MB, 450.42 MB, 450.44 MB, 450.43 MB, 450.43 MB, 450.37 MB, 450.50 MB, 499.77 MB, 624.35 MB, 623.82 MB, 623.88 MB, 624.16 MB, 623.72 MB, 623.89 MB, 623.41 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 637.30 MB (668261046) - PerHostPeakMemUsage: 1.23 GB (1315807494) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 18.568ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.71K (3713) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s253ms - TotalThreadsUserTime: 9s220ms - TotalThreadsVoluntaryContextSwitches: 63.35K (63352) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 56.187ms - ExecTreePrepareTime: 1.036ms DataStreamSender (dst_id=26):(Total: 481.164us, non-child: 481.164us, % non-child: 100.00%) - BytesSent: 9.14 KB (9360) - OverallThroughput: 18.55 MB/sec - PeakMemoryUsage: 204.66 KB (209568) - RowsReturned: 40 (40) - SerializeBatchTime: 379.221us - UncompressedRowBatchSize: 9.14 KB (9360) CodeGen:(Total: 655.366ms, non-child: 655.366ms, % non-child: 100.00%) - CodegenTime: 15.429ms - CompileTime: 212.096ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 409.976ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 32.877ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 631.786ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 87.730us - GetResultsTime: 94.829us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923478) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 620.316ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.621ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 962.480us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623574) - ProbeRows: 698 (698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 438.224us - RowsReturned: 694 (694) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 154.448us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 413.080us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 163.035us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s612ms, non-child: 56.942us, % non-child: 0.00%) - ConvertRowBatchTime: 42.437us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.06 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s612ms - DataArrivalTimer: 1s612ms SenderSide: - DeserializeRowBatchTimer: 162.187us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.900ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 639.465us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567254) - ProbeRows: 698 (698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 522.773us - RowsReturned: 698 (698) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.950us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 387.714us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.643us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.830us, non-child: 15.830us, % non-child: 100.00%) - ConvertRowBatchTime: 7.995us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.31 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.589us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 58.739us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s519ms, % non-child: 0.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1407154) - BuildTime: 1s737ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 612.13 MB (641863936) - ProbeRows: 36.97M (36970063) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s562ms - RowsReturned: 698 (698) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s459ms - BuildRowsPartitioned: 1.41M (1407154) - GetNewBlockTime: 3.040ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.47K (4474) - HashTablesBuildTime: 264.577ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 612.06 MB (641792128) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 203.986ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.832ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1407154) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.35 MB, 22.35 MB, 56.25 MB, 95.11 MB, 131.46 MB, 156.28 MB, 171.32 MB, 180.36 MB, 187.87 MB, 194.52 MB, 200.18 MB, 205.14 MB, 210.33 MB, 215.64 MB, 220.19 MB, 223.77 MB, 226.60 MB, 229.26 MB, 231.71 MB, 233.93 MB, 235.92 MB, 237.90 MB, 239.48 MB, 240.80 MB, 242.29 MB, 243.51 MB, 244.76 MB, 245.43 MB, 246.01 MB, 246.46 MB, 246.91 MB, 247.25 MB, 247.51 MB, 247.59 MB, 248.18 MB, 248.98 MB, 248.98 MB, 248.98 MB, 248.98 MB, 248.98 MB, 248.98 MB, 248.98 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 248.98 MB (261070680) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s755ms - NumBatchesAccepted: 12.62K (12623) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s409ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s051ms - PeakMemoryUsage: 0 - RowsReturned: 36.97M (36970063) - RowsReturnedRate: 311.47 K/sec RecvrSide: BytesReceived(16s000ms): 6.85 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.77 MB, 133.97 MB, 399.45 MB, 507.50 MB, 570.03 MB, 615.16 MB, 645.17 MB, 659.24 MB - FirstBatchArrivalWaitTime: 2s686ms - TotalBytesReceived: 663.43 MB (695652528) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s073ms - NumBatchesAccepted: 56.51K (56507) - NumBatchesRejected: 39 (39) Instance 5f429df048b5534b:41bcce1800000272 (host=foo.232.50:22000):(Total: 12m37s, non-child: 152.886ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.81 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.86 MB, 162.38 MB, 163.39 MB, 242.67 MB, 294.40 MB, 309.70 MB, 342.17 MB, 381.19 MB, 399.66 MB, 411.66 MB, 418.42 MB, 422.38 MB, 426.40 MB, 427.68 MB, 434.43 MB, 434.42 MB, 434.41 MB, 434.42 MB, 434.43 MB, 434.42 MB, 434.42 MB, 438.93 MB, 442.39 MB, 442.43 MB, 442.42 MB, 442.43 MB, 449.17 MB, 450.41 MB, 450.41 MB, 450.39 MB, 450.43 MB, 450.40 MB, 450.43 MB, 450.42 MB, 489.18 MB, 630.71 MB, 630.42 MB, 629.90 MB, 629.85 MB, 629.72 MB, 630.17 MB, 630.35 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.33 GB (1430724863) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 14.609ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.89K (3887) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s287ms - TotalThreadsUserTime: 9s569ms - TotalThreadsVoluntaryContextSwitches: 63.56K (63558) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 51.045ms - ExecTreePrepareTime: 948.387us DataStreamSender (dst_id=26):(Total: 849.005us, non-child: 849.005us, % non-child: 100.00%) - BytesSent: 11.25 KB (11522) - OverallThroughput: 12.94 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 48 (48) - SerializeBatchTime: 694.039us - UncompressedRowBatchSize: 11.25 KB (11522) CodeGen:(Total: 641.131ms, non-child: 641.131ms, % non-child: 100.00%) - CodegenTime: 14.651ms - CompileTime: 198.206ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 413.993ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.370ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 646.499ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 96.631us - GetResultsTime: 183.800us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 631.466ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.372ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 907.934us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619261) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 141.472us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 152.687us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 493.828us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 161.482us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s107ms, non-child: 67.919us, % non-child: 0.01%) - ConvertRowBatchTime: 51.300us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.54 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s107ms - DataArrivalTimer: 1s107ms SenderSide: - DeserializeRowBatchTimer: 134.537us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 10.069ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 492.703us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562941) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.136us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.960us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 288.059us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.720us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.949us, non-child: 15.949us, % non-child: 100.00%) - ConvertRowBatchTime: 8.753us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.18 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.851us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 47.591us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s788ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1474409) - BuildTime: 1s832ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.07M (37071919) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s724ms - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s519ms - BuildRowsPartitioned: 1.47M (1474409) - GetNewBlockTime: 2.804ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.05K (4052) - HashTablesBuildTime: 300.755ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 216.335ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.663ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1474409) - RowsReturnedRate: 2.32 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.46 MB, 23.61 MB, 59.18 MB, 100.21 MB, 138.64 MB, 165.41 MB, 180.88 MB, 190.23 MB, 198.01 MB, 204.95 MB, 210.90 MB, 216.10 MB, 221.65 MB, 227.21 MB, 232.02 MB, 235.77 MB, 238.88 MB, 241.77 MB, 244.48 MB, 246.86 MB, 248.92 MB, 250.88 MB, 252.43 MB, 253.91 MB, 255.34 MB, 256.73 MB, 257.87 MB, 258.66 MB, 259.25 MB, 259.71 MB, 260.10 MB, 260.35 MB, 260.60 MB, 260.72 MB, 261.29 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB, 262.07 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 262.07 MB (274795342) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s893ms - NumBatchesAccepted: 13.23K (13229) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s448ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37071919) - RowsReturnedRate: 316.14 K/sec RecvrSide: BytesReceived(16s000ms): 6.89 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.90 MB, 135.37 MB, 401.60 MB, 509.18 MB, 571.85 MB, 617.03 MB, 647.06 MB, 661.07 MB - FirstBatchArrivalWaitTime: 2s548ms - TotalBytesReceived: 665.22 MB (697530598) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s313ms - NumBatchesAccepted: 56.66K (56662) - NumBatchesRejected: 81 (81) Instance 5f429df048b5534b:41bcce1800000295 (host=foo.246.36:22000):(Total: 12m37s, non-child: 74.616ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.79 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 36.60 MB, 162.42 MB, 162.38 MB, 235.64 MB, 290.39 MB, 302.15 MB, 346.40 MB, 364.38 MB, 382.38 MB, 408.40 MB, 412.88 MB, 418.41 MB, 418.40 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.41 MB, 418.40 MB, 418.38 MB, 419.62 MB, 434.39 MB, 434.39 MB, 434.38 MB, 442.39 MB, 443.88 MB, 450.36 MB, 450.38 MB, 450.40 MB, 450.39 MB, 450.40 MB, 450.35 MB, 450.37 MB, 450.39 MB, 450.39 MB, 483.35 MB, 638.04 MB, 638.39 MB, 637.71 MB, 638.00 MB, 638.01 MB, 637.82 MB, 637.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 651.28 MB (682919495) - PerHostPeakMemUsage: 1.28 GB (1373964388) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 15.657ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.92K (3916) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s220ms - TotalThreadsUserTime: 9s548ms - TotalThreadsVoluntaryContextSwitches: 63.34K (63336) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 49.370ms - ExecTreePrepareTime: 747.758us DataStreamSender (dst_id=26):(Total: 582.133us, non-child: 582.133us, % non-child: 100.00%) - BytesSent: 11.16 KB (11428) - OverallThroughput: 18.72 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 49 (49) - SerializeBatchTime: 457.413us - UncompressedRowBatchSize: 11.16 KB (11428) CodeGen:(Total: 679.382ms, non-child: 679.382ms, % non-child: 100.00%) - CodegenTime: 16.993ms - CompileTime: 218.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 434.094ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.082ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 611.408ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 60.424us - GetResultsTime: 223.838us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 8 (8) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9926103) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - StreamingTime: 596.325ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.101ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 891.631us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9626199) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.960us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 142.468us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 489.998us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 145.399us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s452ms, non-child: 82.359us, % non-child: 0.01%) - ConvertRowBatchTime: 66.801us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s452ms - DataArrivalTimer: 1s451ms SenderSide: - DeserializeRowBatchTimer: 210.382us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.222ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 655.706us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9569879) - ProbeRows: 98 (98) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.610us - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.169us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 425.084us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.817us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.650us, non-child: 15.650us, % non-child: 100.00%) - ConvertRowBatchTime: 8.129us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.51 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.606us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 44.931us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s740ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1441249) - BuildTime: 1s847ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 626.13 MB (656544000) - ProbeRows: 36.98M (36975550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s651ms - RowsReturned: 98 (98) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s558ms - BuildRowsPartitioned: 1.44M (1441249) - GetNewBlockTime: 2.880ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.50K (3505) - HashTablesBuildTime: 276.093ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 626.06 MB (656472192) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 213.321ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.328ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1441249) - RowsReturnedRate: 2.27 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.40 MB, 22.72 MB, 57.26 MB, 97.25 MB, 134.49 MB, 161.17 MB, 176.57 MB, 185.56 MB, 193.01 MB, 199.65 MB, 205.24 MB, 210.18 MB, 215.51 MB, 220.83 MB, 225.46 MB, 229.13 MB, 232.07 MB, 234.78 MB, 237.23 MB, 239.42 MB, 241.46 MB, 243.43 MB, 244.93 MB, 246.29 MB, 247.72 MB, 248.83 MB, 249.89 MB, 250.68 MB, 251.20 MB, 251.66 MB, 252.03 MB, 252.27 MB, 252.48 MB, 252.59 MB, 253.20 MB, 253.97 MB, 253.97 MB, 253.97 MB, 253.97 MB, 253.97 MB, 253.97 MB, 253.97 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 253.97 MB (266311930) - TotalGetBatchTime: 10m35s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 2s095ms - NumBatchesAccepted: 12.94K (12935) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s429ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 36.98M (36975550) - RowsReturnedRate: 316.59 K/sec RecvrSide: BytesReceived(16s000ms): 6.88 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.80 MB, 134.70 MB, 400.29 MB, 507.80 MB, 570.35 MB, 615.45 MB, 645.38 MB, 659.40 MB - FirstBatchArrivalWaitTime: 2s446ms - TotalBytesReceived: 663.55 MB (695778628) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s323ms - NumBatchesAccepted: 56.52K (56516) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce180000027a (host=foo.232.51:22000):(Total: 12m37s, non-child: 147.073ms, % non-child: 0.02%) MemoryUsage(16s000ms): 16.00 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.87 MB, 162.44 MB, 162.93 MB, 230.66 MB, 292.67 MB, 309.41 MB, 345.17 MB, 356.17 MB, 375.15 MB, 389.18 MB, 400.91 MB, 409.42 MB, 424.68 MB, 426.42 MB, 426.42 MB, 432.44 MB, 434.42 MB, 434.44 MB, 438.92 MB, 442.42 MB, 442.43 MB, 442.43 MB, 442.42 MB, 444.92 MB, 450.43 MB, 450.39 MB, 450.40 MB, 450.41 MB, 450.42 MB, 450.41 MB, 450.43 MB, 450.38 MB, 450.38 MB, 450.49 MB, 485.72 MB, 630.11 MB, 629.92 MB, 629.88 MB, 630.16 MB, 629.95 MB, 629.97 MB, 629.62 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 643.30 MB (674552502) - PerHostPeakMemUsage: 1.36 GB (1456006718) - RowsProduced: 51 (51) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 19.910ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.90K (3897) - TotalThreadsTotalWallClockTime: 23m16s - TotalThreadsSysTime: 1s214ms - TotalThreadsUserTime: 9s861ms - TotalThreadsVoluntaryContextSwitches: 63.72K (63723) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 55.526ms - ExecTreePrepareTime: 792.940us DataStreamSender (dst_id=26):(Total: 673.052us, non-child: 673.052us, % non-child: 100.00%) - BytesSent: 10.95 KB (11208) - OverallThroughput: 15.88 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 51 (51) - SerializeBatchTime: 525.977us - UncompressedRowBatchSize: 10.95 KB (11208) CodeGen:(Total: 739.040ms, non-child: 739.040ms, % non-child: 100.00%) - CodegenTime: 19.598ms - CompileTime: 241.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 467.761ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.403ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 648.541ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.813us - GetResultsTime: 154.871us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 51 (51) - RowsReturnedRate: 0 - StreamingTime: 633.500ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.463ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.008ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 718 (718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 403.680us - RowsReturned: 716 (716) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 180.089us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 471.172us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 217.939us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 2s093ms, non-child: 64.000us, % non-child: 0.00%) - ConvertRowBatchTime: 44.602us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 814.00 /sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 2s093ms - DataArrivalTimer: 2s093ms SenderSide: - DeserializeRowBatchTimer: 288.782us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.768ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 616.562us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 718 (718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 539.740us - RowsReturned: 718 (718) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.396us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 367.844us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.447us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.275us, non-child: 15.275us, % non-child: 100.00%) - ConvertRowBatchTime: 8.169us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.94 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.959us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 114.153us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s944ms, % non-child: 0.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1435894) - BuildTime: 1s811ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 618.13 MB (648155392) - ProbeRows: 37.00M (36995955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s903ms - RowsReturned: 718 (718) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s497ms - BuildRowsPartitioned: 1.44M (1435894) - GetNewBlockTime: 3.022ms - HashBuckets: 3.15M (3145728) - HashCollisions: 4.70K (4698) - HashTablesBuildTime: 303.313ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 618.06 MB (648083584) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 208.154ms, % non-child: 0.03%) - ConvertRowBatchTime: 96.721ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1435894) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.45 MB, 22.66 MB, 56.75 MB, 96.41 MB, 134.05 MB, 160.74 MB, 176.11 MB, 185.38 MB, 193.08 MB, 199.89 MB, 205.69 MB, 210.82 MB, 216.29 MB, 221.70 MB, 226.45 MB, 230.02 MB, 232.99 MB, 235.79 MB, 238.39 MB, 240.63 MB, 242.58 MB, 244.42 MB, 245.84 MB, 247.19 MB, 248.46 MB, 249.66 MB, 250.77 MB, 251.39 MB, 252.02 MB, 252.41 MB, 252.69 MB, 253.09 MB, 253.28 MB, 253.45 MB, 254.10 MB, 254.84 MB, 254.84 MB, 254.84 MB, 254.84 MB, 254.84 MB, 254.84 MB, 254.84 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 254.84 MB (267213889) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s864ms - NumBatchesAccepted: 12.88K (12885) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s457ms, % non-child: 1.25%) - ConvertRowBatchTime: 1s080ms - PeakMemoryUsage: 0 - RowsReturned: 37.00M (36995955) - RowsReturnedRate: 317.37 K/sec RecvrSide: BytesReceived(16s000ms): 7.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.19 MB, 137.01 MB, 402.73 MB, 508.84 MB, 571.18 MB, 616.11 MB, 646.00 MB, 659.80 MB - FirstBatchArrivalWaitTime: 2s430ms - TotalBytesReceived: 663.87 MB (696121337) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s599ms - NumBatchesAccepted: 56.54K (56544) - NumBatchesRejected: 78 (78) Instance 5f429df048b5534b:41bcce1800000262 (host=foo.234.47:22000):(Total: 12m37s, non-child: 72.518ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.48 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.95 MB, 162.42 MB, 162.42 MB, 240.41 MB, 290.42 MB, 305.17 MB, 356.18 MB, 380.66 MB, 401.66 MB, 402.42 MB, 402.64 MB, 413.67 MB, 418.40 MB, 418.37 MB, 418.92 MB, 426.42 MB, 430.40 MB, 434.41 MB, 434.41 MB, 434.40 MB, 434.41 MB, 439.43 MB, 449.18 MB, 450.41 MB, 450.40 MB, 450.40 MB, 454.65 MB, 458.43 MB, 462.19 MB, 466.43 MB, 466.40 MB, 471.38 MB, 474.40 MB, 474.35 MB, 512.49 MB, 653.99 MB, 653.84 MB, 653.86 MB, 653.66 MB, 654.15 MB, 653.87 MB, 653.35 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 667.30 MB (699718326) - PerHostPeakMemUsage: 1.31 GB (1401445567) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 14.319ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.73K (3735) - TotalThreadsTotalWallClockTime: 23m15s - TotalThreadsSysTime: 1s286ms - TotalThreadsUserTime: 9s554ms - TotalThreadsVoluntaryContextSwitches: 64.31K (64313) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 51.933ms - ExecTreePrepareTime: 887.321us DataStreamSender (dst_id=26):(Total: 563.926us, non-child: 563.926us, % non-child: 100.00%) - BytesSent: 9.28 KB (9499) - OverallThroughput: 16.06 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 43 (43) - SerializeBatchTime: 404.554us - UncompressedRowBatchSize: 9.28 KB (9499) CodeGen:(Total: 678.815ms, non-child: 678.815ms, % non-child: 100.00%) - CodegenTime: 17.492ms - CompileTime: 225.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 423.948ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.738ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 634.085ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 61.220us - GetResultsTime: 151.970us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919661) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 616.905ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.551ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.175ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 389.869us - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 190.916us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 600.214us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 199.726us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s455ms, non-child: 95.375us, % non-child: 0.01%) - ConvertRowBatchTime: 62.849us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s455ms - DataArrivalTimer: 1s455ms SenderSide: - DeserializeRowBatchTimer: 200.599us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.746ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 701.219us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 700 (700) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 533.744us - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.149us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 477.603us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.466us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.395us, non-child: 15.395us, % non-child: 100.00%) - ConvertRowBatchTime: 7.884us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.80 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.913us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 51.742us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s838ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1468605) - BuildTime: 1s879ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 642.13 MB (673321216) - ProbeRows: 37.31M (37310076) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s729ms - RowsReturned: 700 (700) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s553ms - BuildRowsPartitioned: 1.47M (1468605) - GetNewBlockTime: 3.143ms - HashBuckets: 3.67M (3670016) - HashCollisions: 3.49K (3492) - HashTablesBuildTime: 311.815ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 642.06 MB (673249408) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 213.195ms, % non-child: 0.03%) - ConvertRowBatchTime: 103.013ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1468605) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.30 MB, 22.74 MB, 58.08 MB, 98.61 MB, 136.49 MB, 163.12 MB, 178.95 MB, 188.57 MB, 196.50 MB, 203.55 MB, 209.44 MB, 214.64 MB, 220.16 MB, 225.78 MB, 230.61 MB, 234.37 MB, 237.37 MB, 240.20 MB, 242.85 MB, 245.13 MB, 247.28 MB, 249.37 MB, 251.01 MB, 252.59 MB, 253.97 MB, 255.42 MB, 256.60 MB, 257.43 MB, 257.92 MB, 258.49 MB, 258.95 MB, 259.48 MB, 259.73 MB, 259.80 MB, 260.34 MB, 261.10 MB, 261.10 MB, 261.10 MB, 261.10 MB, 261.10 MB, 261.10 MB, 261.10 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.10 MB (273781859) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s930ms - NumBatchesAccepted: 13.18K (13176) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s451ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s081ms - PeakMemoryUsage: 0 - RowsReturned: 37.31M (37310076) - RowsReturnedRate: 317.46 K/sec RecvrSide: BytesReceived(16s000ms): 6.76 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.39 MB, 132.55 MB, 400.60 MB, 511.24 MB, 574.56 MB, 620.39 MB, 650.81 MB, 665.23 MB - FirstBatchArrivalWaitTime: 2s558ms - TotalBytesReceived: 669.50 MB (702018150) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s401ms - NumBatchesAccepted: 57.03K (57026) - NumBatchesRejected: 76 (76) Instance 5f429df048b5534b:41bcce1800000257 (host=foo.234.50:22000):(Total: 12m37s, non-child: 69.365ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.76 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.71 MB, 162.40 MB, 162.41 MB, 251.67 MB, 292.42 MB, 316.91 MB, 372.18 MB, 409.65 MB, 410.41 MB, 414.38 MB, 418.41 MB, 421.43 MB, 426.41 MB, 426.40 MB, 426.40 MB, 431.15 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.42 MB, 434.42 MB, 434.41 MB, 434.42 MB, 444.67 MB, 457.92 MB, 458.43 MB, 458.40 MB, 458.41 MB, 458.45 MB, 458.40 MB, 459.17 MB, 466.43 MB, 466.40 MB, 466.43 MB, 513.37 MB, 668.23 MB, 667.60 MB, 667.95 MB, 668.15 MB, 667.64 MB, 668.39 MB, 668.23 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 681.30 MB (714398390) - PerHostPeakMemUsage: 1.28 GB (1371316406) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 14.696ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.91K (3914) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s303ms - TotalThreadsUserTime: 9s572ms - TotalThreadsVoluntaryContextSwitches: 64.89K (64895) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 46.592ms - ExecTreePrepareTime: 770.947us DataStreamSender (dst_id=26):(Total: 582.687us, non-child: 582.687us, % non-child: 100.00%) - BytesSent: 11.09 KB (11353) - OverallThroughput: 18.58 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 50 (50) - SerializeBatchTime: 415.471us - UncompressedRowBatchSize: 11.09 KB (11353) CodeGen:(Total: 634.158ms, non-child: 634.158ms, % non-child: 100.00%) - CodegenTime: 15.712ms - CompileTime: 202.821ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 406.196ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.657ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 650.364ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 905.904us - GetResultsTime: 140.099us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9918640) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 636.547ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.799ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.143ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622832) - ProbeRows: 714 (714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 451.857us - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 95.631us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 727.612us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 153.033us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 303.872ms, non-child: 31.243us, % non-child: 0.01%) - ConvertRowBatchTime: 17.582us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 5.61 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 303.848ms - DataArrivalTimer: 303.841ms SenderSide: - DeserializeRowBatchTimer: 341.432us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.802ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 843.747us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566512) - ProbeRows: 714 (714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 556.384us - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.493us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 369.390us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.817us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.397us, non-child: 17.397us, % non-child: 100.00%) - ConvertRowBatchTime: 9.875us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.75 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.362us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 61.187us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s832ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.51M (1509418) - BuildTime: 1s921ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 656.13 MB (688001995) - ProbeRows: 37.06M (37061240) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s677ms - RowsReturned: 714 (714) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s563ms - BuildRowsPartitioned: 1.51M (1509418) - GetNewBlockTime: 2.959ms - HashBuckets: 4.06M (4063232) - HashCollisions: 4.12K (4120) - HashTablesBuildTime: 343.951ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 656.06 MB (687929472) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 221.521ms, % non-child: 0.03%) - ConvertRowBatchTime: 107.034ms - PeakMemoryUsage: 0 - RowsReturned: 1.51M (1509418) - RowsReturnedRate: 2.38 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.46 MB, 24.07 MB, 60.61 MB, 102.70 MB, 142.52 MB, 170.42 MB, 186.49 MB, 195.99 MB, 203.75 MB, 210.58 MB, 216.45 MB, 221.60 MB, 227.14 MB, 232.76 MB, 237.53 MB, 241.27 MB, 244.25 MB, 247.06 MB, 249.80 MB, 252.22 MB, 254.47 MB, 256.70 MB, 258.48 MB, 260.14 MB, 261.59 MB, 263.08 MB, 264.30 MB, 265.20 MB, 265.82 MB, 266.21 MB, 266.65 MB, 267.06 MB, 267.26 MB, 267.38 MB, 268.06 MB, 268.82 MB, 268.82 MB, 268.82 MB, 268.82 MB, 268.82 MB, 268.82 MB, 268.82 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 268.82 MB (281877625) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s951ms - NumBatchesAccepted: 13.55K (13547) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s450ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s077ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37061240) - RowsReturnedRate: 315.19 K/sec RecvrSide: BytesReceived(16s000ms): 6.86 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.76 MB, 134.05 MB, 400.22 MB, 508.66 MB, 571.34 MB, 616.61 MB, 646.71 MB, 660.83 MB - FirstBatchArrivalWaitTime: 2s612ms - TotalBytesReceived: 665.01 MB (697311295) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s437ms - NumBatchesAccepted: 56.65K (56646) - NumBatchesRejected: 72 (72) Instance 5f429df048b5534b:41bcce180000022c (host=foo.234.49:22000):(Total: 12m37s, non-child: 98.778ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.46 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 33.71 MB, 162.40 MB, 162.42 MB, 229.69 MB, 290.43 MB, 301.43 MB, 327.19 MB, 366.91 MB, 386.40 MB, 394.42 MB, 402.42 MB, 406.41 MB, 410.42 MB, 416.17 MB, 418.91 MB, 426.42 MB, 426.41 MB, 430.17 MB, 434.43 MB, 434.40 MB, 434.43 MB, 434.42 MB, 434.40 MB, 434.41 MB, 434.40 MB, 439.91 MB, 442.42 MB, 442.41 MB, 442.38 MB, 442.43 MB, 442.38 MB, 445.40 MB, 450.35 MB, 450.45 MB, 510.31 MB, 627.46 MB, 628.55 MB, 627.75 MB, 627.90 MB, 627.89 MB, 628.30 MB, 627.98 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.30 MB (672455350) - PerHostPeakMemUsage: 1.28 GB (1376628520) - RowsProduced: 46 (46) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 27.766ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.77K (3768) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s222ms - TotalThreadsUserTime: 9s522ms - TotalThreadsVoluntaryContextSwitches: 64.24K (64240) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 57.350ms - ExecTreePrepareTime: 911.301us DataStreamSender (dst_id=26):(Total: 673.479us, non-child: 673.479us, % non-child: 100.00%) - BytesSent: 10.31 KB (10559) - OverallThroughput: 14.95 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 46 (46) - SerializeBatchTime: 555.406us - UncompressedRowBatchSize: 10.31 KB (10559) CodeGen:(Total: 720.934ms, non-child: 720.934ms, % non-child: 100.00%) - CodegenTime: 25.725ms - CompileTime: 224.718ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 466.954ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.733ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 609.714ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 58.554us - GetResultsTime: 138.155us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9916011) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 46 (46) - RowsReturnedRate: 0 - StreamingTime: 597.141ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.981ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.083ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620457) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 119.743us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 126.355us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 730.315us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.687us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 216.514ms, non-child: 57.123us, % non-child: 0.03%) - ConvertRowBatchTime: 43.034us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 7.87 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 216.463ms - DataArrivalTimer: 216.458ms SenderSide: - DeserializeRowBatchTimer: 344.086us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 31.764ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 654.102us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564137) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.685us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.053us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 427.589us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.435us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.595us, non-child: 15.595us, % non-child: 100.00%) - ConvertRowBatchTime: 7.955us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.57 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.151us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 61.169us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s711ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1419888) - BuildTime: 1s803ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.03M (37034641) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s682ms - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s447ms - BuildRowsPartitioned: 1.42M (1419888) - GetNewBlockTime: 2.797ms - HashBuckets: 3.54M (3538944) - HashCollisions: 2.00K (1998) - HashTablesBuildTime: 341.336ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 198.044ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.756ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1419888) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.25 MB, 22.16 MB, 56.11 MB, 95.52 MB, 132.91 MB, 158.85 MB, 174.05 MB, 183.27 MB, 190.73 MB, 197.30 MB, 202.90 MB, 207.85 MB, 213.07 MB, 218.24 MB, 222.74 MB, 226.40 MB, 229.36 MB, 232.21 MB, 234.84 MB, 237.11 MB, 239.19 MB, 241.09 MB, 242.52 MB, 243.91 MB, 245.22 MB, 246.43 MB, 247.47 MB, 248.23 MB, 248.84 MB, 249.35 MB, 249.73 MB, 249.99 MB, 250.23 MB, 250.29 MB, 250.96 MB, 251.82 MB, 251.82 MB, 251.82 MB, 251.82 MB, 251.82 MB, 251.82 MB, 251.82 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 251.82 MB (264057595) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s009ms - NumBatchesAccepted: 12.74K (12743) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s429ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s062ms - PeakMemoryUsage: 0 - RowsReturned: 37.03M (37034641) - RowsReturnedRate: 310.00 K/sec RecvrSide: BytesReceived(16s000ms): 6.75 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.42 MB, 131.59 MB, 397.56 MB, 507.41 MB, 570.24 MB, 615.72 MB, 645.93 MB, 660.30 MB - FirstBatchArrivalWaitTime: 2s519ms - TotalBytesReceived: 664.55 MB (696830217) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s457ms - NumBatchesAccepted: 56.61K (56607) - NumBatchesRejected: 37 (37) Instance 5f429df048b5534b:41bcce1800000245 (host=foo.234.45:22000):(Total: 12m37s, non-child: 71.985ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.91 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 36.85 MB, 162.39 MB, 162.38 MB, 225.91 MB, 290.41 MB, 290.42 MB, 323.16 MB, 351.89 MB, 375.89 MB, 386.65 MB, 399.42 MB, 403.14 MB, 411.91 MB, 418.40 MB, 418.38 MB, 418.39 MB, 418.40 MB, 418.38 MB, 418.39 MB, 418.41 MB, 418.38 MB, 418.40 MB, 418.40 MB, 418.38 MB, 418.42 MB, 418.39 MB, 418.37 MB, 418.39 MB, 418.37 MB, 418.39 MB, 418.41 MB, 418.39 MB, 418.44 MB, 418.33 MB, 470.65 MB, 598.70 MB, 598.30 MB, 598.14 MB, 598.13 MB, 597.78 MB, 597.84 MB, 597.91 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 611.28 MB (640976455) - PerHostPeakMemUsage: 1.19 GB (1277946058) - RowsProduced: 44 (44) - TotalNetworkReceiveTime: 12m32s - TotalNetworkSendTime: 16.664ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.17K (4170) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s139ms - TotalThreadsUserTime: 9s497ms - TotalThreadsVoluntaryContextSwitches: 64.05K (64052) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 51.488ms - ExecTreePrepareTime: 837.177us DataStreamSender (dst_id=26):(Total: 877.593us, non-child: 877.593us, % non-child: 100.00%) - BytesSent: 10.02 KB (10264) - OverallThroughput: 11.15 MB/sec - PeakMemoryUsage: 232.66 KB (238240) - RowsReturned: 44 (44) - SerializeBatchTime: 565.491us - UncompressedRowBatchSize: 10.02 KB (10264) CodeGen:(Total: 674.123ms, non-child: 674.123ms, % non-child: 100.00%) - CodegenTime: 15.680ms - CompileTime: 209.962ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 434.507ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.170ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 637.971ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 48.094us - GetResultsTime: 209.247us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 44 (44) - RowsReturnedRate: 0 - StreamingTime: 624.266ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.332ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 736.420us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.679us - RowsReturned: 88 (88) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 100.140us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 373.674us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 137.900us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s488ms, non-child: 30.815us, % non-child: 0.00%) - ConvertRowBatchTime: 18.943us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s488ms - DataArrivalTimer: 1s488ms SenderSide: - DeserializeRowBatchTimer: 228.016us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 5.876ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 509.866us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 92 (92) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.928us - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 29.504us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 294.778us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.413us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 16.748us, non-child: 16.748us, % non-child: 100.00%) - ConvertRowBatchTime: 7.802us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.36 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.558us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 115.419us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s637ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.37M (1374315) - BuildTime: 1s679ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 586.13 MB (614600960) - ProbeRows: 37.02M (37017482) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s739ms - RowsReturned: 92 (92) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s383ms - BuildRowsPartitioned: 1.37M (1374315) - GetNewBlockTime: 2.175ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.54K (3544) - HashTablesBuildTime: 283.107ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 586.06 MB (614529152) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 194.408ms, % non-child: 0.03%) - ConvertRowBatchTime: 88.660ms - PeakMemoryUsage: 0 - RowsReturned: 1.37M (1374315) - RowsReturnedRate: 2.17 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.40 MB, 22.25 MB, 55.39 MB, 93.80 MB, 129.42 MB, 154.74 MB, 169.68 MB, 178.52 MB, 185.79 MB, 192.21 MB, 197.66 MB, 202.45 MB, 207.53 MB, 212.70 MB, 217.09 MB, 220.52 MB, 223.30 MB, 225.92 MB, 228.31 MB, 230.39 MB, 232.31 MB, 234.16 MB, 235.51 MB, 236.90 MB, 238.15 MB, 239.44 MB, 240.37 MB, 241.26 MB, 241.89 MB, 242.28 MB, 242.60 MB, 242.98 MB, 243.16 MB, 243.25 MB, 243.94 MB, 244.72 MB, 244.72 MB, 244.72 MB, 244.72 MB, 244.72 MB, 244.72 MB, 244.72 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 244.72 MB (256603200) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s523ms - NumBatchesAccepted: 12.34K (12341) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s425ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s066ms - PeakMemoryUsage: 0 - RowsReturned: 37.02M (37017482) - RowsReturnedRate: 312.71 K/sec RecvrSide: BytesReceived(16s000ms): 6.95 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.04 MB, 135.77 MB, 401.71 MB, 508.83 MB, 571.34 MB, 616.39 MB, 646.33 MB, 660.25 MB - FirstBatchArrivalWaitTime: 2s575ms - TotalBytesReceived: 664.38 MB (696650518) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s454ms - NumBatchesAccepted: 56.58K (56580) - NumBatchesRejected: 54 (54) Instance 5f429df048b5534b:41bcce1800000269 (host=foo.234.52:22000):(Total: 12m37s, non-child: 67.775ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.78 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 34.20 MB, 162.41 MB, 162.66 MB, 218.42 MB, 292.17 MB, 305.44 MB, 316.66 MB, 353.93 MB, 360.69 MB, 365.92 MB, 381.68 MB, 393.65 MB, 402.66 MB, 415.41 MB, 426.40 MB, 426.41 MB, 426.41 MB, 426.43 MB, 427.91 MB, 434.41 MB, 434.41 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.39 MB, 434.41 MB, 434.41 MB, 434.41 MB, 434.43 MB, 434.40 MB, 434.42 MB, 434.42 MB, 434.40 MB, 434.39 MB, 472.55 MB, 608.06 MB, 607.67 MB, 607.86 MB, 608.30 MB, 607.77 MB, 608.28 MB, 608.33 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 621.30 MB (651483830) - PerHostPeakMemUsage: 1.22 GB (1314367736) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 12.147ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.95K (3951) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s269ms - TotalThreadsUserTime: 9s608ms - TotalThreadsVoluntaryContextSwitches: 63.22K (63220) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m36s - ExecTreeOpenTime: 10m36s - PrepareTime: 49.628ms - ExecTreePrepareTime: 777.727us DataStreamSender (dst_id=26):(Total: 543.929us, non-child: 543.929us, % non-child: 100.00%) - BytesSent: 9.07 KB (9290) - OverallThroughput: 16.29 MB/sec - PeakMemoryUsage: 216.66 KB (221856) - RowsReturned: 40 (40) - SerializeBatchTime: 374.440us - UncompressedRowBatchSize: 9.07 KB (9290) CodeGen:(Total: 752.973ms, non-child: 752.973ms, % non-child: 100.00%) - CodegenTime: 16.337ms - CompileTime: 234.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 490.501ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.728ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 642.234ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.154us - GetResultsTime: 108.114us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919832) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 629.061ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.966ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 892.744us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619928) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.504us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 144.128us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 506.570us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 115.500us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 767.106ms, non-child: 60.535us, % non-child: 0.01%) - ConvertRowBatchTime: 45.636us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 767.052ms - DataArrivalTimer: 767.046ms SenderSide: - DeserializeRowBatchTimer: 194.806us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.745ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 445.281us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563608) - ProbeRows: 80 (80) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 116.190us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20.390us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 231.637us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.588us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.777us, non-child: 17.777us, % non-child: 100.00%) - ConvertRowBatchTime: 8.169us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.41 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.230us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 77.198us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s718ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1389332) - BuildTime: 1s777ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 596.13 MB (625087585) - ProbeRows: 37.06M (37064571) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s713ms - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s490ms - BuildRowsPartitioned: 1.39M (1389332) - GetNewBlockTime: 2.843ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.94K (2939) - HashTablesBuildTime: 273.772ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 596.06 MB (625014912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 212.787ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.455ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1389332) - RowsReturnedRate: 2.19 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.29 MB, 21.57 MB, 54.68 MB, 93.01 MB, 128.73 MB, 153.90 MB, 169.01 MB, 178.09 MB, 185.49 MB, 191.97 MB, 197.51 MB, 202.42 MB, 207.64 MB, 212.89 MB, 217.34 MB, 220.78 MB, 223.57 MB, 226.21 MB, 228.63 MB, 230.71 MB, 232.57 MB, 234.30 MB, 235.74 MB, 237.02 MB, 238.39 MB, 239.53 MB, 240.65 MB, 241.45 MB, 242.11 MB, 242.69 MB, 242.98 MB, 243.37 MB, 243.55 MB, 243.63 MB, 244.24 MB, 245.04 MB, 245.04 MB, 245.04 MB, 245.04 MB, 245.04 MB, 245.04 MB, 245.04 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 245.04 MB (256944980) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s987ms - NumBatchesAccepted: 12.47K (12469) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s433ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s070ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37064571) - RowsReturnedRate: 315.51 K/sec RecvrSide: BytesReceived(16s000ms): 6.87 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.81 MB, 134.50 MB, 400.66 MB, 508.81 MB, 571.49 MB, 616.75 MB, 646.82 MB, 660.90 MB - FirstBatchArrivalWaitTime: 2s465ms - TotalBytesReceived: 665.07 MB (697380787) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s253ms - NumBatchesAccepted: 56.66K (56659) - NumBatchesRejected: 66 (66) Instance 5f429df048b5534b:41bcce1800000271 (host=foo.232.52:22000):(Total: 12m37s, non-child: 150.414ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.55 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 37.09 MB, 162.40 MB, 163.13 MB, 238.40 MB, 292.39 MB, 306.65 MB, 352.15 MB, 371.64 MB, 398.39 MB, 414.40 MB, 418.38 MB, 418.40 MB, 424.41 MB, 426.39 MB, 426.38 MB, 426.37 MB, 433.92 MB, 434.37 MB, 434.40 MB, 435.38 MB, 442.40 MB, 442.39 MB, 444.90 MB, 450.36 MB, 455.63 MB, 458.38 MB, 463.14 MB, 466.39 MB, 466.37 MB, 466.37 MB, 466.40 MB, 466.41 MB, 466.46 MB, 466.40 MB, 506.49 MB, 656.04 MB, 655.48 MB, 655.77 MB, 656.23 MB, 655.77 MB, 656.12 MB, 656.29 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 669.28 MB (701793863) - PerHostPeakMemUsage: 1.41 GB (1515314840) - RowsProduced: 48 (48) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 90.711ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.44K (3441) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s242ms - TotalThreadsUserTime: 8s858ms - TotalThreadsVoluntaryContextSwitches: 64.99K (64993) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 47.586ms - ExecTreePrepareTime: 734.772us DataStreamSender (dst_id=26):(Total: 627.182us, non-child: 627.182us, % non-child: 100.00%) - BytesSent: 10.74 KB (10997) - OverallThroughput: 16.72 MB/sec - PeakMemoryUsage: 240.66 KB (246432) - RowsReturned: 48 (48) - SerializeBatchTime: 516.337us - UncompressedRowBatchSize: 10.74 KB (10997) CodeGen:(Total: 671.285ms, non-child: 671.285ms, % non-child: 100.00%) - CodegenTime: 16.689ms - CompileTime: 207.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 439.293ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.870ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 613.399ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.636us - GetResultsTime: 120.892us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9927278) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 48 (48) - RowsReturnedRate: 0 - StreamingTime: 603.192ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.939ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.144ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 710 (710) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 394.761us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 158.018us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 657.483us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 211.046us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 75.348us, non-child: 75.348us, % non-child: 100.00%) - ConvertRowBatchTime: 62.403us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 22.62 M/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 4.122us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 155.348us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.421ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 707.730us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 710 (710) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 457.536us - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.576us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 353.410us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 98.252us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 23.965us, non-child: 23.965us, % non-child: 100.00%) - ConvertRowBatchTime: 11.163us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 11.43 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.666us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 134.326us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s249ms, % non-child: 0.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.50M (1498202) - BuildTime: 1s813ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 644.13 MB (675418368) - ProbeRows: 37.09M (37086888) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s232ms - RowsReturned: 710 (710) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s532ms - BuildRowsPartitioned: 1.50M (1498202) - GetNewBlockTime: 4.692ms - HashBuckets: 3.80M (3801088) - HashCollisions: 3.81K (3812) - HashTablesBuildTime: 272.664ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 644.06 MB (675346560) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 212.437ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.834ms - PeakMemoryUsage: 0 - RowsReturned: 1.50M (1498202) - RowsReturnedRate: 2.36 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.36 MB, 22.99 MB, 58.41 MB, 99.05 MB, 137.37 MB, 164.63 MB, 180.53 MB, 190.31 MB, 198.39 MB, 205.54 MB, 211.66 MB, 217.04 MB, 222.78 MB, 228.52 MB, 233.34 MB, 237.15 MB, 240.23 MB, 243.08 MB, 245.73 MB, 248.06 MB, 250.24 MB, 252.23 MB, 253.86 MB, 255.27 MB, 256.68 MB, 257.93 MB, 259.16 MB, 259.89 MB, 260.43 MB, 260.88 MB, 261.28 MB, 261.62 MB, 261.81 MB, 261.89 MB, 262.47 MB, 263.25 MB, 263.25 MB, 263.25 MB, 263.25 MB, 263.25 MB, 263.25 MB, 263.25 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 263.25 MB (276036977) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 2s130ms - NumBatchesAccepted: 13.44K (13443) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s348ms, % non-child: 1.14%) - ConvertRowBatchTime: 1s003ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37086888) - RowsReturnedRate: 314.95 K/sec RecvrSide: BytesReceived(16s000ms): 6.80 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.62 MB, 133.55 MB, 399.82 MB, 508.78 MB, 571.67 MB, 616.99 MB, 647.14 MB, 661.33 MB - FirstBatchArrivalWaitTime: 2s444ms - TotalBytesReceived: 665.53 MB (697861268) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 3s873ms - NumBatchesAccepted: 56.69K (56686) - NumBatchesRejected: 80 (80) Instance 5f429df048b5534b:41bcce180000024c (host=foo.234.51:22000):(Total: 12m37s, non-child: 73.941ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.00 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 39.36 MB, 162.40 MB, 162.91 MB, 243.16 MB, 291.89 MB, 315.13 MB, 342.63 MB, 388.41 MB, 396.15 MB, 406.63 MB, 410.39 MB, 413.13 MB, 421.92 MB, 428.92 MB, 434.38 MB, 434.41 MB, 434.40 MB, 440.89 MB, 442.38 MB, 442.40 MB, 448.39 MB, 458.38 MB, 458.41 MB, 458.40 MB, 458.39 MB, 458.40 MB, 459.16 MB, 466.38 MB, 466.40 MB, 466.37 MB, 466.40 MB, 466.41 MB, 466.31 MB, 466.40 MB, 511.65 MB, 645.92 MB, 646.24 MB, 645.58 MB, 645.81 MB, 645.73 MB, 645.89 MB, 646.39 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 659.28 MB (691308103) - PerHostPeakMemUsage: 1.28 GB (1377587880) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 12.551ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.70K (3696) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s221ms - TotalThreadsUserTime: 9s591ms - TotalThreadsVoluntaryContextSwitches: 64.33K (64327) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 59.724ms - ExecTreePrepareTime: 1.196ms DataStreamSender (dst_id=26):(Total: 605.128us, non-child: 605.128us, % non-child: 100.00%) - BytesSent: 8.77 KB (8984) - OverallThroughput: 14.16 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 40 (40) - SerializeBatchTime: 447.529us - UncompressedRowBatchSize: 8.77 KB (8984) CodeGen:(Total: 686.014ms, non-child: 686.014ms, % non-child: 100.00%) - CodegenTime: 18.465ms - CompileTime: 231.192ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 420.931ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 33.256ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 604.743ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 61.485us - GetResultsTime: 153.467us - HTResizeTime: 0.000ns - HashBuckets: 14.34K (14336) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 591.697ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.913ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 899.291us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 108.750us - RowsReturned: 80 (80) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 123.036us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 538.054us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 132.499us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 54.029us, non-child: 54.029us, % non-child: 100.00%) - ConvertRowBatchTime: 42.718us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 31.54 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 4.373us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 335.030us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 21.069ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 447.442us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 119.576us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 11.075us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 307.323us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.456us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 9.577us, non-child: 9.577us, % non-child: 100.00%) - ConvertRowBatchTime: 4.511us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 28.61 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.326us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 153.898us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s841ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1464573) - BuildTime: 1s924ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 634.13 MB (664932608) - ProbeRows: 37.10M (37103345) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s686ms - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s573ms - BuildRowsPartitioned: 1.46M (1464573) - GetNewBlockTime: 2.924ms - HashBuckets: 3.67M (3670016) - HashCollisions: 4.44K (4442) - HashTablesBuildTime: 337.855ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 634.06 MB (664860800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 214.228ms, % non-child: 0.03%) - ConvertRowBatchTime: 102.726ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1464573) - RowsReturnedRate: 2.31 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.55 MB, 23.87 MB, 59.24 MB, 100.02 MB, 138.22 MB, 165.13 MB, 180.82 MB, 190.47 MB, 198.46 MB, 205.46 MB, 211.47 MB, 216.80 MB, 222.36 MB, 227.90 MB, 232.63 MB, 236.30 MB, 239.29 MB, 242.10 MB, 244.67 MB, 246.89 MB, 248.85 MB, 250.76 MB, 252.28 MB, 253.57 MB, 254.94 MB, 256.19 MB, 257.22 MB, 257.98 MB, 258.63 MB, 259.02 MB, 259.34 MB, 259.57 MB, 259.70 MB, 259.76 MB, 260.42 MB, 261.24 MB, 261.24 MB, 261.24 MB, 261.24 MB, 261.24 MB, 261.24 MB, 261.24 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.24 MB (273929894) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s990ms - NumBatchesAccepted: 13.14K (13141) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s422ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s063ms - PeakMemoryUsage: 0 - RowsReturned: 37.10M (37103345) - RowsReturnedRate: 315.10 K/sec RecvrSide: BytesReceived(16s000ms): 7.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.25 MB, 137.27 MB, 403.75 MB, 510.30 MB, 572.83 MB, 617.88 MB, 647.87 MB, 661.75 MB - FirstBatchArrivalWaitTime: 2s516ms - TotalBytesReceived: 665.85 MB (698196328) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s375ms - NumBatchesAccepted: 56.71K (56711) - NumBatchesRejected: 65 (65) Instance 5f429df048b5534b:41bcce180000026f (host=foo.246.41:22000):(Total: 12m37s, non-child: 160.403ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.99 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 38.37 MB, 162.40 MB, 162.44 MB, 241.16 MB, 290.41 MB, 302.16 MB, 353.90 MB, 379.66 MB, 395.41 MB, 416.64 MB, 418.42 MB, 418.41 MB, 418.40 MB, 418.42 MB, 418.39 MB, 418.42 MB, 421.17 MB, 426.41 MB, 426.40 MB, 431.16 MB, 434.40 MB, 434.43 MB, 434.41 MB, 436.65 MB, 442.41 MB, 442.41 MB, 450.41 MB, 453.94 MB, 460.43 MB, 466.41 MB, 466.40 MB, 466.41 MB, 466.38 MB, 466.40 MB, 509.35 MB, 652.28 MB, 651.58 MB, 651.97 MB, 651.75 MB, 651.95 MB, 652.37 MB, 652.44 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 665.30 MB (697621174) - PerHostPeakMemUsage: 1.27 GB (1368878773) - RowsProduced: 53 (53) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 100.091ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.94K (3935) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s204ms - TotalThreadsUserTime: 9s552ms - TotalThreadsVoluntaryContextSwitches: 64.34K (64337) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 54.957ms - ExecTreePrepareTime: 834.544us DataStreamSender (dst_id=26):(Total: 467.570us, non-child: 467.570us, % non-child: 100.00%) - BytesSent: 11.95 KB (12235) - OverallThroughput: 24.95 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 53 (53) - SerializeBatchTime: 340.505us - UncompressedRowBatchSize: 11.95 KB (12235) CodeGen:(Total: 695.017ms, non-child: 695.017ms, % non-child: 100.00%) - CodegenTime: 18.642ms - CompileTime: 226.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 438.644ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 28.886ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 610.931ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 946.361us - GetResultsTime: 108.879us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 53 (53) - RowsReturnedRate: 0 - StreamingTime: 596.434ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.993ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 2.384ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622132) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.682us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 159.656us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.697ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 320.428us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 61.360us, non-child: 61.360us, % non-child: 100.00%) - ConvertRowBatchTime: 46.233us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 27.77 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 6.799us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 162.363us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 17.351ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.995ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565812) - ProbeRows: 106 (106) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.394us - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 13.948us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.518ms - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.238us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 10.815us, non-child: 10.815us, % non-child: 100.00%) - ConvertRowBatchTime: 5.167us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 25.34 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.395us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 45.704us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s698ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.46M (1459567) - BuildTime: 1s831ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 640.13 MB (671224064) - ProbeRows: 37.06M (37063049) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s650ms - RowsReturned: 106 (106) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s528ms - BuildRowsPartitioned: 1.46M (1459567) - GetNewBlockTime: 3.330ms - HashBuckets: 3.54M (3538944) - HashCollisions: 5.13K (5127) - HashTablesBuildTime: 288.829ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 640.06 MB (671152256) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 209.498ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.447ms - PeakMemoryUsage: 0 - RowsReturned: 1.46M (1459567) - RowsReturnedRate: 2.30 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.47 MB, 23.26 MB, 58.34 MB, 98.69 MB, 136.74 MB, 163.67 MB, 179.32 MB, 188.61 MB, 196.29 MB, 203.11 MB, 208.93 MB, 214.01 MB, 219.46 MB, 224.90 MB, 229.58 MB, 233.25 MB, 236.25 MB, 239.00 MB, 241.57 MB, 243.75 MB, 245.70 MB, 247.56 MB, 248.95 MB, 250.31 MB, 251.50 MB, 252.73 MB, 253.77 MB, 254.50 MB, 255.13 MB, 255.59 MB, 255.84 MB, 256.10 MB, 256.30 MB, 256.39 MB, 257.01 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB, 257.81 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 257.81 MB (270335826) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s844ms - NumBatchesAccepted: 13.10K (13095) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s415ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s063ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37063049) - RowsReturnedRate: 316.05 K/sec RecvrSide: BytesReceived(16s000ms): 6.99 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.14 MB, 136.57 MB, 402.69 MB, 509.49 MB, 572.00 MB, 617.05 MB, 647.04 MB, 660.96 MB - FirstBatchArrivalWaitTime: 2s372ms - TotalBytesReceived: 665.08 MB (697385144) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s395ms - NumBatchesAccepted: 56.65K (56648) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce1800000277 (host=foo.246.40:22000):(Total: 12m37s, non-child: 149.209ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.47 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.95 MB, 162.40 MB, 162.43 MB, 229.90 MB, 290.40 MB, 295.16 MB, 322.91 MB, 365.90 MB, 385.92 MB, 398.66 MB, 409.92 MB, 418.43 MB, 418.42 MB, 418.41 MB, 418.40 MB, 418.40 MB, 418.40 MB, 425.42 MB, 426.41 MB, 426.41 MB, 426.40 MB, 426.42 MB, 426.42 MB, 426.43 MB, 426.41 MB, 427.64 MB, 434.42 MB, 440.94 MB, 442.42 MB, 442.42 MB, 442.40 MB, 442.40 MB, 442.35 MB, 442.46 MB, 475.52 MB, 617.76 MB, 617.75 MB, 617.60 MB, 617.82 MB, 617.66 MB, 617.68 MB, 617.76 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.28 GB (1376696014) - RowsProduced: 41 (41) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 12.779ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.12K (4115) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s273ms - TotalThreadsUserTime: 9s500ms - TotalThreadsVoluntaryContextSwitches: 63.57K (63568) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 62.998ms - ExecTreePrepareTime: 1.573ms DataStreamSender (dst_id=26):(Total: 517.408us, non-child: 517.408us, % non-child: 100.00%) - BytesSent: 8.86 KB (9072) - OverallThroughput: 16.72 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 41 (41) - SerializeBatchTime: 309.445us - UncompressedRowBatchSize: 8.86 KB (9072) CodeGen:(Total: 675.701ms, non-child: 675.701ms, % non-child: 100.00%) - CodegenTime: 16.847ms - CompileTime: 217.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 420.906ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 36.201ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 616.995ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 63.388us - GetResultsTime: 108.282us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9917261) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 41 (41) - RowsReturnedRate: 0 - StreamingTime: 605.661ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.564ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.407ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624520) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 106.832us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 158.156us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 898.566us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 152.068us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 63.015us, non-child: 63.015us, % non-child: 100.00%) - ConvertRowBatchTime: 45.679us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 27.04 M/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 7.757us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 244.823us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 7.050ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 769.376us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9568200) - ProbeRows: 82 (82) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.024us - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 24.055us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 344.013us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 96.822us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 20.162us, non-child: 20.162us, % non-child: 100.00%) - ConvertRowBatchTime: 8.439us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 13.59 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.319us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 151.986us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s709ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1421139) - BuildTime: 1s777ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635572480) - ProbeRows: 37.21M (37211714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s701ms - RowsReturned: 82 (82) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s446ms - BuildRowsPartitioned: 1.42M (1421139) - GetNewBlockTime: 3.606ms - HashBuckets: 3.41M (3407872) - HashCollisions: 3.51K (3507) - HashTablesBuildTime: 319.388ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 210.109ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.016ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1421139) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.32 MB, 22.37 MB, 56.36 MB, 95.40 MB, 132.26 MB, 158.12 MB, 173.38 MB, 182.52 MB, 190.05 MB, 196.69 MB, 202.36 MB, 207.34 MB, 212.60 MB, 217.91 MB, 222.44 MB, 225.99 MB, 228.85 MB, 231.52 MB, 233.98 MB, 236.19 MB, 238.17 MB, 240.08 MB, 241.67 MB, 242.98 MB, 244.40 MB, 245.59 MB, 246.74 MB, 247.46 MB, 248.00 MB, 248.39 MB, 248.75 MB, 249.07 MB, 249.26 MB, 249.33 MB, 249.92 MB, 250.70 MB, 250.70 MB, 250.70 MB, 250.70 MB, 250.70 MB, 250.70 MB, 250.70 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 250.70 MB (262882611) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s822ms - NumBatchesAccepted: 12.75K (12754) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s448ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s076ms - PeakMemoryUsage: 0 - RowsReturned: 37.21M (37211714) - RowsReturnedRate: 318.33 K/sec RecvrSide: BytesReceived(16s000ms): 6.82 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.56 MB, 133.54 MB, 400.78 MB, 510.36 MB, 573.45 MB, 619.00 MB, 649.27 MB, 663.56 MB - FirstBatchArrivalWaitTime: 2s380ms - TotalBytesReceived: 667.78 MB (700223131) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s358ms - NumBatchesAccepted: 56.88K (56879) - NumBatchesRejected: 95 (95) Instance 5f429df048b5534b:41bcce1800000267 (host=foo.246.38:22000):(Total: 12m37s, non-child: 70.204ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.63 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 37.43 MB, 162.39 MB, 162.40 MB, 240.66 MB, 290.40 MB, 308.87 MB, 346.39 MB, 371.90 MB, 406.90 MB, 418.39 MB, 418.39 MB, 418.40 MB, 418.39 MB, 418.38 MB, 418.39 MB, 418.40 MB, 418.40 MB, 432.16 MB, 434.39 MB, 440.64 MB, 446.89 MB, 450.41 MB, 450.39 MB, 450.39 MB, 450.41 MB, 450.39 MB, 450.40 MB, 450.40 MB, 450.39 MB, 450.39 MB, 450.39 MB, 450.40 MB, 450.37 MB, 450.43 MB, 489.62 MB, 628.27 MB, 627.70 MB, 628.25 MB, 628.31 MB, 627.92 MB, 628.77 MB, 628.67 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.28 MB (672433735) - PerHostPeakMemUsage: 1.31 GB (1401697212) - RowsProduced: 62 (62) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 16.662ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.02K (4020) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s233ms - TotalThreadsUserTime: 9s757ms - TotalThreadsVoluntaryContextSwitches: 64.32K (64318) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 44.919ms - ExecTreePrepareTime: 594.165us DataStreamSender (dst_id=26):(Total: 699.397us, non-child: 699.397us, % non-child: 100.00%) - BytesSent: 13.83 KB (14161) - OverallThroughput: 19.31 MB/sec - PeakMemoryUsage: 280.66 KB (287392) - RowsReturned: 62 (62) - SerializeBatchTime: 588.743us - UncompressedRowBatchSize: 13.83 KB (14161) CodeGen:(Total: 717.282ms, non-child: 717.282ms, % non-child: 100.00%) - CodegenTime: 15.681ms - CompileTime: 220.716ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 472.771ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.239ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 645.034ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.979us - GetResultsTime: 210.956us - HTResizeTime: 491.778us - HashBuckets: 30.72K (30720) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.73 MB (10197596) - PinTime: 0.000ns - ReductionFactorEstimate: 4739422.22 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 62 (62) - RowsReturnedRate: 0 - StreamingTime: 628.429ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.233ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.617ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.20 MB (9647836) - ProbeRows: 2.14K (2143) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 446.183us - RowsReturned: 2.14K (2141) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 224.482us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 960.002us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 199.676us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 97.773us, non-child: 97.773us, % non-child: 100.00%) - ConvertRowBatchTime: 78.401us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 17.43 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 10.312us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 353.578us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 5.507ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 900.579us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 2.14K (2143) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 324.995us - RowsReturned: 2.14K (2143) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.537us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 587.711us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.650us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.132us, non-child: 14.132us, % non-child: 100.00%) - ConvertRowBatchTime: 7.514us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 19.39 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.961us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 107.001us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s852ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.48M (1482685) - BuildTime: 1s883ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.07M (37066310) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s737ms - RowsReturned: 2.14K (2143) - RowsReturnedRate: 2.00 /sec Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s524ms - BuildRowsPartitioned: 1.48M (1482685) - GetNewBlockTime: 2.942ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.21K (3209) - HashTablesBuildTime: 345.768ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 216.210ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.932ms - PeakMemoryUsage: 0 - RowsReturned: 1.48M (1482685) - RowsReturnedRate: 2.34 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.42 MB, 23.39 MB, 58.76 MB, 99.06 MB, 137.16 MB, 164.20 MB, 180.03 MB, 189.47 MB, 197.34 MB, 204.35 MB, 210.23 MB, 215.44 MB, 220.98 MB, 226.59 MB, 231.40 MB, 235.14 MB, 238.14 MB, 241.02 MB, 243.71 MB, 246.13 MB, 248.27 MB, 250.29 MB, 251.97 MB, 253.32 MB, 254.75 MB, 256.02 MB, 257.15 MB, 257.80 MB, 258.57 MB, 259.08 MB, 259.43 MB, 259.73 MB, 259.91 MB, 260.00 MB, 260.58 MB, 261.40 MB, 261.40 MB, 261.40 MB, 261.40 MB, 261.40 MB, 261.40 MB, 261.40 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.40 MB (274093696) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s835ms - NumBatchesAccepted: 13.30K (13296) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s448ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s075ms - PeakMemoryUsage: 0 - RowsReturned: 37.07M (37066310) - RowsReturnedRate: 315.90 K/sec RecvrSide: BytesReceived(16s000ms): 6.84 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 12.72 MB, 133.89 MB, 399.99 MB, 508.59 MB, 571.37 MB, 616.73 MB, 646.88 MB, 661.04 MB - FirstBatchArrivalWaitTime: 2s427ms - TotalBytesReceived: 665.23 MB (697541816) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s379ms - NumBatchesAccepted: 56.65K (56651) - NumBatchesRejected: 69 (69) Instance 5f429df048b5534b:41bcce1800000241 (host=foo.246.39:22000):(Total: 12m37s, non-child: 81.984ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.60 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 36.21 MB, 162.45 MB, 162.41 MB, 239.19 MB, 290.42 MB, 298.94 MB, 354.90 MB, 380.67 MB, 398.41 MB, 404.18 MB, 412.37 MB, 418.41 MB, 418.39 MB, 418.41 MB, 418.42 MB, 418.42 MB, 418.42 MB, 418.91 MB, 426.42 MB, 426.43 MB, 426.42 MB, 426.41 MB, 426.42 MB, 426.42 MB, 426.41 MB, 431.18 MB, 434.42 MB, 436.92 MB, 450.15 MB, 458.41 MB, 458.40 MB, 458.42 MB, 458.47 MB, 458.40 MB, 507.84 MB, 635.98 MB, 635.60 MB, 636.00 MB, 636.14 MB, 636.03 MB, 635.79 MB, 635.67 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 649.30 MB (680843958) - PerHostPeakMemUsage: 1.27 GB (1362652558) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 19.668ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.85K (3845) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s209ms - TotalThreadsUserTime: 9s602ms - TotalThreadsVoluntaryContextSwitches: 64.22K (64217) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m35s - ExecTreeOpenTime: 10m35s - PrepareTime: 55.864ms - ExecTreePrepareTime: 1.006ms DataStreamSender (dst_id=26):(Total: 641.494us, non-child: 641.494us, % non-child: 100.00%) - BytesSent: 10.21 KB (10457) - OverallThroughput: 15.55 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 47 (47) - SerializeBatchTime: 485.062us - UncompressedRowBatchSize: 10.21 KB (10457) CodeGen:(Total: 720.360ms, non-child: 720.360ms, % non-child: 100.00%) - CodegenTime: 19.628ms - CompileTime: 256.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 433.080ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.865ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 636.290ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 61.252us - GetResultsTime: 161.790us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919390) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 622.346ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.149ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 916.482us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622807) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.736us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 119.509us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 562.515us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 161.358us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 60.489us, non-child: 60.489us, % non-child: 100.00%) - ConvertRowBatchTime: 47.439us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 28.17 M/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 5.110us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 349.947us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.502ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 518.034us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566487) - ProbeRows: 94 (94) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.870us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.550us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 183.800us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.306us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.811us, non-child: 14.811us, % non-child: 100.00%) - ConvertRowBatchTime: 7.477us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.50 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.242us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 231.117us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s677ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1443579) - BuildTime: 1s788ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 624.13 MB (654446913) - ProbeRows: 36.99M (36993251) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s672ms - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s503ms - BuildRowsPartitioned: 1.44M (1443579) - GetNewBlockTime: 3.062ms - HashBuckets: 3.54M (3538944) - HashCollisions: 4.15K (4148) - HashTablesBuildTime: 270.951ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 624.06 MB (654375040) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 209.546ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.715ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1443579) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.37 MB, 22.94 MB, 57.96 MB, 98.00 MB, 135.67 MB, 162.41 MB, 178.17 MB, 187.66 MB, 195.42 MB, 202.17 MB, 207.97 MB, 213.07 MB, 218.49 MB, 223.90 MB, 228.48 MB, 232.12 MB, 235.05 MB, 237.80 MB, 240.39 MB, 242.62 MB, 244.66 MB, 246.60 MB, 248.03 MB, 249.48 MB, 250.65 MB, 251.89 MB, 252.85 MB, 253.57 MB, 254.17 MB, 254.56 MB, 254.76 MB, 255.01 MB, 255.26 MB, 255.37 MB, 256.01 MB, 256.81 MB, 256.81 MB, 256.81 MB, 256.81 MB, 256.81 MB, 256.81 MB, 256.81 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 256.81 MB (269287251) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s091ms - NumBatchesAccepted: 12.95K (12951) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s435ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 36.99M (36993251) - RowsReturnedRate: 312.74 K/sec RecvrSide: BytesReceived(16s000ms): 6.83 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.71 MB, 133.49 MB, 399.06 MB, 507.53 MB, 570.18 MB, 615.39 MB, 645.46 MB, 659.60 MB - FirstBatchArrivalWaitTime: 2s393ms - TotalBytesReceived: 663.78 MB (696024286) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s537ms - NumBatchesAccepted: 56.54K (56543) - NumBatchesRejected: 39 (39) Instance 5f429df048b5534b:41bcce1800000249 (host=foo.246.35:22000):(Total: 12m37s, non-child: 70.432ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.66 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 35.46 MB, 162.42 MB, 162.91 MB, 225.94 MB, 290.41 MB, 306.68 MB, 321.42 MB, 348.40 MB, 370.90 MB, 392.41 MB, 398.42 MB, 402.41 MB, 406.40 MB, 410.43 MB, 415.16 MB, 423.67 MB, 426.41 MB, 426.42 MB, 426.42 MB, 426.40 MB, 426.41 MB, 433.92 MB, 435.43 MB, 442.39 MB, 442.41 MB, 442.40 MB, 442.39 MB, 442.41 MB, 442.40 MB, 442.42 MB, 442.43 MB, 442.40 MB, 442.39 MB, 442.37 MB, 486.15 MB, 612.02 MB, 611.78 MB, 612.07 MB, 611.51 MB, 611.60 MB, 611.95 MB, 612.32 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 625.30 MB (655678134) - PerHostPeakMemUsage: 1.32 GB (1421035445) - RowsProduced: 52 (52) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 15.941ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.92K (3925) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s253ms - TotalThreadsUserTime: 9s477ms - TotalThreadsVoluntaryContextSwitches: 64.08K (64077) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m40s - ExecTreeOpenTime: 10m39s - PrepareTime: 47.150ms - ExecTreePrepareTime: 762.275us DataStreamSender (dst_id=26):(Total: 689.358us, non-child: 689.358us, % non-child: 100.00%) - BytesSent: 10.85 KB (11109) - OverallThroughput: 15.37 MB/sec - PeakMemoryUsage: 248.66 KB (254624) - RowsReturned: 52 (52) - SerializeBatchTime: 537.293us - UncompressedRowBatchSize: 10.85 KB (11109) CodeGen:(Total: 677.636ms, non-child: 677.636ms, % non-child: 100.00%) - CodegenTime: 16.254ms - CompileTime: 231.836ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 421.389ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 23.896ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 601.575ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.680us - GetResultsTime: 124.432us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923378) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 52 (52) - RowsReturnedRate: 0 - StreamingTime: 587.521ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.943ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 854.784us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619378) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.475us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 131.148us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 391.469us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 136.979us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 62.638us, non-child: 62.638us, % non-child: 100.00%) - ConvertRowBatchTime: 49.375us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 27.20 M/sec RecvrSide: BytesReceived(16s000ms): 23.28 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 5.121us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 205.971us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 38.303ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 485.676us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9563058) - ProbeRows: 104 (104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.376us - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 30.800us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 260.642us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.294us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 13.545us, non-child: 13.545us, % non-child: 100.00%) - ConvertRowBatchTime: 7.521us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 20.23 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.928us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 41.375us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s648ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1412823) - BuildTime: 1s752ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 600.13 MB (629281739) - ProbeRows: 37.12M (37124606) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s678ms - RowsReturned: 104 (104) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s446ms - BuildRowsPartitioned: 1.41M (1412823) - GetNewBlockTime: 3.562ms - HashBuckets: 3.01M (3014656) - HashCollisions: 4.09K (4091) - HashTablesBuildTime: 292.441ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 600.06 MB (629209216) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 206.580ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.405ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1412823) - RowsReturnedRate: 2.23 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.33 MB, 22.15 MB, 55.90 MB, 94.84 MB, 131.26 MB, 156.86 MB, 171.59 MB, 180.44 MB, 187.85 MB, 194.40 MB, 199.97 MB, 204.91 MB, 210.22 MB, 215.51 MB, 220.14 MB, 223.71 MB, 226.62 MB, 229.34 MB, 231.87 MB, 234.18 MB, 236.21 MB, 238.25 MB, 239.80 MB, 241.26 MB, 242.63 MB, 243.96 MB, 245.01 MB, 245.83 MB, 246.49 MB, 246.92 MB, 247.17 MB, 247.51 MB, 247.71 MB, 247.77 MB, 248.40 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB, 249.20 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 249.20 MB (261308860) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s134ms - NumBatchesAccepted: 12.68K (12675) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s426ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s063ms - PeakMemoryUsage: 0 - RowsReturned: 37.12M (37124606) - RowsReturnedRate: 314.34 K/sec RecvrSide: BytesReceived(16s000ms): 6.86 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.81 MB, 134.47 MB, 401.09 MB, 509.46 MB, 572.32 MB, 617.68 MB, 647.83 MB, 661.95 MB - FirstBatchArrivalWaitTime: 2s435ms - TotalBytesReceived: 666.14 MB (698496834) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s682ms - NumBatchesAccepted: 56.74K (56739) - NumBatchesRejected: 49 (49) Instance 5f429df048b5534b:41bcce180000022b (host=foo.246.37:22000):(Total: 12m37s, non-child: 97.279ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.72 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 36.45 MB, 162.44 MB, 162.42 MB, 235.68 MB, 288.90 MB, 308.69 MB, 352.40 MB, 365.92 MB, 381.16 MB, 388.43 MB, 396.67 MB, 410.38 MB, 410.41 MB, 410.42 MB, 410.39 MB, 410.41 MB, 410.41 MB, 419.15 MB, 426.42 MB, 429.92 MB, 442.41 MB, 442.42 MB, 442.39 MB, 442.67 MB, 450.39 MB, 450.40 MB, 450.41 MB, 450.91 MB, 458.42 MB, 458.44 MB, 458.43 MB, 458.44 MB, 465.17 MB, 466.41 MB, 531.82 MB, 654.02 MB, 654.30 MB, 653.99 MB, 653.60 MB, 653.65 MB, 653.97 MB, 654.24 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 667.30 MB (699718326) - PerHostPeakMemUsage: 1.30 GB (1395155466) - RowsProduced: 47 (47) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 28.710ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.89K (3887) - TotalThreadsTotalWallClockTime: 23m11s - TotalThreadsSysTime: 1s194ms - TotalThreadsUserTime: 9s414ms - TotalThreadsVoluntaryContextSwitches: 64.06K (64065) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 55.281ms - ExecTreePrepareTime: 810.420us DataStreamSender (dst_id=26):(Total: 480.408us, non-child: 480.408us, % non-child: 100.00%) - BytesSent: 10.65 KB (10903) - OverallThroughput: 21.64 MB/sec - PeakMemoryUsage: 244.66 KB (250528) - RowsReturned: 47 (47) - SerializeBatchTime: 321.723us - UncompressedRowBatchSize: 10.65 KB (10903) CodeGen:(Total: 669.834ms, non-child: 669.834ms, % non-child: 100.00%) - CodegenTime: 19.352ms - CompileTime: 208.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 431.804ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.223ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 598.916ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.016us - GetResultsTime: 84.069us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 47 (47) - RowsReturnedRate: 0 - StreamingTime: 586.274ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 1.979ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.148ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9627374) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.444us - RowsReturned: 94 (94) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 143.214us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 749.513us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 130.255us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 61.763us, non-child: 61.763us, % non-child: 100.00%) - ConvertRowBatchTime: 49.652us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 27.59 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 5.289us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 267.209us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 6.350ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 605.942us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9571054) - ProbeRows: 96 (96) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.823us - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 24.960us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 394.429us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.936us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 18.851us, non-child: 18.851us, % non-child: 100.00%) - ConvertRowBatchTime: 9.562us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.54 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.959us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 60.416us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s614ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1452520) - BuildTime: 1s814ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 642.13 MB (673321331) - ProbeRows: 37.12M (37120998) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s581ms - RowsReturned: 96 (96) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s481ms - BuildRowsPartitioned: 1.45M (1452520) - GetNewBlockTime: 3.094ms - HashBuckets: 3.67M (3670016) - HashCollisions: 5.06K (5059) - HashTablesBuildTime: 319.087ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 642.06 MB (673249408) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 206.041ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.091ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1452520) - RowsReturnedRate: 2.30 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.38 MB, 22.81 MB, 57.43 MB, 97.48 MB, 135.03 MB, 161.05 MB, 176.20 MB, 185.40 MB, 192.96 MB, 199.59 MB, 205.29 MB, 210.25 MB, 215.54 MB, 220.87 MB, 225.43 MB, 228.91 MB, 231.75 MB, 234.38 MB, 236.85 MB, 239.03 MB, 241.02 MB, 242.98 MB, 244.53 MB, 245.91 MB, 247.32 MB, 248.64 MB, 249.82 MB, 250.68 MB, 251.17 MB, 251.62 MB, 252.01 MB, 252.34 MB, 252.56 MB, 252.65 MB, 253.33 MB, 254.07 MB, 254.07 MB, 254.07 MB, 254.07 MB, 254.07 MB, 254.07 MB, 254.07 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 254.07 MB (266412000) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s058ms - NumBatchesAccepted: 13.04K (13037) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s425ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s058ms - PeakMemoryUsage: 0 - RowsReturned: 37.12M (37120998) - RowsReturnedRate: 310.53 K/sec RecvrSide: BytesReceived(16s000ms): 6.89 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 12.93 MB, 134.88 MB, 401.51 MB, 509.65 MB, 572.44 MB, 617.77 MB, 647.88 MB, 661.97 MB - FirstBatchArrivalWaitTime: 2s429ms - TotalBytesReceived: 666.16 MB (698514349) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s181ms - NumBatchesAccepted: 56.73K (56735) - NumBatchesRejected: 44 (44) Instance 5f429df048b5534b:41bcce1800000296 (host=foo.246.50:22000):(Total: 12m37s, non-child: 65.747ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.08 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.61 MB, 162.42 MB, 162.42 MB, 226.44 MB, 289.65 MB, 297.40 MB, 332.91 MB, 349.42 MB, 375.41 MB, 392.67 MB, 402.41 MB, 408.64 MB, 410.42 MB, 410.44 MB, 410.43 MB, 415.40 MB, 418.42 MB, 425.41 MB, 426.42 MB, 426.41 MB, 426.41 MB, 426.43 MB, 430.41 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.41 MB, 434.40 MB, 434.43 MB, 434.42 MB, 434.38 MB, 434.40 MB, 470.12 MB, 613.53 MB, 614.05 MB, 613.77 MB, 613.63 MB, 614.10 MB, 613.91 MB, 613.21 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 627.30 MB (657775286) - PerHostPeakMemUsage: 1.25 GB (1346091482) - RowsProduced: 50 (50) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 12.387ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.69K (3685) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s201ms - TotalThreadsUserTime: 9s495ms - TotalThreadsVoluntaryContextSwitches: 64.39K (64394) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 55.244ms - ExecTreePrepareTime: 1.101ms DataStreamSender (dst_id=26):(Total: 616.241us, non-child: 616.241us, % non-child: 100.00%) - BytesSent: 10.18 KB (10426) - OverallThroughput: 16.13 MB/sec - PeakMemoryUsage: 256.66 KB (262816) - RowsReturned: 50 (50) - SerializeBatchTime: 487.208us - UncompressedRowBatchSize: 10.18 KB (10426) CodeGen:(Total: 686.783ms, non-child: 686.783ms, % non-child: 100.00%) - CodegenTime: 21.591ms - CompileTime: 225.164ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 431.364ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.721ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 621.282ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 144.656us - GetResultsTime: 145.464us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9928628) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 50 (50) - RowsReturnedRate: 0 - StreamingTime: 607.530ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.073ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.716ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9624628) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 141.180us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 204.795us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 1.068ms - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 246.407us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 97.628us, non-child: 97.628us, % non-child: 100.00%) - ConvertRowBatchTime: 60.242us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 17.45 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 8.904us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 213.465us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 10.060ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.061ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9568308) - ProbeRows: 100 (100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.512us - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.422us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 752.625us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 96.855us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 21.977us, non-child: 21.977us, % non-child: 100.00%) - ConvertRowBatchTime: 10.290us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 12.47 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.565us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 80.412us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s700ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1395440) - BuildTime: 1s790ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 602.13 MB (631378176) - ProbeRows: 37.29M (37288444) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s687ms - RowsReturned: 100 (100) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s483ms - BuildRowsPartitioned: 1.40M (1395440) - GetNewBlockTime: 2.801ms - HashBuckets: 3.15M (3145728) - HashCollisions: 2.34K (2340) - HashTablesBuildTime: 293.056ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 602.06 MB (631306368) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 205.408ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.533ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1395440) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.45 MB, 22.38 MB, 55.96 MB, 94.45 MB, 130.50 MB, 156.18 MB, 171.53 MB, 180.61 MB, 188.09 MB, 194.65 MB, 200.07 MB, 204.93 MB, 210.19 MB, 215.35 MB, 219.82 MB, 223.25 MB, 226.09 MB, 228.80 MB, 231.26 MB, 233.44 MB, 235.33 MB, 237.21 MB, 238.66 MB, 239.97 MB, 241.27 MB, 242.46 MB, 243.44 MB, 244.20 MB, 244.76 MB, 245.18 MB, 245.51 MB, 245.86 MB, 246.08 MB, 246.14 MB, 246.82 MB, 247.62 MB, 247.62 MB, 247.62 MB, 247.62 MB, 247.62 MB, 247.62 MB, 247.62 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 247.62 MB (259648760) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s757ms - NumBatchesAccepted: 12.52K (12524) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s434ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s076ms - PeakMemoryUsage: 0 - RowsReturned: 37.29M (37288444) - RowsReturnedRate: 320.01 K/sec RecvrSide: BytesReceived(16s000ms): 7.04 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.25 MB, 138.46 MB, 406.22 MB, 512.91 MB, 575.69 MB, 620.95 MB, 651.05 MB, 664.96 MB - FirstBatchArrivalWaitTime: 2s233ms - TotalBytesReceived: 669.07 MB (701574194) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s385ms - NumBatchesAccepted: 56.99K (56994) - NumBatchesRejected: 103 (103) Instance 5f429df048b5534b:41bcce1800000258 (host=foo.234.44:22000):(Total: 12m37s, non-child: 70.507ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.04 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.61 MB, 162.41 MB, 162.42 MB, 227.43 MB, 290.43 MB, 303.68 MB, 320.90 MB, 346.91 MB, 371.91 MB, 387.40 MB, 402.40 MB, 409.66 MB, 416.68 MB, 420.42 MB, 426.40 MB, 426.41 MB, 426.42 MB, 429.16 MB, 434.42 MB, 434.40 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.40 MB, 434.40 MB, 434.42 MB, 434.40 MB, 434.41 MB, 434.42 MB, 434.41 MB, 434.40 MB, 434.41 MB, 434.35 MB, 434.44 MB, 478.18 MB, 613.35 MB, 614.52 MB, 614.27 MB, 614.09 MB, 613.84 MB, 613.96 MB, 614.19 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 627.30 MB (657775286) - PerHostPeakMemUsage: 1.21 GB (1304546732) - RowsProduced: 45 (45) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 13.239ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.76K (3761) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s184ms - TotalThreadsUserTime: 9s470ms - TotalThreadsVoluntaryContextSwitches: 63.87K (63870) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m36s - ExecTreeOpenTime: 10m36s - PrepareTime: 49.003ms - ExecTreePrepareTime: 819.428us DataStreamSender (dst_id=26):(Total: 588.866us, non-child: 588.866us, % non-child: 100.00%) - BytesSent: 10.25 KB (10499) - OverallThroughput: 17.00 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 45 (45) - SerializeBatchTime: 462.453us - UncompressedRowBatchSize: 10.25 KB (10499) CodeGen:(Total: 639.997ms, non-child: 639.997ms, % non-child: 100.00%) - CodegenTime: 17.780ms - CompileTime: 208.561ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 404.471ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.436ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 644.770ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 75.547us - GetResultsTime: 120.260us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919086) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 45 (45) - RowsReturnedRate: 0 - StreamingTime: 629.590ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m36s, non-child: 2.737ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.078ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9619182) - ProbeRows: 706 (706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 457.292us - RowsReturned: 704 (704) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 232.973us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 422.853us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 217.676us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 767.238ms, non-child: 59.026us, % non-child: 0.01%) - ConvertRowBatchTime: 42.453us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 767.187ms - DataArrivalTimer: 767.179ms SenderSide: - DeserializeRowBatchTimer: 257.947us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m36s, non-child: 2.807ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 768.871us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9562862) - ProbeRows: 706 (706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 515.419us - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.507us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 465.270us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.042us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 13.207us, non-child: 13.207us, % non-child: 100.00%) - ConvertRowBatchTime: 7.444us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 20.75 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.770us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 90.799us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m36s, non-child: 6s681ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1408231) - BuildTime: 1s745ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 602.13 MB (631378176) - ProbeRows: 37.13M (37132184) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s716ms - RowsReturned: 706 (706) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s431ms - BuildRowsPartitioned: 1.41M (1408231) - GetNewBlockTime: 3.093ms - HashBuckets: 3.15M (3145728) - HashCollisions: 3.25K (3251) - HashTablesBuildTime: 301.035ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 602.06 MB (631306368) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 198.304ms, % non-child: 0.03%) - ConvertRowBatchTime: 93.869ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1408231) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.43 MB, 22.49 MB, 56.13 MB, 94.98 MB, 131.35 MB, 156.59 MB, 171.75 MB, 180.80 MB, 188.29 MB, 194.85 MB, 200.49 MB, 205.46 MB, 210.76 MB, 216.18 MB, 220.87 MB, 224.51 MB, 227.47 MB, 230.21 MB, 232.79 MB, 235.04 MB, 237.08 MB, 239.07 MB, 240.66 MB, 242.18 MB, 243.59 MB, 245.00 MB, 246.10 MB, 246.92 MB, 247.58 MB, 248.04 MB, 248.28 MB, 248.51 MB, 248.62 MB, 248.71 MB, 249.38 MB, 250.20 MB, 250.20 MB, 250.20 MB, 250.20 MB, 250.20 MB, 250.20 MB, 250.20 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 250.20 MB (262357914) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s772ms - NumBatchesAccepted: 12.63K (12634) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s442ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s075ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37132184) - RowsReturnedRate: 316.28 K/sec RecvrSide: BytesReceived(16s000ms): 7.02 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.28 MB, 137.78 MB, 404.51 MB, 510.81 MB, 573.36 MB, 618.44 MB, 648.41 MB, 662.26 MB - FirstBatchArrivalWaitTime: 2s412ms - TotalBytesReceived: 666.35 MB (698715801) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s571ms - NumBatchesAccepted: 56.75K (56750) - NumBatchesRejected: 64 (64) Instance 5f429df048b5534b:41bcce180000027b (host=foo.246.47:22000):(Total: 12m37s, non-child: 151.837ms, % non-child: 0.02%) MemoryUsage(16s000ms): 15.89 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.36 MB, 162.41 MB, 162.40 MB, 231.42 MB, 290.43 MB, 296.91 MB, 327.67 MB, 370.18 MB, 382.15 MB, 388.12 MB, 409.64 MB, 413.44 MB, 418.39 MB, 418.41 MB, 418.41 MB, 423.41 MB, 426.41 MB, 426.42 MB, 426.40 MB, 426.42 MB, 426.40 MB, 426.42 MB, 426.42 MB, 426.40 MB, 426.41 MB, 426.39 MB, 432.90 MB, 434.41 MB, 434.41 MB, 434.43 MB, 434.42 MB, 434.39 MB, 434.43 MB, 434.42 MB, 471.09 MB, 618.64 MB, 618.12 MB, 617.63 MB, 618.05 MB, 617.89 MB, 617.83 MB, 618.17 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 631.30 MB (661969590) - PerHostPeakMemUsage: 1.27 GB (1359123751) - RowsProduced: 49 (49) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 15.173ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.98K (3979) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s192ms - TotalThreadsUserTime: 9s555ms - TotalThreadsVoluntaryContextSwitches: 63.30K (63299) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 51.506ms - ExecTreePrepareTime: 746.648us DataStreamSender (dst_id=26):(Total: 535.089us, non-child: 535.089us, % non-child: 100.00%) - BytesSent: 10.80 KB (11060) - OverallThroughput: 19.71 MB/sec - PeakMemoryUsage: 252.66 KB (258720) - RowsReturned: 49 (49) - SerializeBatchTime: 368.301us - UncompressedRowBatchSize: 10.80 KB (11060) CodeGen:(Total: 676.142ms, non-child: 676.142ms, % non-child: 100.00%) - CodegenTime: 15.872ms - CompileTime: 217.302ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 429.086ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 29.262ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 608.855ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 68.618us - GetResultsTime: 204.591us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 49 (49) - RowsReturnedRate: 0 - StreamingTime: 594.168ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.266ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.253ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 712 (712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 398.286us - RowsReturned: 712 (712) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 120.521us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 624.198us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 154.217us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 55.141us, non-child: 55.141us, % non-child: 100.00%) - ConvertRowBatchTime: 42.468us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 30.90 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 4.847us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 181.822us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 2.813ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 652.245us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 712 (712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 546.327us - RowsReturned: 712 (712) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.697us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 445.075us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.823us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 24.991us, non-child: 24.991us, % non-child: 100.00%) - ConvertRowBatchTime: 7.985us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 10.96 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 10.734us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 49.277us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s751ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.41M (1407840) - BuildTime: 1s762ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 606.13 MB (635572480) - ProbeRows: 37.13M (37127824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s770ms - RowsReturned: 712 (712) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s473ms - BuildRowsPartitioned: 1.41M (1407840) - GetNewBlockTime: 3.042ms - HashBuckets: 3.41M (3407872) - HashCollisions: 4.49K (4489) - HashTablesBuildTime: 275.018ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 606.06 MB (635500672) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 206.461ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.743ms - PeakMemoryUsage: 0 - RowsReturned: 1.41M (1407840) - RowsReturnedRate: 2.22 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.46 MB, 22.90 MB, 56.96 MB, 95.99 MB, 132.67 MB, 158.64 MB, 173.62 MB, 182.64 MB, 190.10 MB, 196.65 MB, 202.16 MB, 207.12 MB, 212.34 MB, 217.54 MB, 222.07 MB, 225.55 MB, 228.31 MB, 230.99 MB, 233.44 MB, 235.55 MB, 237.51 MB, 239.37 MB, 240.70 MB, 242.01 MB, 243.24 MB, 244.50 MB, 245.43 MB, 246.22 MB, 246.84 MB, 247.15 MB, 247.45 MB, 247.81 MB, 248.01 MB, 248.10 MB, 248.79 MB, 249.57 MB, 249.57 MB, 249.57 MB, 249.57 MB, 249.57 MB, 249.57 MB, 249.57 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 249.57 MB (261691826) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s892ms - NumBatchesAccepted: 12.64K (12636) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s432ms, % non-child: 1.23%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37127824) - RowsReturnedRate: 318.36 K/sec RecvrSide: BytesReceived(16s000ms): 6.99 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.08 MB, 136.65 MB, 403.24 MB, 510.31 MB, 572.97 MB, 618.15 MB, 648.16 MB, 662.11 MB - FirstBatchArrivalWaitTime: 2s269ms - TotalBytesReceived: 666.24 MB (698598675) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s176ms - NumBatchesAccepted: 56.75K (56754) - NumBatchesRejected: 82 (82) Instance 5f429df048b5534b:41bcce180000023b (host=foo.246.49:22000):(Total: 12m37s, non-child: 208.664ms, % non-child: 0.03%) MemoryUsage(16s000ms): 15.87 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 38.62 MB, 162.42 MB, 162.65 MB, 239.16 MB, 291.17 MB, 314.41 MB, 345.16 MB, 365.42 MB, 374.41 MB, 399.42 MB, 413.15 MB, 418.40 MB, 418.42 MB, 423.90 MB, 437.65 MB, 442.42 MB, 442.43 MB, 442.41 MB, 442.42 MB, 442.40 MB, 442.39 MB, 442.41 MB, 450.40 MB, 450.39 MB, 450.42 MB, 450.40 MB, 450.41 MB, 450.39 MB, 450.42 MB, 450.40 MB, 450.38 MB, 450.43 MB, 450.39 MB, 450.45 MB, 503.45 MB, 632.12 MB, 631.66 MB, 631.80 MB, 632.18 MB, 631.99 MB, 631.91 MB, 632.24 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 645.30 MB (676649654) - PerHostPeakMemUsage: 1.23 GB (1315483351) - RowsProduced: 36 (36) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 11.132ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.83K (3826) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s233ms - TotalThreadsUserTime: 9s573ms - TotalThreadsVoluntaryContextSwitches: 63.74K (63740) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1m57s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 59.739ms - ExecTreePrepareTime: 1.059ms DataStreamSender (dst_id=26):(Total: 500.160us, non-child: 500.160us, % non-child: 100.00%) - BytesSent: 7.72 KB (7909) - OverallThroughput: 15.08 MB/sec - PeakMemoryUsage: 212.66 KB (217760) - RowsReturned: 36 (36) - SerializeBatchTime: 331.747us - UncompressedRowBatchSize: 7.72 KB (7909) CodeGen:(Total: 696.795ms, non-child: 696.795ms, % non-child: 100.00%) - CodegenTime: 17.216ms - CompileTime: 216.162ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 449.520ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 30.124ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 600.418ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 53.196us - GetResultsTime: 93.701us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9919465) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 36 (36) - RowsReturnedRate: 0 - StreamingTime: 585.221ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 1.912ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 785.078us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622057) - ProbeRows: 72 (72) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 100.390us - RowsReturned: 72 (72) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 155.819us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 435.300us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 120.176us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 568.670ms, non-child: 65.998us, % non-child: 0.01%) - ConvertRowBatchTime: 43.781us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 3.00 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 568.617ms - DataArrivalTimer: 568.604ms SenderSide: - DeserializeRowBatchTimer: 183.273us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 24.586ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 429.546us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565737) - ProbeRows: 72 (72) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 107.876us - RowsReturned: 72 (72) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20.948us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 251.124us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.459us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 23.631us, non-child: 23.631us, % non-child: 100.00%) - ConvertRowBatchTime: 8.074us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 11.59 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 9.135us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 96.396us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s718ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1472634) - BuildTime: 1s831ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 620.13 MB (650252544) - ProbeRows: 37.13M (37131156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s655ms - RowsReturned: 72 (72) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s497ms - BuildRowsPartitioned: 1.47M (1472634) - GetNewBlockTime: 3.158ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.77K (3765) - HashTablesBuildTime: 321.367ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 620.06 MB (650180736) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 211.819ms, % non-child: 0.03%) - ConvertRowBatchTime: 97.159ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1472634) - RowsReturnedRate: 2.33 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.48 MB, 23.16 MB, 58.26 MB, 98.78 MB, 136.43 MB, 163.36 MB, 179.17 MB, 188.45 MB, 196.16 MB, 202.89 MB, 208.66 MB, 213.77 MB, 219.22 MB, 224.67 MB, 229.35 MB, 232.97 MB, 235.90 MB, 238.65 MB, 241.20 MB, 243.52 MB, 245.63 MB, 247.63 MB, 249.10 MB, 250.58 MB, 251.85 MB, 253.25 MB, 254.22 MB, 255.17 MB, 255.78 MB, 256.18 MB, 256.49 MB, 256.84 MB, 257.09 MB, 257.22 MB, 257.85 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB, 258.59 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 258.59 MB (271147094) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s947ms - NumBatchesAccepted: 13.21K (13215) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s429ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s062ms - PeakMemoryUsage: 0 - RowsReturned: 37.13M (37131156) - RowsReturnedRate: 314.34 K/sec RecvrSide: BytesReceived(16s000ms): 6.98 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.19 MB, 136.84 MB, 403.47 MB, 510.45 MB, 573.07 MB, 618.22 MB, 648.22 MB, 662.15 MB - FirstBatchArrivalWaitTime: 2s222ms - TotalBytesReceived: 666.28 MB (698643929) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s504ms - NumBatchesAccepted: 56.75K (56751) - NumBatchesRejected: 53 (53) Instance 5f429df048b5534b:41bcce180000022f (host=foo.246.42:22000):(Total: 12m37s, non-child: 99.823ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.74 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 37.85 MB, 162.42 MB, 162.41 MB, 237.40 MB, 290.39 MB, 313.14 MB, 329.38 MB, 365.88 MB, 387.66 MB, 400.15 MB, 402.39 MB, 408.17 MB, 410.40 MB, 413.64 MB, 423.14 MB, 426.65 MB, 437.63 MB, 442.40 MB, 442.39 MB, 442.39 MB, 442.40 MB, 442.40 MB, 442.42 MB, 442.39 MB, 442.39 MB, 444.63 MB, 450.41 MB, 450.36 MB, 450.41 MB, 450.39 MB, 450.41 MB, 450.41 MB, 450.44 MB, 450.52 MB, 511.32 MB, 626.68 MB, 626.37 MB, 625.68 MB, 625.85 MB, 625.75 MB, 625.80 MB, 625.42 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 639.28 MB (670336583) - PerHostPeakMemUsage: 1.22 GB (1308016236) - RowsProduced: 37 (37) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 18.287ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.87K (3873) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s244ms - TotalThreadsUserTime: 9s618ms - TotalThreadsVoluntaryContextSwitches: 64.46K (64463) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 78.628ms - ExecTreePrepareTime: 1.057ms DataStreamSender (dst_id=26):(Total: 442.798us, non-child: 442.798us, % non-child: 100.00%) - BytesSent: 8.47 KB (8669) - OverallThroughput: 18.67 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 37 (37) - SerializeBatchTime: 234.304us - UncompressedRowBatchSize: 8.47 KB (8669) CodeGen:(Total: 713.624ms, non-child: 713.624ms, % non-child: 100.00%) - CodegenTime: 16.303ms - CompileTime: 234.348ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 437.361ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 40.497ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 650.200ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 59.094us - GetResultsTime: 89.265us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 6 (6) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 37 (37) - RowsReturnedRate: 0 - StreamingTime: 636.434ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 1.982ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 910.882us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 76 (76) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 104.345us - RowsReturned: 74 (74) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 105.036us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 493.447us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 211.054us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 863.497ms, non-child: 32.707us, % non-child: 0.00%) - ConvertRowBatchTime: 19.812us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.97 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 863.469ms - DataArrivalTimer: 863.465ms SenderSide: - DeserializeRowBatchTimer: 195.735us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 9.739ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 568.797us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 76 (76) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.813us - RowsReturned: 76 (76) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33.541us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 320.469us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.926us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 37.135us, non-child: 37.135us, % non-child: 100.00%) - ConvertRowBatchTime: 13.975us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 7.38 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.661us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 156.106us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s768ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.43M (1429281) - BuildTime: 1s832ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 614.13 MB (643961628) - ProbeRows: 36.96M (36961612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s711ms - RowsReturned: 76 (76) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s519ms - BuildRowsPartitioned: 1.43M (1429281) - GetNewBlockTime: 2.757ms - HashBuckets: 3.41M (3407872) - HashCollisions: 2.91K (2907) - HashTablesBuildTime: 300.336ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 614.06 MB (643889280) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m32s, non-child: 212.101ms, % non-child: 0.03%) - ConvertRowBatchTime: 100.004ms - PeakMemoryUsage: 0 - RowsReturned: 1.43M (1429281) - RowsReturnedRate: 2.26 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.44 MB, 23.01 MB, 57.83 MB, 97.93 MB, 134.87 MB, 160.70 MB, 176.15 MB, 185.45 MB, 193.04 MB, 199.78 MB, 205.46 MB, 210.49 MB, 215.87 MB, 221.31 MB, 225.97 MB, 229.62 MB, 232.59 MB, 235.37 MB, 238.02 MB, 240.31 MB, 242.37 MB, 244.32 MB, 245.81 MB, 247.17 MB, 248.49 MB, 249.66 MB, 250.68 MB, 251.56 MB, 252.08 MB, 252.49 MB, 252.83 MB, 253.13 MB, 253.36 MB, 253.41 MB, 254.13 MB, 254.92 MB, 254.92 MB, 254.92 MB, 254.92 MB, 254.92 MB, 254.92 MB, 254.92 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 254.92 MB (267303198) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 2s093ms - NumBatchesAccepted: 12.83K (12829) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s419ms, % non-child: 1.19%) - ConvertRowBatchTime: 1s057ms - PeakMemoryUsage: 0 - RowsReturned: 36.96M (36961612) - RowsReturnedRate: 310.08 K/sec RecvrSide: BytesReceived(16s000ms): 6.91 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.00 MB, 135.20 MB, 400.70 MB, 507.85 MB, 570.33 MB, 615.36 MB, 645.28 MB, 659.24 MB - FirstBatchArrivalWaitTime: 2s302ms - TotalBytesReceived: 663.38 MB (695599950) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTimer: 4s459ms - NumBatchesAccepted: 56.50K (56497) - NumBatchesRejected: 31 (31) Instance 5f429df048b5534b:41bcce180000021e (host=foo.246.44:22000):(Total: 12m37s, non-child: 106.516ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.85 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 37.37 MB, 162.42 MB, 162.44 MB, 236.66 MB, 290.39 MB, 309.44 MB, 334.41 MB, 368.91 MB, 383.17 MB, 393.41 MB, 403.65 MB, 414.41 MB, 419.16 MB, 426.42 MB, 426.43 MB, 426.40 MB, 428.66 MB, 434.41 MB, 434.43 MB, 434.42 MB, 434.42 MB, 442.40 MB, 446.66 MB, 450.41 MB, 450.40 MB, 450.44 MB, 450.39 MB, 450.46 MB, 450.42 MB, 450.42 MB, 450.37 MB, 450.42 MB, 450.39 MB, 450.39 MB, 517.85 MB, 628.09 MB, 627.81 MB, 628.02 MB, 628.11 MB, 627.67 MB, 627.70 MB, 627.69 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 641.30 MB (672455350) - PerHostPeakMemUsage: 1.31 GB (1403306148) - RowsProduced: 38 (38) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 33.649ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.82K (3819) - TotalThreadsTotalWallClockTime: 23m11s - TotalThreadsSysTime: 1s231ms - TotalThreadsUserTime: 9s422ms - TotalThreadsVoluntaryContextSwitches: 64.26K (64261) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2m2s - OpenTime: 10m34s - ExecTreeOpenTime: 10m33s - PrepareTime: 58.865ms - ExecTreePrepareTime: 1.379ms DataStreamSender (dst_id=26):(Total: 543.816us, non-child: 543.816us, % non-child: 100.00%) - BytesSent: 8.27 KB (8468) - OverallThroughput: 14.85 MB/sec - PeakMemoryUsage: 208.66 KB (213664) - RowsReturned: 38 (38) - SerializeBatchTime: 285.835us - UncompressedRowBatchSize: 8.27 KB (8468) CodeGen:(Total: 745.120ms, non-child: 745.120ms, % non-child: 100.00%) - CodegenTime: 18.277ms - CompileTime: 222.390ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 490.326ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 31.784ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 633.219ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 49.512us - GetResultsTime: 67.902us - HTResizeTime: 0.000ns - HashBuckets: 13.31K (13312) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.45 MB (9913969) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 38 (38) - RowsReturnedRate: 0 - StreamingTime: 619.697ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.741ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.351ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622257) - ProbeRows: 692 (692) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 419.287us - RowsReturned: 690 (690) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 241.238us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 737.373us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 249.028us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 562.014ms, non-child: 71.164us, % non-child: 0.01%) - ConvertRowBatchTime: 43.449us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 3.03 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 561.962ms - DataArrivalTimer: 561.944ms SenderSide: - DeserializeRowBatchTimer: 333.235us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 3.301ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 530.300us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9565937) - ProbeRows: 692 (692) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 529.246us - RowsReturned: 692 (692) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 17.704us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 334.789us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.965us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 9.137us, non-child: 9.137us, % non-child: 100.00%) - ConvertRowBatchTime: 4.410us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 29.99 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.260us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 119.809us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s543ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.45M (1447615) - BuildTime: 1s798ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 616.13 MB (646058240) - ProbeRows: 37.01M (37005884) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s535ms - RowsReturned: 692 (692) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s494ms - BuildRowsPartitioned: 1.45M (1447615) - GetNewBlockTime: 3.624ms - HashBuckets: 3.54M (3538944) - HashCollisions: 3.51K (3514) - HashTablesBuildTime: 289.967ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 616.06 MB (645986432) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m31s, non-child: 204.496ms, % non-child: 0.03%) - ConvertRowBatchTime: 99.427ms - PeakMemoryUsage: 0 - RowsReturned: 1.45M (1447615) - RowsReturnedRate: 2.29 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.47 MB, 23.18 MB, 58.00 MB, 97.78 MB, 134.85 MB, 160.98 MB, 176.29 MB, 185.61 MB, 193.40 MB, 200.31 MB, 206.18 MB, 211.45 MB, 217.14 MB, 222.82 MB, 227.64 MB, 231.36 MB, 234.41 MB, 237.19 MB, 239.78 MB, 242.08 MB, 244.14 MB, 246.15 MB, 247.64 MB, 248.92 MB, 250.30 MB, 251.53 MB, 252.53 MB, 253.39 MB, 253.87 MB, 254.40 MB, 254.71 MB, 254.99 MB, 255.21 MB, 255.31 MB, 255.96 MB, 256.73 MB, 256.73 MB, 256.73 MB, 256.73 MB, 256.73 MB, 256.73 MB, 256.73 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 256.73 MB (269196312) - TotalGetBatchTime: 10m31s - DataArrivalTimer: 10m31s SenderSide: - DeserializeRowBatchTimer: 1s999ms - NumBatchesAccepted: 12.99K (12987) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m59s, non-child: 1s396ms, % non-child: 1.17%) - ConvertRowBatchTime: 1s043ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37005884) - RowsReturnedRate: 309.24 K/sec RecvrSide: BytesReceived(16s000ms): 6.97 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.20 MB, 136.44 MB, 402.23 MB, 508.84 MB, 571.23 MB, 616.19 MB, 646.12 MB, 659.98 MB - FirstBatchArrivalWaitTime: 2s243ms - TotalBytesReceived: 664.08 MB (696339583) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTimer: 4s078ms - NumBatchesAccepted: 56.56K (56563) - NumBatchesRejected: 33 (33) Instance 5f429df048b5534b:41bcce1800000287 (host=foo.246.45:22000):(Total: 12m37s, non-child: 64.898ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.29 MB, 21.24 MB, 21.24 MB, 21.24 MB, 21.24 MB, 38.59 MB, 162.41 MB, 162.38 MB, 224.40 MB, 290.41 MB, 296.41 MB, 317.41 MB, 346.91 MB, 366.90 MB, 380.13 MB, 394.89 MB, 406.12 MB, 417.41 MB, 418.39 MB, 418.39 MB, 418.40 MB, 418.40 MB, 418.40 MB, 420.39 MB, 426.39 MB, 426.41 MB, 426.40 MB, 426.41 MB, 426.40 MB, 426.41 MB, 434.38 MB, 434.39 MB, 434.38 MB, 434.39 MB, 434.41 MB, 434.40 MB, 434.40 MB, 434.28 MB, 434.37 MB, 466.52 MB, 604.18 MB, 603.94 MB, 604.18 MB, 603.83 MB, 603.76 MB, 604.32 MB, 603.88 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 617.28 MB (647267911) - PerHostPeakMemUsage: 1.21 GB (1300939375) - RowsProduced: 56 (56) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 14.074ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.81K (3809) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s162ms - TotalThreadsUserTime: 9s716ms - TotalThreadsVoluntaryContextSwitches: 62.59K (62591) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m38s - ExecTreeOpenTime: 10m37s - PrepareTime: 46.352ms - ExecTreePrepareTime: 760.616us DataStreamSender (dst_id=26):(Total: 484.757us, non-child: 484.757us, % non-child: 100.00%) - BytesSent: 11.92 KB (12204) - OverallThroughput: 24.01 MB/sec - PeakMemoryUsage: 260.66 KB (266912) - RowsReturned: 56 (56) - SerializeBatchTime: 369.736us - UncompressedRowBatchSize: 11.92 KB (12204) CodeGen:(Total: 728.336ms, non-child: 728.336ms, % non-child: 100.00%) - CodegenTime: 16.836ms - CompileTime: 231.096ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 473.783ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 22.949ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 603.562ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 50.164us - GetResultsTime: 100.775us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 7 (7) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9920582) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 56 (56) - RowsReturnedRate: 0 - StreamingTime: 589.270ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 1.915ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.325ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.17 MB (9620678) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.060us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 222.237us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 708.611us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 281.161us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 529.391ms, non-child: 65.588us, % non-child: 0.01%) - ConvertRowBatchTime: 49.811us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 3.22 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 529.332ms - DataArrivalTimer: 529.326ms SenderSide: - DeserializeRowBatchTimer: 229.320us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 16.142ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 631.941us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564358) - ProbeRows: 112 (112) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 148.326us - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.569us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 388.063us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.281us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.917us, non-child: 17.917us, % non-child: 100.00%) - ConvertRowBatchTime: 8.643us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.29 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.305us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 72.678us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s750ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.37M (1368930) - BuildTime: 1s753ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 592.13 MB (620892416) - ProbeRows: 37.01M (37013499) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s771ms - RowsReturned: 112 (112) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s471ms - BuildRowsPartitioned: 1.37M (1368930) - GetNewBlockTime: 3.052ms - HashBuckets: 3.01M (3014656) - HashCollisions: 2.99K (2989) - HashTablesBuildTime: 268.145ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 592.06 MB (620820608) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m35s, non-child: 200.291ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.195ms - PeakMemoryUsage: 0 - RowsReturned: 1.37M (1368930) - RowsReturnedRate: 2.15 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.54 MB, 22.59 MB, 55.68 MB, 93.68 MB, 129.43 MB, 154.96 MB, 169.94 MB, 178.51 MB, 185.70 MB, 191.90 MB, 197.06 MB, 201.69 MB, 206.59 MB, 211.53 MB, 215.76 MB, 219.01 MB, 221.70 MB, 224.27 MB, 226.64 MB, 228.74 MB, 230.68 MB, 232.49 MB, 233.86 MB, 235.32 MB, 236.45 MB, 237.73 MB, 238.66 MB, 239.41 MB, 240.17 MB, 240.61 MB, 240.82 MB, 241.13 MB, 241.32 MB, 241.38 MB, 242.02 MB, 242.83 MB, 242.83 MB, 242.83 MB, 242.83 MB, 242.83 MB, 242.83 MB, 242.83 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 242.83 MB (254622675) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 1s732ms - NumBatchesAccepted: 12.28K (12281) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m56s, non-child: 1s446ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s076ms - PeakMemoryUsage: 0 - RowsReturned: 37.01M (37013499) - RowsReturnedRate: 318.17 K/sec RecvrSide: BytesReceived(16s000ms): 7.16 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 10.00 MB, 13.76 MB, 140.68 MB, 406.31 MB, 510.17 MB, 572.25 MB, 616.94 MB, 646.67 MB, 660.21 MB - FirstBatchArrivalWaitTime: 2s211ms - TotalBytesReceived: 664.19 MB (696457734) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTimer: 4s230ms - NumBatchesAccepted: 56.57K (56573) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce180000025a (host=foo.246.48:22000):(Total: 12m37s, non-child: 66.765ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.24 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 39.58 MB, 162.41 MB, 162.43 MB, 230.18 MB, 290.40 MB, 293.41 MB, 327.92 MB, 367.41 MB, 380.17 MB, 393.94 MB, 394.43 MB, 404.64 MB, 410.40 MB, 413.94 MB, 418.41 MB, 418.39 MB, 418.43 MB, 418.42 MB, 418.43 MB, 418.41 MB, 418.42 MB, 418.42 MB, 418.42 MB, 422.16 MB, 426.42 MB, 426.44 MB, 426.41 MB, 426.41 MB, 426.41 MB, 426.41 MB, 426.40 MB, 426.38 MB, 426.42 MB, 426.46 MB, 469.62 MB, 599.86 MB, 599.22 MB, 600.13 MB, 600.10 MB, 599.77 MB, 600.21 MB, 600.19 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 613.30 MB (643095222) - PerHostPeakMemUsage: 1.20 GB (1291562661) - RowsProduced: 54 (54) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 15.024ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.21K (4206) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s158ms - TotalThreadsUserTime: 9s589ms - TotalThreadsVoluntaryContextSwitches: 62.94K (62944) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m37s - PrepareTime: 49.945ms - ExecTreePrepareTime: 853.640us DataStreamSender (dst_id=26):(Total: 730.123us, non-child: 730.123us, % non-child: 100.00%) - BytesSent: 11.76 KB (12038) - OverallThroughput: 15.72 MB/sec - PeakMemoryUsage: 264.66 KB (271008) - RowsReturned: 54 (54) - SerializeBatchTime: 515.633us - UncompressedRowBatchSize: 11.76 KB (12038) CodeGen:(Total: 736.403ms, non-child: 736.403ms, % non-child: 100.00%) - CodegenTime: 14.674ms - CompileTime: 273.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 434.989ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 27.533ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 625.694ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 80.765us - GetResultsTime: 116.828us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9921132) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 54 (54) - RowsReturnedRate: 0 - StreamingTime: 611.054ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.122ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.058ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9621228) - ProbeRows: 108 (108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 140.989us - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 155.840us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 566.858us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 133.808us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 58.574us, non-child: 58.574us, % non-child: 100.00%) - ConvertRowBatchTime: 45.592us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 29.09 M/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 4.800us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 290.201us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 10.107ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 580.758us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9564908) - ProbeRows: 108 (108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.295us - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.193us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 312.148us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.785us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 14.510us, non-child: 14.510us, % non-child: 100.00%) - ConvertRowBatchTime: 7.471us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.88 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.054us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 56.474us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s589ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.40M (1399063) - BuildTime: 1s661ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 588.13 MB (616698112) - ProbeRows: 37.08M (37076731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s701ms - RowsReturned: 108 (108) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s317ms - BuildRowsPartitioned: 1.40M (1399063) - GetNewBlockTime: 2.137ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.21K (4205) - HashTablesBuildTime: 333.565ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 588.06 MB (616626304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 185.635ms, % non-child: 0.03%) - ConvertRowBatchTime: 84.097ms - PeakMemoryUsage: 0 - RowsReturned: 1.40M (1399063) - RowsReturnedRate: 2.21 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.53 MB, 22.87 MB, 56.57 MB, 95.32 MB, 131.96 MB, 157.17 MB, 171.73 MB, 180.56 MB, 187.92 MB, 194.41 MB, 199.90 MB, 204.78 MB, 210.04 MB, 215.22 MB, 219.72 MB, 223.17 MB, 225.96 MB, 228.62 MB, 231.08 MB, 233.26 MB, 235.27 MB, 237.21 MB, 238.71 MB, 240.17 MB, 241.50 MB, 242.84 MB, 243.93 MB, 244.78 MB, 245.40 MB, 245.79 MB, 246.10 MB, 246.49 MB, 246.74 MB, 246.77 MB, 247.45 MB, 248.21 MB, 248.21 MB, 248.21 MB, 248.21 MB, 248.21 MB, 248.21 MB, 248.21 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 248.21 MB (260264257) - TotalGetBatchTime: 10m34s - DataArrivalTimer: 10m34s SenderSide: - DeserializeRowBatchTimer: 2s033ms - NumBatchesAccepted: 12.55K (12554) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s448ms, % non-child: 1.24%) - ConvertRowBatchTime: 1s069ms - PeakMemoryUsage: 0 - RowsReturned: 37.08M (37076731) - RowsReturnedRate: 316.37 K/sec RecvrSide: BytesReceived(16s000ms): 7.14 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.57 MB, 139.68 MB, 405.81 MB, 510.73 MB, 573.03 MB, 617.87 MB, 647.70 MB, 661.36 MB - FirstBatchArrivalWaitTime: 2s219ms - TotalBytesReceived: 665.38 MB (697705840) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTimer: 4s209ms - NumBatchesAccepted: 56.67K (56672) - NumBatchesRejected: 75 (75) Instance 5f429df048b5534b:41bcce1800000242 (host=foo.246.51:22000):(Total: 12m37s, non-child: 70.870ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.14 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 40.36 MB, 162.40 MB, 162.44 MB, 244.89 MB, 290.92 MB, 319.18 MB, 351.91 MB, 383.91 MB, 397.17 MB, 402.42 MB, 402.40 MB, 402.42 MB, 412.63 MB, 422.66 MB, 426.41 MB, 430.93 MB, 434.41 MB, 439.40 MB, 449.67 MB, 450.43 MB, 456.18 MB, 458.41 MB, 458.41 MB, 464.67 MB, 466.41 MB, 466.43 MB, 466.41 MB, 466.41 MB, 466.44 MB, 466.43 MB, 466.45 MB, 466.40 MB, 466.40 MB, 466.40 MB, 518.65 MB, 647.76 MB, 647.78 MB, 647.98 MB, 648.14 MB, 648.09 MB, 647.94 MB, 647.88 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 661.30 MB (693426870) - PerHostPeakMemUsage: 1.23 GB (1319248021) - RowsProduced: 55 (55) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 16.033ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.68K (3680) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s244ms - TotalThreadsUserTime: 9s391ms - TotalThreadsVoluntaryContextSwitches: 64.80K (64802) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2m1s - OpenTime: 10m35s - ExecTreeOpenTime: 10m35s - PrepareTime: 49.626ms - ExecTreePrepareTime: 721.508us DataStreamSender (dst_id=26):(Total: 796.310us, non-child: 796.310us, % non-child: 100.00%) - BytesSent: 12.05 KB (12343) - OverallThroughput: 14.78 MB/sec - PeakMemoryUsage: 272.66 KB (279200) - RowsReturned: 55 (55) - SerializeBatchTime: 615.763us - UncompressedRowBatchSize: 12.05 KB (12343) CodeGen:(Total: 623.009ms, non-child: 623.009ms, % non-child: 100.00%) - CodegenTime: 16.336ms - CompileTime: 194.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 402.426ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 26.057ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 617.004ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 72.537us - GetResultsTime: 134.951us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 1 (1) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9926328) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 55 (55) - RowsReturnedRate: 0 - StreamingTime: 604.629ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.388ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.165ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9622328) - ProbeRows: 724 (724) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 476.818us - RowsReturned: 724 (724) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 210.661us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 485.314us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 326.832us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 628.325ms, non-child: 70.245us, % non-child: 0.01%) - ConvertRowBatchTime: 54.505us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 2.71 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 628.261ms - DataArrivalTimer: 628.255ms SenderSide: - DeserializeRowBatchTimer: 352.620us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 2.594ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 633.048us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566008) - ProbeRows: 724 (724) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 511.326us - RowsReturned: 724 (724) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.916us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 407.623us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.612us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 15.843us, non-child: 15.843us, % non-child: 100.00%) - ConvertRowBatchTime: 8.523us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.29 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.812us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 72.701us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s694ms, % non-child: 0.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.47M (1473296) - BuildTime: 1s840ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 636.13 MB (667029760) - ProbeRows: 37.20M (37195883) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s631ms - RowsReturned: 724 (724) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s542ms - BuildRowsPartitioned: 1.47M (1473296) - GetNewBlockTime: 3.149ms - HashBuckets: 3.80M (3801088) - HashCollisions: 4.79K (4787) - HashTablesBuildTime: 285.335ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 636.06 MB (666957952) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 215.821ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.627ms - PeakMemoryUsage: 0 - RowsReturned: 1.47M (1473296) - RowsReturnedRate: 2.33 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.57 MB, 23.86 MB, 59.59 MB, 100.58 MB, 138.24 MB, 165.20 MB, 181.06 MB, 190.57 MB, 198.34 MB, 205.21 MB, 211.15 MB, 216.37 MB, 221.97 MB, 227.45 MB, 232.10 MB, 235.82 MB, 238.81 MB, 241.63 MB, 244.29 MB, 246.70 MB, 248.88 MB, 250.91 MB, 252.48 MB, 253.87 MB, 255.31 MB, 256.44 MB, 257.57 MB, 258.37 MB, 258.89 MB, 259.34 MB, 259.55 MB, 259.90 MB, 260.22 MB, 260.32 MB, 260.96 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB, 261.62 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 261.62 MB (274332546) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 2s111ms - NumBatchesAccepted: 13.22K (13225) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s433ms, % non-child: 1.21%) - ConvertRowBatchTime: 1s064ms - PeakMemoryUsage: 0 - RowsReturned: 37.20M (37195883) - RowsReturnedRate: 314.52 K/sec RecvrSide: BytesReceived(16s000ms): 7.08 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.44 MB, 138.81 MB, 405.92 MB, 511.80 MB, 574.41 MB, 619.47 MB, 649.43 MB, 663.24 MB - FirstBatchArrivalWaitTime: 2s326ms - TotalBytesReceived: 667.30 MB (699718644) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s557ms - NumBatchesAccepted: 56.86K (56857) - NumBatchesRejected: 56 (56) Instance 5f429df048b5534b:41bcce180000024d (host=foo.246.46:22000):(Total: 12m37s, non-child: 71.817ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.29 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 39.62 MB, 162.45 MB, 162.42 MB, 227.18 MB, 290.43 MB, 301.40 MB, 321.17 MB, 359.91 MB, 378.41 MB, 388.68 MB, 394.39 MB, 394.40 MB, 397.15 MB, 410.66 MB, 418.42 MB, 418.40 MB, 418.41 MB, 418.42 MB, 418.39 MB, 421.41 MB, 433.41 MB, 434.42 MB, 434.43 MB, 434.41 MB, 434.42 MB, 434.40 MB, 434.46 MB, 434.40 MB, 434.41 MB, 434.40 MB, 434.39 MB, 434.42 MB, 434.36 MB, 434.43 MB, 479.34 MB, 607.96 MB, 607.47 MB, 607.90 MB, 608.09 MB, 607.59 MB, 608.22 MB, 608.35 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 621.30 MB (651483830) - PerHostPeakMemUsage: 1.20 GB (1286662146) - RowsProduced: 40 (40) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 11.837ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4.11K (4112) - TotalThreadsTotalWallClockTime: 23m14s - TotalThreadsSysTime: 1s177ms - TotalThreadsUserTime: 9s542ms - TotalThreadsVoluntaryContextSwitches: 63.04K (63039) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 2m - OpenTime: 10m36s - ExecTreeOpenTime: 10m35s - PrepareTime: 50.574ms - ExecTreePrepareTime: 862.531us DataStreamSender (dst_id=26):(Total: 475.279us, non-child: 475.279us, % non-child: 100.00%) - BytesSent: 8.36 KB (8557) - OverallThroughput: 17.17 MB/sec - PeakMemoryUsage: 220.66 KB (225952) - RowsReturned: 40 (40) - SerializeBatchTime: 285.520us - UncompressedRowBatchSize: 8.36 KB (8557) CodeGen:(Total: 683.647ms, non-child: 683.647ms, % non-child: 100.00%) - CodegenTime: 16.131ms - CompileTime: 226.598ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 432.052ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.438ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 646.945ms, % non-child: 0.09%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 52.035us - GetResultsTime: 123.403us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923436) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 40 (40) - RowsReturnedRate: 0 - StreamingTime: 632.123ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.430ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 984.974us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623532) - ProbeRows: 696 (696) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 400.413us - RowsReturned: 694 (694) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 161.319us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 550.054us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 145.744us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s264ms, non-child: 55.630us, % non-child: 0.00%) - ConvertRowBatchTime: 42.437us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.35 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s264ms - DataArrivalTimer: 1s264ms SenderSide: - DeserializeRowBatchTimer: 194.532us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 3.019ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 471.195us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9567212) - ProbeRows: 696 (696) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 542.614us - RowsReturned: 696 (696) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.765us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 279.842us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.198us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 17.571us, non-child: 17.571us, % non-child: 100.00%) - ConvertRowBatchTime: 8.858us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.59 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.620us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 95.411us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s643ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.39M (1393250) - BuildTime: 1s731ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 596.13 MB (625086720) - ProbeRows: 37.06M (37060620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s690ms - RowsReturned: 696 (696) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s365ms - BuildRowsPartitioned: 1.39M (1393250) - GetNewBlockTime: 2.488ms - HashBuckets: 3.28M (3276800) - HashCollisions: 2.30K (2304) - HashTablesBuildTime: 353.146ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 596.06 MB (625014912) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m34s, non-child: 195.887ms, % non-child: 0.03%) - ConvertRowBatchTime: 89.791ms - PeakMemoryUsage: 0 - RowsReturned: 1.39M (1393250) - RowsReturnedRate: 2.20 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.58 MB, 23.02 MB, 56.63 MB, 95.21 MB, 130.87 MB, 155.87 MB, 170.85 MB, 179.77 MB, 187.21 MB, 193.70 MB, 199.24 MB, 204.10 MB, 209.34 MB, 214.54 MB, 219.00 MB, 222.50 MB, 225.27 MB, 227.92 MB, 230.33 MB, 232.47 MB, 234.41 MB, 236.26 MB, 237.73 MB, 239.04 MB, 240.34 MB, 241.69 MB, 242.71 MB, 243.54 MB, 244.09 MB, 244.54 MB, 244.92 MB, 245.25 MB, 245.42 MB, 245.46 MB, 246.17 MB, 246.97 MB, 246.97 MB, 246.97 MB, 246.97 MB, 246.97 MB, 246.97 MB, 246.97 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 246.97 MB (258971859) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s784ms - NumBatchesAccepted: 12.50K (12501) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m57s, non-child: 1s428ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s067ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37060620) - RowsReturnedRate: 315.54 K/sec RecvrSide: BytesReceived(16s000ms): 7.16 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.77 MB, 140.30 MB, 406.22 MB, 510.53 MB, 572.80 MB, 617.52 MB, 647.29 MB, 660.88 MB - FirstBatchArrivalWaitTime: 2s262ms - TotalBytesReceived: 664.88 MB (697175519) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s180ms - NumBatchesAccepted: 56.64K (56641) - NumBatchesRejected: 55 (55) Instance 5f429df048b5534b:41bcce1800000237 (host=foo.246.52:22000):(Total: 12m37s, non-child: 85.931ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.14 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 39.35 MB, 162.42 MB, 162.41 MB, 235.66 MB, 290.40 MB, 295.66 MB, 330.17 MB, 365.66 MB, 390.42 MB, 402.42 MB, 404.42 MB, 413.43 MB, 418.44 MB, 418.44 MB, 418.41 MB, 418.41 MB, 418.42 MB, 419.91 MB, 426.41 MB, 426.41 MB, 426.42 MB, 426.40 MB, 426.42 MB, 426.43 MB, 426.41 MB, 426.41 MB, 426.40 MB, 426.40 MB, 426.40 MB, 426.42 MB, 426.45 MB, 426.42 MB, 432.84 MB, 434.41 MB, 491.82 MB, 615.53 MB, 616.21 MB, 616.00 MB, 615.85 MB, 616.26 MB, 615.93 MB, 616.24 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 629.30 MB (659872438) - PerHostPeakMemUsage: 1.23 GB (1318272346) - RowsProduced: 43 (43) - TotalNetworkReceiveTime: 12m30s - TotalNetworkSendTime: 24.626ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.96K (3962) - TotalThreadsTotalWallClockTime: 23m12s - TotalThreadsSysTime: 1s204ms - TotalThreadsUserTime: 9s614ms - TotalThreadsVoluntaryContextSwitches: 63.76K (63759) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1m58s - OpenTime: 10m39s - ExecTreeOpenTime: 10m38s - PrepareTime: 49.385ms - ExecTreePrepareTime: 709.731us DataStreamSender (dst_id=26):(Total: 572.250us, non-child: 572.250us, % non-child: 100.00%) - BytesSent: 9.23 KB (9447) - OverallThroughput: 15.74 MB/sec - PeakMemoryUsage: 236.66 KB (242336) - RowsReturned: 43 (43) - SerializeBatchTime: 406.328us - UncompressedRowBatchSize: 9.23 KB (9447) CodeGen:(Total: 676.487ms, non-child: 676.487ms, % non-child: 100.00%) - CodegenTime: 18.003ms - CompileTime: 224.782ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 426.477ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 24.501ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 622.627ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 51.837us - GetResultsTime: 153.462us - HTResizeTime: 0.000ns - HashBuckets: 15.36K (15360) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.47 MB (9932070) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 43 (43) - RowsReturnedRate: 0 - StreamingTime: 608.810ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.009ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.007ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.19 MB (9632166) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.830us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 163.687us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 576.126us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 164.114us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 529.552ms, non-child: 66.864us, % non-child: 0.01%) - ConvertRowBatchTime: 50.576us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 3.22 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 529.492ms - DataArrivalTimer: 529.485ms SenderSide: - DeserializeRowBatchTimer: 334.594us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 20.107ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 537.013us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.13 MB (9575846) - ProbeRows: 86 (86) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.856us - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 20.541us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 346.522us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.001us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 16.305us, non-child: 16.305us, % non-child: 100.00%) - ConvertRowBatchTime: 8.041us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.80 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.306us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 90.666us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s678ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.42M (1418524) - BuildTime: 1s741ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 604.13 MB (633475328) - ProbeRows: 37.06M (37061648) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s710ms - RowsReturned: 86 (86) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s460ms - BuildRowsPartitioned: 1.42M (1418524) - GetNewBlockTime: 2.922ms - HashBuckets: 3.28M (3276800) - HashCollisions: 4.11K (4109) - HashTablesBuildTime: 268.049ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 604.06 MB (633403520) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 208.237ms, % non-child: 0.03%) - ConvertRowBatchTime: 98.385ms - PeakMemoryUsage: 0 - RowsReturned: 1.42M (1418524) - RowsReturnedRate: 2.24 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.54 MB, 23.20 MB, 57.56 MB, 97.02 MB, 133.91 MB, 159.41 MB, 174.16 MB, 183.16 MB, 190.63 MB, 197.27 MB, 202.92 MB, 207.92 MB, 213.22 MB, 218.53 MB, 223.05 MB, 226.60 MB, 229.45 MB, 232.15 MB, 234.67 MB, 236.92 MB, 238.94 MB, 240.88 MB, 242.34 MB, 243.78 MB, 245.12 MB, 246.42 MB, 247.52 MB, 248.35 MB, 249.07 MB, 249.54 MB, 249.76 MB, 250.01 MB, 250.21 MB, 250.29 MB, 250.98 MB, 251.80 MB, 251.80 MB, 251.80 MB, 251.80 MB, 251.80 MB, 251.80 MB, 251.80 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 251.80 MB (264034477) - TotalGetBatchTime: 10m32s - DataArrivalTimer: 10m32s SenderSide: - DeserializeRowBatchTimer: 1s882ms - NumBatchesAccepted: 12.72K (12723) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s442ms, % non-child: 1.22%) - ConvertRowBatchTime: 1s074ms - PeakMemoryUsage: 0 - RowsReturned: 37.06M (37061648) - RowsReturnedRate: 313.19 K/sec RecvrSide: BytesReceived(16s000ms): 7.08 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.52 MB, 138.86 MB, 405.02 MB, 510.22 MB, 572.62 MB, 617.47 MB, 647.29 MB, 661.01 MB - FirstBatchArrivalWaitTime: 2s231ms - TotalBytesReceived: 665.06 MB (697371024) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s542ms - NumBatchesAccepted: 56.65K (56646) - NumBatchesRejected: 50 (50) Instance 5f429df048b5534b:41bcce180000023f (host=foo.234.46:22000):(Total: 12m37s, non-child: 79.203ms, % non-child: 0.01%) MemoryUsage(16s000ms): 15.76 MB, 21.26 MB, 21.26 MB, 21.26 MB, 21.26 MB, 38.37 MB, 162.40 MB, 162.42 MB, 233.15 MB, 290.45 MB, 302.43 MB, 345.19 MB, 362.92 MB, 373.92 MB, 393.16 MB, 404.41 MB, 418.19 MB, 418.39 MB, 418.41 MB, 418.41 MB, 418.38 MB, 420.65 MB, 432.42 MB, 434.41 MB, 434.40 MB, 439.15 MB, 447.17 MB, 450.42 MB, 457.91 MB, 462.94 MB, 466.41 MB, 466.42 MB, 466.42 MB, 466.42 MB, 466.41 MB, 466.38 MB, 466.40 MB, 466.39 MB, 466.33 MB, 515.97 MB, 640.57 MB, 640.32 MB, 639.97 MB, 639.76 MB, 639.44 MB, 640.06 MB, 640.34 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 653.30 MB (685038262) - PerHostPeakMemUsage: 1.30 GB (1394424713) - RowsProduced: 61 (61) - TotalNetworkReceiveTime: 12m31s - TotalNetworkSendTime: 23.907ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.98K (3976) - TotalThreadsTotalWallClockTime: 23m13s - TotalThreadsSysTime: 1s206ms - TotalThreadsUserTime: 9s359ms - TotalThreadsVoluntaryContextSwitches: 63.77K (63775) Fragment Instance Lifecycle Timings: - ExecTime: 1m59s - ExecTreeExecTime: 1m59s - OpenTime: 10m37s - ExecTreeOpenTime: 10m36s - PrepareTime: 60.500ms - ExecTreePrepareTime: 1.000ms DataStreamSender (dst_id=26):(Total: 574.821us, non-child: 574.821us, % non-child: 100.00%) - BytesSent: 13.48 KB (13801) - OverallThroughput: 22.90 MB/sec - PeakMemoryUsage: 268.66 KB (275104) - RowsReturned: 61 (61) - SerializeBatchTime: 394.102us - UncompressedRowBatchSize: 13.48 KB (13801) CodeGen:(Total: 633.632ms, non-child: 633.632ms, % non-child: 100.00%) - CodegenTime: 14.793ms - CompileTime: 198.133ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 7.18K (7182) - OptimizationTime: 398.546ms - PeakMemoryUsage: 3.51 MB (3677184) - PrepareTime: 36.483ms AGGREGATION_NODE (id=15):(Total: 12m36s, non-child: 619.117ms, % non-child: 0.08%) ExecOption: Streaming Preaggregation, Codegen Disabled: PartitionedAggregationNode::CodegenUpdateTuple(): cannot codegenCHAR in aggregations - GetNewBlockTime: 518.450us - GetResultsTime: 110.479us - HTResizeTime: 0.000ns - HashBuckets: 16.38K (16384) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.46 MB (9923182) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 61 (61) - RowsReturnedRate: 0 - StreamingTime: 605.090ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 12m35s, non-child: 2.368ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.70K (1704) - BuildTime: 1.477ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.18 MB (9623278) - ProbeRows: 122 (122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 141.852us - RowsReturned: 122 (122) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 150.079us - BuildRowsPartitioned: 1.70K (1704) - GetNewBlockTime: 925.358us - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 180.310us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.08 MB (1131648) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=25):(Total: 1s646ms, non-child: 59.657us, % non-child: 0.00%) - ConvertRowBatchTime: 42.424us - PeakMemoryUsage: 0 - RowsReturned: 1.70K (1704) - RowsReturnedRate: 1.03 K/sec RecvrSide: BytesReceived(16s000ms): 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB, 23.57 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 23.57 KB (24135) - TotalGetBatchTime: 1s646ms - DataArrivalTimer: 1s646ms SenderSide: - DeserializeRowBatchTimer: 220.544us - NumBatchesAccepted: 2 (2) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12m35s, non-child: 5.657ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.121ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 9.12 MB (9566958) - ProbeRows: 122 (122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 150.429us - RowsReturned: 122 (122) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 32.866us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 730.378us - HashBuckets: 576 (576) - HashCollisions: 0 (0) - HashTablesBuildTime: 123.848us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.03 MB (1079424) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=24):(Total: 22.202us, non-child: 22.202us, % non-child: 100.00%) - ConvertRowBatchTime: 12.589us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 12.34 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.028us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 82.627us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=12):(Total: 12m35s, non-child: 6s570ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.44M (1442670) - BuildTime: 1s746ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 628.13 MB (658641767) - ProbeRows: 37.09M (37090452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s609ms - RowsReturned: 122 (122) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s450ms - BuildRowsPartitioned: 1.44M (1442670) - GetNewBlockTime: 3.288ms - HashBuckets: 3.28M (3276800) - HashCollisions: 3.48K (3475) - HashTablesBuildTime: 280.779ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 628.06 MB (658569344) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 10m33s, non-child: 199.451ms, % non-child: 0.03%) - ConvertRowBatchTime: 95.320ms - PeakMemoryUsage: 0 - RowsReturned: 1.44M (1442670) - RowsReturnedRate: 2.28 K/sec RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 1.46 MB, 22.90 MB, 56.98 MB, 96.38 MB, 133.28 MB, 159.93 MB, 175.91 MB, 185.13 MB, 192.88 MB, 199.70 MB, 205.48 MB, 210.51 MB, 215.96 MB, 221.46 MB, 226.15 MB, 229.84 MB, 232.84 MB, 235.56 MB, 238.08 MB, 240.33 MB, 242.31 MB, 244.17 MB, 245.58 MB, 246.98 MB, 248.22 MB, 249.50 MB, 250.37 MB, 251.23 MB, 251.85 MB, 252.17 MB, 252.45 MB, 252.64 MB, 252.78 MB, 252.83 MB, 253.50 MB, 254.35 MB, 254.35 MB, 254.35 MB, 254.35 MB, 254.35 MB, 254.35 MB, 254.35 MB - FirstBatchArrivalWaitTime: 1m30s - TotalBytesReceived: 254.35 MB (266710061) - TotalGetBatchTime: 10m33s - DataArrivalTimer: 10m33s SenderSide: - DeserializeRowBatchTimer: 1s994ms - NumBatchesAccepted: 12.94K (12937) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=22):(Total: 1m58s, non-child: 1s421ms, % non-child: 1.20%) - ConvertRowBatchTime: 1s054ms - PeakMemoryUsage: 0 - RowsReturned: 37.09M (37090452) - RowsReturnedRate: 313.83 K/sec RecvrSide: BytesReceived(16s000ms): 6.98 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 10.01 MB, 13.18 MB, 136.81 MB, 403.28 MB, 510.06 MB, 572.61 MB, 617.67 MB, 647.64 MB, 661.53 MB - FirstBatchArrivalWaitTime: 2s181ms - TotalBytesReceived: 665.64 MB (697975993) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTimer: 4s412ms - NumBatchesAccepted: 56.69K (56692) - NumBatchesRejected: 49 (49) Averaged Fragment F00:(Total: 11m32s, non-child: 11m23s, % non-child: 98.62%) split sizes: min: 21.78 GB, max: 22.93 GB, avg: 22.56 GB, stddev: 188.35 MB completion times: min:10m57s max:12m38s mean: 11m32s stddev:28s424ms execution rates: min:30.36 MB/sec max:35.46 MB/sec mean:33.40 MB/sec stddev:1.40 MB/sec num instances: 129 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.42 MB (141997007) - PerHostPeakMemUsage: 1.32 GB (1415052875) - RowsProduced: 37.06M (37059272) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m16s - TotalStorageWaitTime: 220.906ms - TotalThreadsInvoluntaryContextSwitches: 3.87K (3870) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 2s047ms - TotalThreadsUserTime: 22s278ms - TotalThreadsVoluntaryContextSwitches: 188.85K (188849) Fragment Instance Lifecycle Timings: - ExecTime: 11m32s - ExecTreeExecTime: 5s185ms - OpenTime: 67.084ms - ExecTreeOpenTime: 207.021us - PrepareTime: 33.772ms - ExecTreePrepareTime: 885.141us DataStreamSender (dst_id=22):(Total: 4s303ms, non-child: 4s303ms, % non-child: 100.00%) - BytesSent: 665.03 MB (697336517) - OverallThroughput: 155.41 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.06M (37059272) - SerializeBatchTime: 4s294ms - UncompressedRowBatchSize: 665.03 MB (697336517) CodeGen:(Total: 93.150ms, non-child: 93.150ms, % non-child: 100.00%) - CodegenTime: 1.497ms - CompileTime: 10.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 55.286ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.703ms HDFS_SCAN_NODE (id=2):(Total: 5s160ms, non-child: 5s160ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 242.57 MB (254355172) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.57 MB (254355172) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.57 MB (254355172) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s053ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.55 MB (133741643) - PerReadThreadRawHdfsThroughput: 789.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.254ms - RowBatchQueuePutWaitTime: 56m1s - RowsRead: 37.06M (37059272) - RowsReturned: 37.06M (37059272) - RowsReturnedRate: 7.17 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.32K (2323) - ScannerThreadsTotalWallClockTime: 56m25s - MaterializeTupleTime(*): 2s986ms - ScannerThreadsSysTime: 1s526ms - ScannerThreadsUserTime: 11s339ms - ScannerThreadsVoluntaryContextSwitches: 172.95K (172951) - TotalRawHdfsReadTime(*): 310.890ms - TotalReadThroughput: 359.14 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 36.20K (36195) - RowGroups rejected: 0 (0) - RowGroups total: 36.20K (36195) - Rows processed: 177.94K (177937) - Rows rejected: 0 (0) - Rows total: 37.06M (37059272) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 139.58K (139578) - Rows rejected: 0 (0) - Rows total: 37.06M (37059272) Filter 3 (2.00 MB): - Rows processed: 138.73K (138734) - Rows rejected: 0 (0) - Rows total: 37.06M (37059272) BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F00: Instance 5f429df048b5534b:41bcce180000004c (host=foo.232.45:22000):(Total: 12m38s, non-child: 12m26s, % non-child: 98.52%) Hdfs split stats (:<# splits>/): 0:10/2.39 GB 7:8/1.97 GB 1:15/3.49 GB 6:14/3.12 GB 5:16/3.66 GB 3:12/2.76 GB 2:11/2.58 GB 4:11/2.71 GB Filter 1 arrival: 746ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 66.40 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.16 MB, 96.76 MB, 100.68 MB, 74.60 MB, 66.92 MB, 83.08 MB, 61.19 MB, 81.01 MB, 67.87 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 101.79 MB (106729726) - PerHostPeakMemUsage: 1.33 GB (1424343503) - RowsProduced: 43.43M (43430342) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m16s - TotalStorageWaitTime: 222.823ms - TotalThreadsInvoluntaryContextSwitches: 4.10K (4097) - TotalThreadsTotalWallClockTime: 1h1m - TotalThreadsSysTime: 974.850ms - TotalThreadsUserTime: 24s592ms - TotalThreadsVoluntaryContextSwitches: 61.96K (61962) Fragment Instance Lifecycle Timings: - ExecTime: 12m37s - ExecTreeExecTime: 5s260ms - OpenTime: 65.818ms - ExecTreeOpenTime: 184.412us - PrepareTime: 32.811ms - ExecTreePrepareTime: 736.573us DataStreamSender (dst_id=22):(Total: 5s922ms, non-child: 5s922ms, % non-child: 100.00%) - BytesSent: 779.36 MB (817219540) - OverallThroughput: 131.59 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 43.43M (43430342) - SerializeBatchTime: 5s910ms - UncompressedRowBatchSize: 779.36 MB (817219540) CodeGen:(Total: 92.754ms, non-child: 92.754ms, % non-child: 100.00%) - CodegenTime: 1.537ms - CompileTime: 10.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.511ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.629ms HDFS_SCAN_NODE (id=2):(Total: 5s219ms, non-child: 5s219ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.39 GB 7:8/1.97 GB 1:15/3.49 GB 6:14/3.12 GB 5:16/3.66 GB 3:12/2.76 GB 2:11/2.58 GB 4:11/2.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:39 BytesRead(16s000ms): 57.13 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 83.09 MB, 104.75 MB, 154.79 MB, 154.79 MB, 217.60 MB, 245.34 MB - FooterProcessingTime: (Avg: 1.589ms ; Min: 659.209us ; Max: 3.587ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.85 - BytesRead: 284.52 MB (298339859) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.52 MB (298339859) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.52 MB (298339859) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s188ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 93.72 MB (98271368) - PerReadThreadRawHdfsThroughput: 858.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.453ms - RowBatchQueuePutWaitTime: 48m24s - RowsRead: 43.43M (43430343) - RowsReturned: 43.43M (43430342) - RowsReturnedRate: 8.32 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1636) - ScannerThreadsTotalWallClockTime: 48m40s - MaterializeTupleTime(*): 3s452ms - ScannerThreadsSysTime: 234.962ms - ScannerThreadsUserTime: 8s892ms - ScannerThreadsVoluntaryContextSwitches: 43.23K (43233) - TotalRawHdfsReadTime(*): 331.410ms - TotalReadThroughput: 384.62 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 84 (84) - Files total: 97 (97) - RowGroups processed: 42.42K (42419) - RowGroups rejected: 0 (0) - RowGroups total: 42.42K (42419) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 43.43M (43430343) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 192.51K (192513) - Rows rejected: 0 (0) - Rows total: 43.43M (43430343) Filter 3 (2.00 MB): - Rows processed: 192.51K (192513) - Rows rejected: 1 (1) - Rows total: 43.43M (43430343) Instance 5f429df048b5534b:41bcce1800000040 (host=foo.232.15:22000):(Total: 12m37s, non-child: 12m26s, % non-child: 98.53%) Hdfs split stats (:<# splits>/): 7:13/3.00 GB 1:11/2.59 GB 2:10/2.34 GB 5:14/3.45 GB 6:9/2.12 GB 4:9/1.95 GB 0:11/2.65 GB 3:18/4.37 GB Filter 1 arrival: 1s293ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.92 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 134.58 MB, 135.09 MB, 139.25 MB, 137.22 MB, 99.42 MB, 84.75 MB, 81.34 MB, 67.04 MB, 71.63 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4 - AverageThreadTokens: 5.80 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.47 MB (147298528) - PerHostPeakMemUsage: 1.42 GB (1529109992) - RowsProduced: 44.47M (44471519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m17s - TotalStorageWaitTime: 284.368ms - TotalThreadsInvoluntaryContextSwitches: 4.18K (4184) - TotalThreadsTotalWallClockTime: 1h13m - TotalThreadsSysTime: 1s504ms - TotalThreadsUserTime: 25s034ms - TotalThreadsVoluntaryContextSwitches: 146.65K (146647) Fragment Instance Lifecycle Timings: - ExecTime: 12m37s - ExecTreeExecTime: 5s383ms - OpenTime: 56.741ms - ExecTreeOpenTime: 145.119us - PrepareTime: 38.086ms - ExecTreePrepareTime: 595.785us DataStreamSender (dst_id=22):(Total: 5s675ms, non-child: 5s675ms, % non-child: 100.00%) - BytesSent: 797.29 MB (836023824) - OverallThroughput: 140.49 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 44.47M (44471519) - SerializeBatchTime: 5s661ms - UncompressedRowBatchSize: 797.29 MB (836023824) CodeGen:(Total: 83.503ms, non-child: 83.503ms, % non-child: 100.00%) - CodegenTime: 1.218ms - CompileTime: 8.181ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 47.678ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.192ms HDFS_SCAN_NODE (id=2):(Total: 5s348ms, non-child: 5s348ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.00 GB 1:11/2.59 GB 2:10/2.34 GB 5:14/3.45 GB 6:9/2.12 GB 4:9/1.95 GB 0:11/2.65 GB 3:18/4.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:39 BytesRead(16s000ms): 77.92 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 113.34 MB, 133.53 MB, 185.15 MB, 205.32 MB, 255.04 MB - FooterProcessingTime: (Avg: 1.195ms ; Min: 554.881us ; Max: 2.856ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.80 - BytesRead: 290.76 MB (304886147) - BytesReadDataNodeCache: 0 - BytesReadLocal: 290.76 MB (304886147) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 290.76 MB (304886147) - CachedFileHandlesHitCount: 75 (75) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s197ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828708) - PerReadThreadRawHdfsThroughput: 826.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.198ms - RowBatchQueuePutWaitTime: 1h - RowsRead: 44.47M (44471519) - RowsReturned: 44.47M (44471519) - RowsReturnedRate: 8.31 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 3s412ms - ScannerThreadsSysTime: 894.862ms - ScannerThreadsUserTime: 10s144ms - ScannerThreadsVoluntaryContextSwitches: 128.57K (128573) - TotalRawHdfsReadTime(*): 351.605ms - TotalReadThroughput: 393.32 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 82 (82) - Files total: 95 (95) - RowGroups processed: 43.44K (43436) - RowGroups rejected: 0 (0) - RowGroups total: 43.44K (43436) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 44.47M (44471519) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 193.54K (193536) - Rows rejected: 0 (0) - Rows total: 44.47M (44471519) Filter 3 (2.00 MB): - Rows processed: 179.20K (179200) - Rows rejected: 0 (0) - Rows total: 44.47M (44471519) Instance 5f429df048b5534b:41bcce180000000d (host=foo.232.43:22000):(Total: 12m32s, non-child: 12m22s, % non-child: 98.58%) Hdfs split stats (:<# splits>/): 2:11/2.71 GB 5:15/3.63 GB 3:12/2.75 GB 7:7/1.46 GB 0:9/2.22 GB 4:19/4.21 GB 1:13/3.13 GB 6:12/2.71 GB Filter 1 arrival: 592ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.67 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.09 MB, 130.48 MB, 134.20 MB, 116.53 MB, 88.83 MB, 78.17 MB, 78.32 MB, 70.36 MB, 77.85 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4 - AverageThreadTokens: 5.80 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.27 MB (141845483) - PerHostPeakMemUsage: 1.43 GB (1530522299) - RowsProduced: 39.20M (39204176) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m12s - TotalStorageWaitTime: 276.209ms - TotalThreadsInvoluntaryContextSwitches: 3.39K (3392) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 945.853ms - TotalThreadsUserTime: 19s476ms - TotalThreadsVoluntaryContextSwitches: 56.63K (56635) Fragment Instance Lifecycle Timings: - ExecTime: 12m32s - ExecTreeExecTime: 5s248ms - OpenTime: 66.698ms - ExecTreeOpenTime: 188.801us - PrepareTime: 37.977ms - ExecTreePrepareTime: 833.269us DataStreamSender (dst_id=22):(Total: 5s411ms, non-child: 5s411ms, % non-child: 100.00%) - BytesSent: 705.91 MB (740197085) - OverallThroughput: 130.45 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.20M (39204176) - SerializeBatchTime: 5s398ms - UncompressedRowBatchSize: 705.91 MB (740197085) CodeGen:(Total: 92.734ms, non-child: 92.734ms, % non-child: 100.00%) - CodegenTime: 1.410ms - CompileTime: 9.952ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.825ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.424ms HDFS_SCAN_NODE (id=2):(Total: 5s216ms, non-child: 5s216ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:11/2.71 GB 5:15/3.63 GB 3:12/2.75 GB 7:7/1.46 GB 0:9/2.22 GB 4:19/4.21 GB 1:13/3.13 GB 6:12/2.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.39 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 141.69 MB, 184.25 MB, 206.69 MB, 256.06 MB - FooterProcessingTime: (Avg: 864.064us ; Min: 375.840us ; Max: 3.310ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.80 - BytesRead: 256.06 MB (268497768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.06 MB (268497768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.06 MB (268497768) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s098ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585792) - PerReadThreadRawHdfsThroughput: 680.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.572ms - RowBatchQueuePutWaitTime: 1h - RowsRead: 39.20M (39204176) - RowsReturned: 39.20M (39204176) - RowsReturnedRate: 7.51 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.13K (1129) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 3s169ms - ScannerThreadsSysTime: 228.962ms - ScannerThreadsUserTime: 5s125ms - ScannerThreadsVoluntaryContextSwitches: 38.70K (38699) - TotalRawHdfsReadTime(*): 376.016ms - TotalReadThroughput: 348.44 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 87 (87) - Files total: 98 (98) - RowGroups processed: 38.29K (38292) - RowGroups rejected: 0 (0) - RowGroups total: 38.29K (38292) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.20M (39204176) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 126.98K (126976) - Rows rejected: 0 (0) - Rows total: 39.20M (39204176) Filter 3 (2.00 MB): - Rows processed: 126.98K (126976) - Rows rejected: 0 (0) - Rows total: 39.20M (39204176) Instance 5f429df048b5534b:41bcce180000006f (host=foo.232.11:22000):(Total: 12m32s, non-child: 12m22s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 3:13/3.10 GB 0:16/3.94 GB 7:10/2.47 GB 6:11/2.44 GB 5:14/3.32 GB 2:9/2.18 GB 1:12/2.89 GB 4:10/2.29 GB Filter 1 arrival: 1s403ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 90.14 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 130.96 MB, 131.09 MB, 133.95 MB, 119.18 MB, 90.11 MB, 74.91 MB, 77.00 MB, 71.92 MB, 61.72 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 3 - AverageThreadTokens: 5.83 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.05 MB (141615387) - PerHostPeakMemUsage: 1.40 GB (1507459617) - RowsProduced: 39.79M (39794065) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m13s - TotalStorageWaitTime: 236.603ms - TotalThreadsInvoluntaryContextSwitches: 3.42K (3420) - TotalThreadsTotalWallClockTime: 1h13m - TotalThreadsSysTime: 999.845ms - TotalThreadsUserTime: 19s838ms - TotalThreadsVoluntaryContextSwitches: 76.80K (76795) Fragment Instance Lifecycle Timings: - ExecTime: 12m32s - ExecTreeExecTime: 5s218ms - OpenTime: 63.183ms - ExecTreeOpenTime: 195.946us - PrepareTime: 32.102ms - ExecTreePrepareTime: 741.734us DataStreamSender (dst_id=22):(Total: 5s077ms, non-child: 5s077ms, % non-child: 100.00%) - BytesSent: 715.97 MB (750749059) - OverallThroughput: 141.00 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.79M (39794065) - SerializeBatchTime: 5s066ms - UncompressedRowBatchSize: 715.97 MB (750749059) CodeGen:(Total: 89.608ms, non-child: 89.608ms, % non-child: 100.00%) - CodegenTime: 1.478ms - CompileTime: 10.804ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.926ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.420ms HDFS_SCAN_NODE (id=2):(Total: 5s190ms, non-child: 5s190ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/3.10 GB 0:16/3.94 GB 7:10/2.47 GB 6:11/2.44 GB 5:14/3.32 GB 2:9/2.18 GB 1:12/2.89 GB 4:10/2.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06653% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.43 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 112.62 MB, 131.30 MB, 184.35 MB, 213.73 MB - FooterProcessingTime: (Avg: 1.595ms ; Min: 659.290us ; Max: 3.069ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.83 - BytesRead: 260.69 MB (273357043) - BytesReadDataNodeCache: 0 - BytesReadLocal: 260.69 MB (273357043) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 260.69 MB (273357043) - CachedFileHandlesHitCount: 68 (68) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s064ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.08 MB (133248107) - PerReadThreadRawHdfsThroughput: 871.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.482ms - RowBatchQueuePutWaitTime: 1h - RowsRead: 39.79M (39794065) - RowsReturned: 39.79M (39794065) - RowsReturnedRate: 7.67 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.28K (1276) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 3s056ms - ScannerThreadsSysTime: 446.929ms - ScannerThreadsUserTime: 6s632ms - ScannerThreadsVoluntaryContextSwitches: 59.13K (59133) - TotalRawHdfsReadTime(*): 299.152ms - TotalReadThroughput: 355.22 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 83 (83) - Files total: 95 (95) - RowGroups processed: 38.87K (38867) - RowGroups rejected: 0 (0) - RowGroups total: 38.87K (38867) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 39.79M (39794065) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 157.70K (157696) - Rows rejected: 0 (0) - Rows total: 39.79M (39794065) Filter 3 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 39.79M (39794065) Instance 5f429df048b5534b:41bcce1800000031 (host=foo.232.33:22000):(Total: 12m21s, non-child: 12m10s, % non-child: 98.60%) Hdfs split stats (:<# splits>/): 5:14/3.45 GB 6:8/1.97 GB 1:10/2.26 GB 0:6/1.28 GB 7:16/3.87 GB 3:21/4.80 GB 2:10/2.42 GB 4:10/2.46 GB Filter 1 arrival: 961ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.21 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.65 MB, 139.26 MB, 127.27 MB, 96.81 MB, 79.04 MB, 78.14 MB, 72.93 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.45 MB (147277699) - PerHostPeakMemUsage: 1.43 GB (1538772744) - RowsProduced: 40.66M (40660371) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m2s - TotalStorageWaitTime: 208.566ms - TotalThreadsInvoluntaryContextSwitches: 3.86K (3860) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 2s140ms - TotalThreadsUserTime: 20s660ms - TotalThreadsVoluntaryContextSwitches: 184.83K (184829) Fragment Instance Lifecycle Timings: - ExecTime: 12m21s - ExecTreeExecTime: 5s276ms - OpenTime: 69.496ms - ExecTreeOpenTime: 170.806us - PrepareTime: 42.695ms - ExecTreePrepareTime: 955.322us DataStreamSender (dst_id=22):(Total: 5s072ms, non-child: 5s072ms, % non-child: 100.00%) - BytesSent: 730.84 MB (766346120) - OverallThroughput: 144.08 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 40.66M (40660371) - SerializeBatchTime: 5s061ms - UncompressedRowBatchSize: 730.84 MB (766346120) CodeGen:(Total: 97.156ms, non-child: 97.156ms, % non-child: 100.00%) - CodegenTime: 1.420ms - CompileTime: 10.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 57.647ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.264ms HDFS_SCAN_NODE (id=2):(Total: 5s245ms, non-child: 5s245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/3.45 GB 6:8/1.97 GB 1:10/2.26 GB 0:6/1.28 GB 7:16/3.87 GB 3:21/4.80 GB 2:10/2.42 GB 4:10/2.46 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.50 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 112.73 MB, 133.07 MB, 177.83 MB, 235.24 MB - FooterProcessingTime: (Avg: 1.783ms ; Min: 623.492us ; Max: 3.500ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 266.63 MB (279577677) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.63 MB (279577677) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.63 MB (279577677) - CachedFileHandlesHitCount: 69 (69) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s144ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828861) - PerReadThreadRawHdfsThroughput: 726.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 73.601ms - RowBatchQueuePutWaitTime: 59m33s - RowsRead: 40.66M (40660372) - RowsReturned: 40.66M (40660371) - RowsReturnedRate: 7.75 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.88K (1876) - ScannerThreadsTotalWallClockTime: 59m47s - MaterializeTupleTime(*): 3s266ms - ScannerThreadsSysTime: 1s530ms - ScannerThreadsUserTime: 7s583ms - ScannerThreadsVoluntaryContextSwitches: 167.83K (167826) - TotalRawHdfsReadTime(*): 367.094ms - TotalReadThroughput: 368.70 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 83 (83) - Files total: 95 (95) - RowGroups processed: 39.71K (39713) - RowGroups rejected: 0 (0) - RowGroups total: 39.71K (39713) - Rows processed: 196.61K (196609) - Rows rejected: 0 (0) - Rows total: 40.66M (40660372) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 173.06K (173057) - Rows rejected: 0 (0) - Rows total: 40.66M (40660372) Filter 3 (2.00 MB): - Rows processed: 165.89K (165889) - Rows rejected: 1 (1) - Rows total: 40.66M (40660372) Instance 5f429df048b5534b:41bcce1800000018 (host=foo.232.13:22000):(Total: 12m21s, non-child: 12m11s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 4:6/1.48 GB 7:7/1.73 GB 0:8/1.77 GB 2:15/3.42 GB 5:11/2.43 GB 3:18/4.10 GB 6:20/4.59 GB 1:12/2.74 GB Filter 1 arrival: 1s393ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 88.96 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.26 MB, 134.54 MB, 139.07 MB, 118.28 MB, 90.53 MB, 77.59 MB, 74.33 MB, 71.86 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.82 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.45 MB (147271477) - PerHostPeakMemUsage: 1.41 GB (1510408439) - RowsProduced: 36.12M (36122884) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m3s - TotalStorageWaitTime: 205.073ms - TotalThreadsInvoluntaryContextSwitches: 3.53K (3530) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 2s006ms - TotalThreadsUserTime: 20s873ms - TotalThreadsVoluntaryContextSwitches: 191.19K (191185) Fragment Instance Lifecycle Timings: - ExecTime: 12m20s - ExecTreeExecTime: 5s187ms - OpenTime: 79.047ms - ExecTreeOpenTime: 170.248us - PrepareTime: 28.451ms - ExecTreePrepareTime: 589.554us DataStreamSender (dst_id=22):(Total: 4s517ms, non-child: 4s517ms, % non-child: 100.00%) - BytesSent: 648.72 MB (680227983) - OverallThroughput: 143.59 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.12M (36122884) - SerializeBatchTime: 4s508ms - UncompressedRowBatchSize: 648.72 MB (680227983) CodeGen:(Total: 101.954ms, non-child: 101.954ms, % non-child: 100.00%) - CodegenTime: 1.427ms - CompileTime: 9.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 67.676ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.579ms HDFS_SCAN_NODE (id=2):(Total: 5s161ms, non-child: 5s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:6/1.48 GB 7:7/1.73 GB 0:8/1.77 GB 2:15/3.42 GB 5:11/2.43 GB 3:18/4.10 GB 6:20/4.59 GB 1:12/2.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:99.86% 1:0% 2:0.06761% 3:0% 4:0.06761% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 74.25 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 113.02 MB, 143.72 MB, 171.61 MB, 222.85 MB - FooterProcessingTime: (Avg: 1.407ms ; Min: 745.927us ; Max: 2.971ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.83 - BytesRead: 236.06 MB (247531367) - BytesReadDataNodeCache: 0 - BytesReadLocal: 236.06 MB (247531367) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 236.06 MB (247531367) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 966.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828878) - PerReadThreadRawHdfsThroughput: 826.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.991ms - RowBatchQueuePutWaitTime: 59m19s - RowsRead: 36.12M (36122884) - RowsReturned: 36.12M (36122884) - RowsReturnedRate: 7.00 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.64K (1636) - ScannerThreadsTotalWallClockTime: 59m35s - MaterializeTupleTime(*): 2s755ms - ScannerThreadsSysTime: 1s486ms - ScannerThreadsUserTime: 9s072ms - ScannerThreadsVoluntaryContextSwitches: 173.84K (173844) - TotalRawHdfsReadTime(*): 285.667ms - TotalReadThroughput: 326.66 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 35.28K (35281) - RowGroups rejected: 0 (0) - RowGroups total: 35.28K (35281) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 36.12M (36122884) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 36.12M (36122884) Filter 3 (2.00 MB): - Rows processed: 149.50K (149504) - Rows rejected: 0 (0) - Rows total: 36.12M (36122884) Instance 5f429df048b5534b:41bcce1800000029 (host=foo.232.23:22000):(Total: 12m19s, non-child: 12m7s, % non-child: 98.33%) Hdfs split stats (:<# splits>/): 1:10/2.32 GB 7:11/2.43 GB 5:7/1.66 GB 4:12/2.89 GB 3:14/3.45 GB 6:11/2.39 GB 0:15/3.66 GB 2:16/3.80 GB Filter 1 arrival: 1s272ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.06 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 128.98 MB, 129.69 MB, 121.19 MB, 89.65 MB, 93.59 MB, 96.20 MB, 91.38 MB, 74.55 MB ThreadUsage(16s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.25 MB (141815147) - PerHostPeakMemUsage: 1.38 GB (1486259692) - RowsProduced: 56.36M (56361302) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m56s - TotalStorageWaitTime: 314.968ms - TotalThreadsInvoluntaryContextSwitches: 6.23K (6232) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 1s908ms - TotalThreadsUserTime: 38s564ms - TotalThreadsVoluntaryContextSwitches: 148.43K (148426) Fragment Instance Lifecycle Timings: - ExecTime: 12m19s - ExecTreeExecTime: 5s333ms - OpenTime: 62.443ms - ExecTreeOpenTime: 161.050us - PrepareTime: 39.042ms - ExecTreePrepareTime: 877.272us DataStreamSender (dst_id=22):(Total: 6s962ms, non-child: 6s962ms, % non-child: 100.00%) - BytesSent: 1013.34 MB (1062560386) - OverallThroughput: 145.55 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 56.36M (56361302) - SerializeBatchTime: 6s945ms - UncompressedRowBatchSize: 1013.34 MB (1062560386) CodeGen:(Total: 88.844ms, non-child: 88.844ms, % non-child: 100.00%) - CodegenTime: 1.695ms - CompileTime: 9.577ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.762ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.878ms HDFS_SCAN_NODE (id=2):(Total: 5s285ms, non-child: 5s285ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:10/2.32 GB 7:11/2.43 GB 5:7/1.66 GB 4:12/2.89 GB 3:14/3.45 GB 6:11/2.39 GB 0:15/3.66 GB 2:16/3.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0.06766% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:80 PARQUET/SNAPPY:48 BytesRead(16s000ms): 77.37 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 146.11 MB, 208.22 MB, 268.03 MB, 303.92 MB, 339.01 MB - FooterProcessingTime: (Avg: 2.284ms ; Min: 633.794us ; Max: 8.640ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 368.55 MB (386457378) - BytesReadDataNodeCache: 0 - BytesReadLocal: 368.55 MB (386457378) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 368.55 MB (386457378) - CachedFileHandlesHitCount: 94 (94) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s647ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133586017) - PerReadThreadRawHdfsThroughput: 796.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.793ms - RowBatchQueuePutWaitTime: 59m30s - RowsRead: 56.36M (56361302) - RowsReturned: 56.36M (56361302) - RowsReturnedRate: 10.66 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 3.75K (3745) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 4s784ms - ScannerThreadsSysTime: 1s153ms - ScannerThreadsUserTime: 21s154ms - ScannerThreadsVoluntaryContextSwitches: 131.47K (131472) - TotalRawHdfsReadTime(*): 462.786ms - TotalReadThroughput: 510.69 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 80 (80) - Files total: 96 (96) - RowGroups processed: 55.05K (55046) - RowGroups rejected: 0 (0) - RowGroups total: 55.05K (55046) - Rows processed: 262.14K (262144) - Rows rejected: 0 (0) - Rows total: 56.36M (56361302) - Splits processed: 16 (16) - Splits rejected: 0 (0) - Splits total: 16 (16) Filter 2 (2.00 MB): - Rows processed: 230.40K (230400) - Rows rejected: 0 (0) - Rows total: 56.36M (56361302) Filter 3 (2.00 MB): - Rows processed: 228.35K (228352) - Rows rejected: 0 (0) - Rows total: 56.36M (56361302) Instance 5f429df048b5534b:41bcce180000005e (host=foo.232.49:22000):(Total: 12m19s, non-child: 12m10s, % non-child: 98.72%) Hdfs split stats (:<# splits>/): 0:8/1.90 GB 4:13/2.78 GB 3:16/3.73 GB 2:8/1.77 GB 6:12/2.70 GB 5:13/3.16 GB 1:14/3.34 GB 7:14/3.23 GB Filter 1 arrival: 727ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.14 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.13 MB, 135.75 MB, 140.21 MB, 121.55 MB, 100.39 MB, 88.99 MB, 80.88 MB, 52.86 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.30 MB (148168697) - PerHostPeakMemUsage: 1.41 GB (1511109593) - RowsProduced: 31.88M (31883855) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m3s - TotalStorageWaitTime: 166.679ms - TotalThreadsInvoluntaryContextSwitches: 4.26K (4264) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 5s177ms - TotalThreadsUserTime: 23s842ms - TotalThreadsVoluntaryContextSwitches: 633.03K (633029) Fragment Instance Lifecycle Timings: - ExecTime: 12m19s - ExecTreeExecTime: 5s157ms - OpenTime: 72.146ms - ExecTreeOpenTime: 203.868us - PrepareTime: 37.316ms - ExecTreePrepareTime: 959.644us DataStreamSender (dst_id=22):(Total: 4s255ms, non-child: 4s255ms, % non-child: 100.00%) - BytesSent: 572.05 MB (599839486) - OverallThroughput: 134.43 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.88M (31883855) - SerializeBatchTime: 4s246ms - UncompressedRowBatchSize: 572.05 MB (599839486) CodeGen:(Total: 97.170ms, non-child: 97.170ms, % non-child: 100.00%) - CodegenTime: 1.584ms - CompileTime: 9.661ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 61.327ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.581ms HDFS_SCAN_NODE (id=2):(Total: 5s134ms, non-child: 5s134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:8/1.90 GB 4:13/2.78 GB 3:16/3.73 GB 2:8/1.77 GB 6:12/2.70 GB 5:13/3.16 GB 1:14/3.34 GB 7:14/3.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06784% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.27 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 127.51 MB, 184.73 MB, 201.91 MB - FooterProcessingTime: (Avg: 2.595ms ; Min: 570.548us ; Max: 15.203ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 208.63 MB (218767466) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.63 MB (218767466) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.63 MB (218767466) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 866.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877740) - PerReadThreadRawHdfsThroughput: 927.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.434ms - RowBatchQueuePutWaitTime: 59m33s - RowsRead: 31.88M (31883855) - RowsReturned: 31.88M (31883855) - RowsReturnedRate: 6.21 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.37K (2369) - ScannerThreadsTotalWallClockTime: 59m53s - MaterializeTupleTime(*): 2s494ms - ScannerThreadsSysTime: 4s685ms - ScannerThreadsUserTime: 12s715ms - ScannerThreadsVoluntaryContextSwitches: 615.88K (615879) - TotalRawHdfsReadTime(*): 225.060ms - TotalReadThroughput: 289.68 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 89 (89) - Files total: 98 (98) - RowGroups processed: 31.14K (31141) - RowGroups rejected: 0 (0) - RowGroups total: 31.14K (31141) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.88M (31883855) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 117.76K (117760) - Rows rejected: 0 (0) - Rows total: 31.88M (31883855) Filter 3 (2.00 MB): - Rows processed: 113.66K (113664) - Rows rejected: 0 (0) - Rows total: 31.88M (31883855) Instance 5f429df048b5534b:41bcce180000005c (host=foo.232.52:22000):(Total: 12m18s, non-child: 12m9s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 7:9/1.88 GB 5:12/2.73 GB 2:16/3.57 GB 0:13/3.05 GB 6:12/2.82 GB 3:15/3.64 GB 1:12/2.58 GB 4:10/2.27 GB Filter 1 arrival: 303ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.69 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 134.43 MB, 135.03 MB, 139.23 MB, 125.78 MB, 99.40 MB, 84.63 MB, 75.34 MB, 61.75 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.87 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.46 MB (147280869) - PerHostPeakMemUsage: 1.41 GB (1515314840) - RowsProduced: 34.45M (34448304) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m1s - TotalStorageWaitTime: 229.154ms - TotalThreadsInvoluntaryContextSwitches: 4.23K (4229) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 1s134ms - TotalThreadsUserTime: 27s396ms - TotalThreadsVoluntaryContextSwitches: 82.92K (82920) Fragment Instance Lifecycle Timings: - ExecTime: 12m18s - ExecTreeExecTime: 5s206ms - OpenTime: 60.739ms - ExecTreeOpenTime: 183.679us - PrepareTime: 33.375ms - ExecTreePrepareTime: 799.546us DataStreamSender (dst_id=22):(Total: 4s568ms, non-child: 4s568ms, % non-child: 100.00%) - BytesSent: 617.62 MB (647621607) - OverallThroughput: 135.18 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.45M (34448304) - SerializeBatchTime: 4s558ms - UncompressedRowBatchSize: 617.62 MB (647621607) CodeGen:(Total: 87.350ms, non-child: 87.350ms, % non-child: 100.00%) - CodegenTime: 1.426ms - CompileTime: 9.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.054ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.219ms HDFS_SCAN_NODE (id=2):(Total: 5s180ms, non-child: 5s180ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:9/1.88 GB 5:12/2.73 GB 2:16/3.57 GB 0:13/3.05 GB 6:12/2.82 GB 3:15/3.64 GB 1:12/2.58 GB 4:10/2.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0.06775% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.11 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 126.79 MB, 183.67 MB, 209.83 MB - FooterProcessingTime: (Avg: 1.421ms ; Min: 641.991us ; Max: 3.164ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 225.55 MB (236507783) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.55 MB (236507783) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.55 MB (236507783) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 964.875ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828676) - PerReadThreadRawHdfsThroughput: 687.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.648ms - RowBatchQueuePutWaitTime: 59m37s - RowsRead: 34.45M (34448304) - RowsReturned: 34.45M (34448304) - RowsReturnedRate: 6.65 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.21K (2215) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 2s729ms - ScannerThreadsSysTime: 593.908ms - ScannerThreadsUserTime: 15s402ms - ScannerThreadsVoluntaryContextSwitches: 65.51K (65510) - TotalRawHdfsReadTime(*): 328.081ms - TotalReadThroughput: 312.75 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 89 (89) - Files total: 99 (99) - RowGroups processed: 33.65K (33646) - RowGroups rejected: 0 (0) - RowGroups total: 33.65K (33646) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.45M (34448304) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 109.57K (109568) - Rows rejected: 0 (0) - Rows total: 34.45M (34448304) Filter 3 (2.00 MB): - Rows processed: 109.57K (109568) - Rows rejected: 0 (0) - Rows total: 34.45M (34448304) Instance 5f429df048b5534b:41bcce180000000a (host=foo.232.34:22000):(Total: 12m18s, non-child: 12m9s, % non-child: 98.72%) Hdfs split stats (:<# splits>/): 0:10/2.34 GB 6:16/3.85 GB 7:12/2.76 GB 2:12/2.62 GB 3:6/1.48 GB 4:14/3.01 GB 1:13/3.05 GB 5:15/3.58 GB Filter 1 arrival: 940ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 94.24 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 136.95 MB, 137.17 MB, 140.18 MB, 125.51 MB, 100.42 MB, 92.68 MB, 77.13 MB, 57.73 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.87 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.34 MB (148210495) - PerHostPeakMemUsage: 1.42 GB (1529787983) - RowsProduced: 31.85M (31849561) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m2s - TotalStorageWaitTime: 157.549ms - TotalThreadsInvoluntaryContextSwitches: 3.51K (3512) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 1s587ms - TotalThreadsUserTime: 23s645ms - TotalThreadsVoluntaryContextSwitches: 194.85K (194846) Fragment Instance Lifecycle Timings: - ExecTime: 12m18s - ExecTreeExecTime: 5s185ms - OpenTime: 60.932ms - ExecTreeOpenTime: 179.128us - PrepareTime: 38.080ms - ExecTreePrepareTime: 1.268ms DataStreamSender (dst_id=22):(Total: 4s168ms, non-child: 4s168ms, % non-child: 100.00%) - BytesSent: 568.28 MB (595881996) - OverallThroughput: 136.34 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.85M (31849561) - SerializeBatchTime: 4s157ms - UncompressedRowBatchSize: 568.28 MB (595881996) CodeGen:(Total: 87.966ms, non-child: 87.966ms, % non-child: 100.00%) - CodegenTime: 1.332ms - CompileTime: 9.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.258ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.644ms HDFS_SCAN_NODE (id=2):(Total: 5s164ms, non-child: 5s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.34 GB 6:16/3.85 GB 7:12/2.76 GB 2:12/2.62 GB 3:6/1.48 GB 4:14/3.01 GB 1:13/3.05 GB 5:15/3.58 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.14 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 119.48 MB, 180.04 MB, 202.75 MB - FooterProcessingTime: (Avg: 1.421ms ; Min: 792.774us ; Max: 2.795ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 207.98 MB (218082523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 207.98 MB (218082523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 207.98 MB (218082523) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 854.417ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877416) - PerReadThreadRawHdfsThroughput: 856.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.759ms - RowBatchQueuePutWaitTime: 59m41s - RowsRead: 31.85M (31849561) - RowsReturned: 31.85M (31849561) - RowsReturnedRate: 6.17 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.73K (1732) - ScannerThreadsTotalWallClockTime: 1h - MaterializeTupleTime(*): 2s446ms - ScannerThreadsSysTime: 1s112ms - ScannerThreadsUserTime: 12s711ms - ScannerThreadsVoluntaryContextSwitches: 177.55K (177548) - TotalRawHdfsReadTime(*): 242.912ms - TotalReadThroughput: 288.97 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 89 (89) - Files total: 98 (98) - RowGroups processed: 31.11K (31108) - RowGroups rejected: 0 (0) - RowGroups total: 31.11K (31108) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.85M (31849561) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 109.57K (109568) - Rows rejected: 0 (0) - Rows total: 31.85M (31849561) Filter 3 (2.00 MB): - Rows processed: 104.45K (104448) - Rows rejected: 0 (0) - Rows total: 31.85M (31849561) Instance 5f429df048b5534b:41bcce1800000069 (host=foo.232.17:22000):(Total: 12m16s, non-child: 12m6s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 5:10/2.39 GB 7:10/2.33 GB 2:11/2.57 GB 6:6/1.48 GB 3:10/2.31 GB 1:20/4.74 GB 0:17/4.05 GB 4:12/2.68 GB Filter 1 arrival: 862ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 80.57 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 116.86 MB, 117.25 MB, 120.22 MB, 99.37 MB, 71.15 MB, 81.59 MB, 87.70 MB, 83.04 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4 - AverageThreadTokens: 5.82 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 121.39 MB (127290009) - PerHostPeakMemUsage: 1.41 GB (1512670434) - RowsProduced: 38.66M (38662758) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m58s - TotalStorageWaitTime: 216.903ms - TotalThreadsInvoluntaryContextSwitches: 3.45K (3451) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 1s815ms - TotalThreadsUserTime: 19s247ms - TotalThreadsVoluntaryContextSwitches: 151.84K (151842) Fragment Instance Lifecycle Timings: - ExecTime: 12m16s - ExecTreeExecTime: 5s223ms - OpenTime: 72.266ms - ExecTreeOpenTime: 193.522us - PrepareTime: 30.794ms - ExecTreePrepareTime: 780.626us DataStreamSender (dst_id=22):(Total: 4s952ms, non-child: 4s952ms, % non-child: 100.00%) - BytesSent: 695.74 MB (729540350) - OverallThroughput: 140.49 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.66M (38662758) - SerializeBatchTime: 4s942ms - UncompressedRowBatchSize: 695.74 MB (729540350) CodeGen:(Total: 97.069ms, non-child: 97.069ms, % non-child: 100.00%) - CodegenTime: 1.698ms - CompileTime: 9.786ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 61.257ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.558ms HDFS_SCAN_NODE (id=2):(Total: 5s194ms, non-child: 5s194ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:10/2.39 GB 7:10/2.33 GB 2:11/2.57 GB 6:6/1.48 GB 3:10/2.31 GB 1:20/4.74 GB 0:17/4.05 GB 4:12/2.68 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:36 BytesRead(16s000ms): 63.47 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 92.33 MB, 116.39 MB, 157.42 MB, 199.30 MB - FooterProcessingTime: (Avg: 1.692ms ; Min: 773.920us ; Max: 3.397ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.82 - BytesRead: 253.12 MB (265417000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.12 MB (265417000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.12 MB (265417000) - CachedFileHandlesHitCount: 67 (67) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s095ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 113.39 MB (118900171) - PerReadThreadRawHdfsThroughput: 811.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.193ms - RowBatchQueuePutWaitTime: 58m57s - RowsRead: 38.66M (38662758) - RowsReturned: 38.66M (38662758) - RowsReturnedRate: 7.44 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1510) - ScannerThreadsTotalWallClockTime: 59m7s - MaterializeTupleTime(*): 3s179ms - ScannerThreadsSysTime: 1s278ms - ScannerThreadsUserTime: 6s477ms - ScannerThreadsVoluntaryContextSwitches: 134.80K (134800) - TotalRawHdfsReadTime(*): 312.041ms - TotalReadThroughput: 352.65 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 84 (84) - Files total: 96 (96) - RowGroups processed: 37.76K (37762) - RowGroups rejected: 0 (0) - RowGroups total: 37.76K (37762) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 38.66M (38662758) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 151.55K (151552) - Rows rejected: 0 (0) - Rows total: 38.66M (38662758) Filter 3 (2.00 MB): - Rows processed: 151.55K (151552) - Rows rejected: 0 (0) - Rows total: 38.66M (38662758) Instance 5f429df048b5534b:41bcce180000004e (host=foo.232.22:22000):(Total: 12m15s, non-child: 12m5s, % non-child: 98.56%) Hdfs split stats (:<# splits>/): 3:16/3.76 GB 1:8/1.69 GB 0:10/2.19 GB 2:6/1.38 GB 6:15/3.46 GB 7:14/3.25 GB 4:14/3.25 GB 5:16/3.76 GB Filter 1 arrival: 1s291ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.62 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.37 MB, 134.74 MB, 138.13 MB, 105.34 MB, 80.15 MB, 86.58 MB, 75.15 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.39 MB (146165236) - PerHostPeakMemUsage: 1.42 GB (1527033436) - RowsProduced: 42.96M (42963212) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m56s - TotalStorageWaitTime: 236.567ms - TotalThreadsInvoluntaryContextSwitches: 4.07K (4069) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 1s613ms - TotalThreadsUserTime: 24s421ms - TotalThreadsVoluntaryContextSwitches: 110.83K (110826) Fragment Instance Lifecycle Timings: - ExecTime: 12m15s - ExecTreeExecTime: 5s228ms - OpenTime: 65.510ms - ExecTreeOpenTime: 193.202us - PrepareTime: 33.964ms - ExecTreePrepareTime: 1.065ms DataStreamSender (dst_id=22):(Total: 5s309ms, non-child: 5s309ms, % non-child: 100.00%) - BytesSent: 768.71 MB (806051691) - OverallThroughput: 144.79 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.96M (42963212) - SerializeBatchTime: 5s298ms - UncompressedRowBatchSize: 768.71 MB (806051691) CodeGen:(Total: 93.127ms, non-child: 93.127ms, % non-child: 100.00%) - CodegenTime: 1.380ms - CompileTime: 12.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.300ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.095ms HDFS_SCAN_NODE (id=2):(Total: 5s197ms, non-child: 5s197ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:16/3.76 GB 1:8/1.69 GB 0:10/2.19 GB 2:6/1.38 GB 6:15/3.46 GB 7:14/3.25 GB 4:14/3.25 GB 5:16/3.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06807% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.84 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 114.72 MB, 184.98 MB, 219.37 MB - FooterProcessingTime: (Avg: 1.845ms ; Min: 614.413us ; Max: 3.981ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.85 - BytesRead: 280.68 MB (294309824) - BytesReadDataNodeCache: 0 - BytesReadLocal: 280.68 MB (294309824) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 280.68 MB (294309824) - CachedFileHandlesHitCount: 71 (71) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780186) - PerReadThreadRawHdfsThroughput: 835.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.913ms - RowBatchQueuePutWaitTime: 58m52s - RowsRead: 42.96M (42963212) - RowsReturned: 42.96M (42963212) - RowsReturnedRate: 8.27 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.05K (2047) - ScannerThreadsTotalWallClockTime: 59m28s - MaterializeTupleTime(*): 3s491ms - ScannerThreadsSysTime: 965.851ms - ScannerThreadsUserTime: 10s906ms - ScannerThreadsVoluntaryContextSwitches: 93.76K (93764) - TotalRawHdfsReadTime(*): 335.880ms - TotalReadThroughput: 391.30 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 87 (87) - Files total: 99 (99) - RowGroups processed: 41.96K (41961) - RowGroups rejected: 0 (0) - RowGroups total: 41.96K (41961) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 42.96M (42963212) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 157.70K (157696) - Rows rejected: 0 (0) - Rows total: 42.96M (42963212) Filter 3 (2.00 MB): - Rows processed: 156.67K (156672) - Rows rejected: 0 (0) - Rows total: 42.96M (42963212) Instance 5f429df048b5534b:41bcce1800000060 (host=foo.232.21:22000):(Total: 12m15s, non-child: 12m5s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 7:7/1.61 GB 0:13/3.06 GB 2:7/1.73 GB 3:11/2.46 GB 5:13/2.99 GB 1:18/4.30 GB 6:14/3.31 GB 4:13/3.02 GB Filter 1 arrival: 983ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.06 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.31 MB, 135.56 MB, 138.09 MB, 112.33 MB, 88.97 MB, 79.11 MB, 71.36 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.38 MB (146146574) - PerHostPeakMemUsage: 1.39 GB (1494598744) - RowsProduced: 37.13M (37129983) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m57s - TotalStorageWaitTime: 218.178ms - TotalThreadsInvoluntaryContextSwitches: 3.70K (3700) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 796.876ms - TotalThreadsUserTime: 22s260ms - TotalThreadsVoluntaryContextSwitches: 53.41K (53412) Fragment Instance Lifecycle Timings: - ExecTime: 12m15s - ExecTreeExecTime: 5s204ms - OpenTime: 59.944ms - ExecTreeOpenTime: 170.062us - PrepareTime: 40.870ms - ExecTreePrepareTime: 973.033us DataStreamSender (dst_id=22):(Total: 4s687ms, non-child: 4s687ms, % non-child: 100.00%) - BytesSent: 656.40 MB (688285955) - OverallThroughput: 140.05 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.13M (37129983) - SerializeBatchTime: 4s675ms - UncompressedRowBatchSize: 656.40 MB (688285955) CodeGen:(Total: 94.776ms, non-child: 94.776ms, % non-child: 100.00%) - CodegenTime: 1.868ms - CompileTime: 9.235ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.713ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 34.927ms HDFS_SCAN_NODE (id=2):(Total: 5s175ms, non-child: 5s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:7/1.61 GB 0:13/3.06 GB 2:7/1.73 GB 3:11/2.46 GB 5:13/2.99 GB 1:18/4.30 GB 6:14/3.31 GB 4:13/3.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.61 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 148.70 MB, 180.73 MB - FooterProcessingTime: (Avg: 2.549ms ; Min: 570.010us ; Max: 11.089ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 242.64 MB (254431633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.64 MB (254431633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.64 MB (254431633) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s036ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780769) - PerReadThreadRawHdfsThroughput: 844.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.460ms - RowBatchQueuePutWaitTime: 59m5s - RowsRead: 37.13M (37129983) - RowsReturned: 37.13M (37129983) - RowsReturnedRate: 7.17 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1762) - ScannerThreadsTotalWallClockTime: 59m18s - MaterializeTupleTime(*): 2s961ms - ScannerThreadsSysTime: 221.963ms - ScannerThreadsUserTime: 10s005ms - ScannerThreadsVoluntaryContextSwitches: 36.44K (36435) - TotalRawHdfsReadTime(*): 287.295ms - TotalReadThroughput: 338.05 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 36.27K (36266) - RowGroups rejected: 0 (0) - RowGroups total: 36.27K (36266) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.13M (37129983) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 37.13M (37129983) Filter 3 (2.00 MB): - Rows processed: 135.17K (135168) - Rows rejected: 0 (0) - Rows total: 37.13M (37129983) Instance 5f429df048b5534b:41bcce180000005f (host=foo.232.12:22000):(Total: 12m13s, non-child: 12m4s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 1:11/2.71 GB 4:15/3.56 GB 5:10/2.40 GB 7:13/2.89 GB 2:16/3.75 GB 0:10/2.20 GB 3:9/2.02 GB 6:12/2.89 GB Filter 1 arrival: 1s417ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 74.78 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 108.36 MB, 109.26 MB, 113.26 MB, 93.46 MB, 61.50 MB, 85.05 MB, 71.49 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.81 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 114.42 MB (119978622) - PerHostPeakMemUsage: 1.39 GB (1491728620) - RowsProduced: 35.36M (35364658) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m56s - TotalStorageWaitTime: 194.922ms - TotalThreadsInvoluntaryContextSwitches: 3.73K (3735) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 777.879ms - TotalThreadsUserTime: 21s437ms - TotalThreadsVoluntaryContextSwitches: 53.51K (53507) Fragment Instance Lifecycle Timings: - ExecTime: 12m13s - ExecTreeExecTime: 5s198ms - OpenTime: 63.993ms - ExecTreeOpenTime: 248.097us - PrepareTime: 30.120ms - ExecTreePrepareTime: 736.277us DataStreamSender (dst_id=22):(Total: 4s531ms, non-child: 4s531ms, % non-child: 100.00%) - BytesSent: 635.49 MB (666364696) - OverallThroughput: 140.24 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.36M (35364658) - SerializeBatchTime: 4s521ms - UncompressedRowBatchSize: 635.49 MB (666364696) CodeGen:(Total: 88.534ms, non-child: 88.534ms, % non-child: 100.00%) - CodegenTime: 1.683ms - CompileTime: 12.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.822ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.142ms HDFS_SCAN_NODE (id=2):(Total: 5s168ms, non-child: 5s168ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.71 GB 4:15/3.56 GB 5:10/2.40 GB 7:13/2.89 GB 2:16/3.75 GB 0:10/2.20 GB 3:9/2.02 GB 6:12/2.89 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s943ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0.06821% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 65.20 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 94.83 MB, 163.72 MB, 194.83 MB - FooterProcessingTime: (Avg: 1.435ms ; Min: 447.628us ; Max: 2.988ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.81 - BytesRead: 232.01 MB (243280831) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.01 MB (243280831) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.01 MB (243280831) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s017ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 106.45 MB (111625998) - PerReadThreadRawHdfsThroughput: 837.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.156ms - RowBatchQueuePutWaitTime: 58m18s - RowsRead: 35.36M (35364658) - RowsReturned: 35.36M (35364658) - RowsReturnedRate: 6.84 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.95K (1954) - ScannerThreadsTotalWallClockTime: 58m50s - MaterializeTupleTime(*): 2s915ms - ScannerThreadsSysTime: 238.961ms - ScannerThreadsUserTime: 9s753ms - ScannerThreadsVoluntaryContextSwitches: 36.73K (36726) - TotalRawHdfsReadTime(*): 276.885ms - TotalReadThroughput: 324.12 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 34.54K (34542) - RowGroups rejected: 0 (0) - RowGroups total: 34.54K (34542) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 35.36M (35364658) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 35.36M (35364658) Filter 3 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 35.36M (35364658) Instance 5f429df048b5534b:41bcce1800000076 (host=foo.232.39:22000):(Total: 12m13s, non-child: 12m3s, % non-child: 98.64%) Hdfs split stats (:<# splits>/): 2:13/3.15 GB 4:10/1.83 GB 1:12/2.85 GB 5:15/3.54 GB 6:11/2.51 GB 0:11/2.52 GB 3:15/3.56 GB 7:9/2.22 GB Filter 1 arrival: 778ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 72.62 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.31 MB, 105.84 MB, 107.76 MB, 75.67 MB, 73.61 MB, 81.34 MB, 69.59 MB ThreadUsage(16s000ms): 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4 - AverageThreadTokens: 4.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 109.72 MB (115051748) - PerHostPeakMemUsage: 1.33 GB (1428372172) - RowsProduced: 34.42M (34419794) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m55s - TotalStorageWaitTime: 202.012ms - TotalThreadsInvoluntaryContextSwitches: 3.38K (3380) - TotalThreadsTotalWallClockTime: 59m40s - TotalThreadsSysTime: 877.865ms - TotalThreadsUserTime: 20s273ms - TotalThreadsVoluntaryContextSwitches: 54.10K (54098) Fragment Instance Lifecycle Timings: - ExecTime: 12m13s - ExecTreeExecTime: 5s204ms - OpenTime: 66.728ms - ExecTreeOpenTime: 176.932us - PrepareTime: 32.843ms - ExecTreePrepareTime: 932.768us DataStreamSender (dst_id=22):(Total: 4s724ms, non-child: 4s724ms, % non-child: 100.00%) - BytesSent: 618.18 MB (648209293) - OverallThroughput: 130.84 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.42M (34419794) - SerializeBatchTime: 4s713ms - UncompressedRowBatchSize: 618.18 MB (648209293) CodeGen:(Total: 94.490ms, non-child: 94.490ms, % non-child: 100.00%) - CodegenTime: 1.293ms - CompileTime: 11.339ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.180ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.489ms HDFS_SCAN_NODE (id=2):(Total: 5s175ms, non-child: 5s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:13/3.15 GB 4:10/1.83 GB 1:12/2.85 GB 5:15/3.54 GB 6:11/2.51 GB 0:11/2.52 GB 3:15/3.56 GB 7:9/2.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 60.67 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 88.24 MB, 123.38 MB, 160.02 MB, 178.37 MB - FooterProcessingTime: (Avg: 1.636ms ; Min: 420.168us ; Max: 3.801ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 225.29 MB (236230171) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.29 MB (236230171) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.29 MB (236230171) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 998.601ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 101.70 MB (106639958) - PerReadThreadRawHdfsThroughput: 662.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.884ms - RowBatchQueuePutWaitTime: 47m18s - RowsRead: 34.42M (34419794) - RowsReturned: 34.42M (34419794) - RowsReturnedRate: 6.65 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1494) - ScannerThreadsTotalWallClockTime: 47m26s - MaterializeTupleTime(*): 2s891ms - ScannerThreadsSysTime: 302.952ms - ScannerThreadsUserTime: 8s115ms - ScannerThreadsVoluntaryContextSwitches: 37.31K (37307) - TotalRawHdfsReadTime(*): 339.965ms - TotalReadThroughput: 315.15 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 33.62K (33617) - RowGroups rejected: 0 (0) - RowGroups total: 33.62K (33617) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.42M (34419794) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 141.31K (141312) - Rows rejected: 0 (0) - Rows total: 34.42M (34419794) Filter 3 (2.00 MB): - Rows processed: 135.17K (135168) - Rows rejected: 0 (0) - Rows total: 34.42M (34419794) Instance 5f429df048b5534b:41bcce1800000035 (host=foo.232.32:22000):(Total: 12m13s, non-child: 12m3s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 0:10/2.18 GB 3:13/2.82 GB 1:10/2.25 GB 4:15/3.41 GB 7:15/3.50 GB 5:12/2.29 GB 2:11/2.57 GB 6:16/3.65 GB Filter 1 arrival: 959ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 83.95 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 121.77 MB, 122.33 MB, 126.41 MB, 102.79 MB, 74.63 MB, 81.77 MB, 67.91 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.82 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 127.45 MB (133643057) - PerHostPeakMemUsage: 1.42 GB (1522909179) - RowsProduced: 32.57M (32569562) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m56s - TotalStorageWaitTime: 162.823ms - TotalThreadsInvoluntaryContextSwitches: 4.17K (4173) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 890.863ms - TotalThreadsUserTime: 28s544ms - TotalThreadsVoluntaryContextSwitches: 63.57K (63572) Fragment Instance Lifecycle Timings: - ExecTime: 12m13s - ExecTreeExecTime: 5s165ms - OpenTime: 72.454ms - ExecTreeOpenTime: 177.803us - PrepareTime: 45.320ms - ExecTreePrepareTime: 1.015ms DataStreamSender (dst_id=22):(Total: 4s332ms, non-child: 4s332ms, % non-child: 100.00%) - BytesSent: 583.94 MB (612304942) - OverallThroughput: 134.78 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.57M (32569562) - SerializeBatchTime: 4s323ms - UncompressedRowBatchSize: 583.94 MB (612304942) CodeGen:(Total: 106.398ms, non-child: 106.398ms, % non-child: 100.00%) - CodegenTime: 1.353ms - CompileTime: 13.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 57.556ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 34.578ms HDFS_SCAN_NODE (id=2):(Total: 5s137ms, non-child: 5s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.18 GB 3:13/2.82 GB 1:10/2.25 GB 4:15/3.41 GB 7:15/3.50 GB 5:12/2.29 GB 2:11/2.57 GB 6:16/3.65 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:92 PARQUET/SNAPPY:30 BytesRead(16s000ms): 64.72 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 94.13 MB, 109.80 MB, 159.88 MB, 175.59 MB - FooterProcessingTime: (Avg: 968.118us ; Min: 284.359us ; Max: 2.496ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.82 - BytesRead: 213.72 MB (224103646) - BytesReadDataNodeCache: 0 - BytesReadLocal: 213.72 MB (224103646) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 213.72 MB (224103646) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 919.423ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.52 MB (125328369) - PerReadThreadRawHdfsThroughput: 897.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.430ms - RowBatchQueuePutWaitTime: 58m17s - RowsRead: 32.57M (32569562) - RowsReturned: 32.57M (32569562) - RowsReturnedRate: 6.34 M/sec - ScanRangesComplete: 102 (102) - ScannerThreadsInvoluntaryContextSwitches: 2.32K (2316) - ScannerThreadsTotalWallClockTime: 58m56s - MaterializeTupleTime(*): 2s605ms - ScannerThreadsSysTime: 347.945ms - ScannerThreadsUserTime: 17s047ms - ScannerThreadsVoluntaryContextSwitches: 46.58K (46583) - TotalRawHdfsReadTime(*): 238.016ms - TotalReadThroughput: 298.77 KB/sec Filter 1 (8.00 KB): - Files processed: 102 (102) - Files rejected: 92 (92) - Files total: 102 (102) - RowGroups processed: 31.81K (31812) - RowGroups rejected: 0 (0) - RowGroups total: 31.81K (31812) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 32.57M (32569562) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 138.24K (138240) - Rows rejected: 0 (0) - Rows total: 32.57M (32569562) Filter 3 (2.00 MB): - Rows processed: 138.24K (138240) - Rows rejected: 0 (0) - Rows total: 32.57M (32569562) Instance 5f429df048b5534b:41bcce180000003f (host=foo.221.41:22000):(Total: 12m10s, non-child: 12m, % non-child: 98.54%) Hdfs split stats (:<# splits>/): 1:12/2.56 GB 0:13/3.07 GB 6:11/2.58 GB 5:10/2.28 GB 3:17/3.99 GB 4:14/3.38 GB 2:13/2.87 GB 7:8/1.97 GB Filter 1 arrival: 1s552ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.09 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.62 MB, 130.99 MB, 135.24 MB, 112.79 MB, 85.43 MB, 79.74 MB, 74.31 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.87 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 136.41 MB (143034283) - PerHostPeakMemUsage: 1.43 GB (1531852975) - RowsProduced: 42.22M (42215468) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m50s - TotalStorageWaitTime: 263.480ms - TotalThreadsInvoluntaryContextSwitches: 3.84K (3842) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 1s084ms - TotalThreadsUserTime: 23s100ms - TotalThreadsVoluntaryContextSwitches: 122.20K (122201) Fragment Instance Lifecycle Timings: - ExecTime: 12m10s - ExecTreeExecTime: 5s241ms - OpenTime: 64.141ms - ExecTreeOpenTime: 191.512us - PrepareTime: 25.381ms - ExecTreePrepareTime: 924.144us DataStreamSender (dst_id=22):(Total: 5s400ms, non-child: 5s400ms, % non-child: 100.00%) - BytesSent: 753.36 MB (789956061) - OverallThroughput: 139.49 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.22M (42215468) - SerializeBatchTime: 5s387ms - UncompressedRowBatchSize: 753.36 MB (789956061) CodeGen:(Total: 83.666ms, non-child: 83.666ms, % non-child: 100.00%) - CodegenTime: 1.301ms - CompileTime: 9.945ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.151ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 20.001ms HDFS_SCAN_NODE (id=2):(Total: 5s208ms, non-child: 5s208ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:12/2.56 GB 0:13/3.07 GB 6:11/2.58 GB 5:10/2.28 GB 3:17/3.99 GB 4:14/3.38 GB 2:13/2.87 GB 7:8/1.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:39 BytesRead(16s000ms): 77.27 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 112.40 MB, 171.00 MB, 223.01 MB - FooterProcessingTime: (Avg: 1.324ms ; Min: 678.804us ; Max: 3.120ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 277.29 MB (290759995) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.29 MB (290759995) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.29 MB (290759995) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s144ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.40 MB (134634707) - PerReadThreadRawHdfsThroughput: 775.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.373ms - RowBatchQueuePutWaitTime: 58m44s - RowsRead: 42.22M (42215468) - RowsReturned: 42.22M (42215468) - RowsReturnedRate: 8.11 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1604) - ScannerThreadsTotalWallClockTime: 59m16s - MaterializeTupleTime(*): 3s282ms - ScannerThreadsSysTime: 468.926ms - ScannerThreadsUserTime: 8s610ms - ScannerThreadsVoluntaryContextSwitches: 104.48K (104483) - TotalRawHdfsReadTime(*): 357.480ms - TotalReadThroughput: 388.70 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 85 (85) - Files total: 98 (98) - RowGroups processed: 41.23K (41233) - RowGroups rejected: 0 (0) - RowGroups total: 41.23K (41233) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 42.22M (42215468) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 42.22M (42215468) Filter 3 (2.00 MB): - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 42.22M (42215468) Instance 5f429df048b5534b:41bcce1800000020 (host=foo.232.30:22000):(Total: 12m10s, non-child: 12m, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 4:12/2.68 GB 0:13/3.13 GB 3:16/3.47 GB 5:12/2.83 GB 7:13/3.09 GB 6:12/2.81 GB 2:7/1.64 GB 1:13/2.94 GB Filter 1 arrival: 1s001ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.71 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 135.99 MB, 136.38 MB, 139.18 MB, 118.79 MB, 90.00 MB, 107.38 MB, 90.85 MB ThreadUsage(16s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.47 MB (147297369) - PerHostPeakMemUsage: 1.40 GB (1502874196) - RowsProduced: 34.39M (34394575) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m53s - TotalStorageWaitTime: 216.152ms - TotalThreadsInvoluntaryContextSwitches: 4.30K (4296) - TotalThreadsTotalWallClockTime: 1h12m - TotalThreadsSysTime: 5s033ms - TotalThreadsUserTime: 22s152ms - TotalThreadsVoluntaryContextSwitches: 443.69K (443685) Fragment Instance Lifecycle Timings: - ExecTime: 12m10s - ExecTreeExecTime: 5s185ms - OpenTime: 62.039ms - ExecTreeOpenTime: 170.871us - PrepareTime: 32.723ms - ExecTreePrepareTime: 834.385us DataStreamSender (dst_id=22):(Total: 4s348ms, non-child: 4s348ms, % non-child: 100.00%) - BytesSent: 614.86 MB (644731955) - OverallThroughput: 141.41 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.39M (34394575) - SerializeBatchTime: 4s339ms - UncompressedRowBatchSize: 614.86 MB (644731955) CodeGen:(Total: 87.949ms, non-child: 87.949ms, % non-child: 100.00%) - CodegenTime: 1.496ms - CompileTime: 9.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.673ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.483ms HDFS_SCAN_NODE (id=2):(Total: 5s159ms, non-child: 5s159ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:12/2.68 GB 0:13/3.13 GB 3:16/3.47 GB 5:12/2.83 GB 7:13/3.09 GB 6:12/2.81 GB 2:7/1.64 GB 1:13/2.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.52 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 112.76 MB, 192.73 MB, 208.42 MB - FooterProcessingTime: (Avg: 4.533ms ; Min: 622.501us ; Max: 17.117ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 225.36 MB (236303915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.36 MB (236303915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.36 MB (236303915) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s012ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828491) - PerReadThreadRawHdfsThroughput: 773.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.929ms - RowBatchQueuePutWaitTime: 59m11s - RowsRead: 34.39M (34394575) - RowsReturned: 34.39M (34394575) - RowsReturnedRate: 6.67 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.55K (2552) - ScannerThreadsTotalWallClockTime: 59m52s - MaterializeTupleTime(*): 2s864ms - ScannerThreadsSysTime: 4s511ms - ScannerThreadsUserTime: 11s000ms - ScannerThreadsVoluntaryContextSwitches: 426.99K (426992) - TotalRawHdfsReadTime(*): 291.243ms - TotalReadThroughput: 316.77 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 88 (88) - Files total: 98 (98) - RowGroups processed: 33.59K (33593) - RowGroups rejected: 0 (0) - RowGroups total: 33.59K (33593) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.39M (34394575) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 128.00K (128000) - Rows rejected: 0 (0) - Rows total: 34.39M (34394575) Filter 3 (2.00 MB): - Rows processed: 128.00K (128000) - Rows rejected: 0 (0) - Rows total: 34.39M (34394575) Instance 5f429df048b5534b:41bcce1800000004 (host=foo.221.34:22000):(Total: 12m10s, non-child: 11m59s, % non-child: 98.57%) Hdfs split stats (:<# splits>/): 4:10/2.33 GB 6:9/2.15 GB 7:14/3.41 GB 2:9/2.22 GB 3:15/3.49 GB 0:13/3.08 GB 5:12/2.82 GB 1:13/3.08 GB Filter 1 arrival: 1s590ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 75.30 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.14 MB, 109.52 MB, 114.22 MB, 66.85 MB, 80.08 MB, 67.16 MB, 72.13 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4 - AverageThreadTokens: 5.76 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 115.31 MB (120908367) - PerHostPeakMemUsage: 1.40 GB (1500830944) - RowsProduced: 42.49M (42485047) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m50s - TotalStorageWaitTime: 228.714ms - TotalThreadsInvoluntaryContextSwitches: 4.45K (4447) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 937.854ms - TotalThreadsUserTime: 27s688ms - TotalThreadsVoluntaryContextSwitches: 85.68K (85684) Fragment Instance Lifecycle Timings: - ExecTime: 12m10s - ExecTreeExecTime: 5s223ms - OpenTime: 60.498ms - ExecTreeOpenTime: 195.810us - PrepareTime: 31.498ms - ExecTreePrepareTime: 1.501ms DataStreamSender (dst_id=22):(Total: 5s196ms, non-child: 5s196ms, % non-child: 100.00%) - BytesSent: 761.11 MB (798082082) - OverallThroughput: 146.46 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.49M (42485047) - SerializeBatchTime: 5s185ms - UncompressedRowBatchSize: 761.11 MB (798082082) CodeGen:(Total: 82.679ms, non-child: 82.679ms, % non-child: 100.00%) - CodegenTime: 1.334ms - CompileTime: 9.524ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.960ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 22.745ms HDFS_SCAN_NODE (id=2):(Total: 5s195ms, non-child: 5s195ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:10/2.33 GB 6:9/2.15 GB 7:14/3.41 GB 2:9/2.22 GB 3:15/3.49 GB 0:13/3.08 GB 5:12/2.82 GB 1:13/3.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:39 BytesRead(16s000ms): 64.25 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 93.45 MB, 151.03 MB, 167.48 MB, 236.91 MB - FooterProcessingTime: (Avg: 1.368ms ; Min: 699.099us ; Max: 2.724ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.77 - BytesRead: 277.91 MB (291409286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.91 MB (291409286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.91 MB (291409286) - CachedFileHandlesHitCount: 73 (73) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s123ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 107.39 MB (112608937) - PerReadThreadRawHdfsThroughput: 855.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.760ms - RowBatchQueuePutWaitTime: 57m42s - RowsRead: 42.49M (42485047) - RowsReturned: 42.49M (42485047) - RowsReturnedRate: 8.18 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2288) - ScannerThreadsTotalWallClockTime: 57m58s - MaterializeTupleTime(*): 3s213ms - ScannerThreadsSysTime: 345.944ms - ScannerThreadsUserTime: 13s747ms - ScannerThreadsVoluntaryContextSwitches: 67.61K (67605) - TotalRawHdfsReadTime(*): 324.808ms - TotalReadThroughput: 390.37 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 82 (82) - Files total: 95 (95) - RowGroups processed: 41.49K (41494) - RowGroups rejected: 0 (0) - RowGroups total: 41.49K (41494) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 42.49M (42485047) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 187.39K (187392) - Rows rejected: 0 (0) - Rows total: 42.49M (42485047) Filter 3 (2.00 MB): - Rows processed: 187.39K (187392) - Rows rejected: 0 (0) - Rows total: 42.49M (42485047) Instance 5f429df048b5534b:41bcce1800000070 (host=foo.221.18:22000):(Total: 12m10s, non-child: 11m59s, % non-child: 98.54%) Hdfs split stats (:<# splits>/): 5:7/1.61 GB 6:10/2.32 GB 7:15/3.56 GB 0:17/3.74 GB 4:13/2.95 GB 1:10/2.47 GB 2:7/1.57 GB 3:17/4.05 GB Filter 1 arrival: 1s764ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 95.72 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 138.99 MB, 139.15 MB, 142.31 MB, 109.09 MB, 86.55 MB, 76.10 MB, 77.31 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 143.33 MB (150291257) - PerHostPeakMemUsage: 1.48 GB (1585855039) - RowsProduced: 42.87M (42870032) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m50s - TotalStorageWaitTime: 290.369ms - TotalThreadsInvoluntaryContextSwitches: 3.73K (3735) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 1s049ms - TotalThreadsUserTime: 21s687ms - TotalThreadsVoluntaryContextSwitches: 90.90K (90899) Fragment Instance Lifecycle Timings: - ExecTime: 12m10s - ExecTreeExecTime: 5s243ms - OpenTime: 72.529ms - ExecTreeOpenTime: 265.463us - PrepareTime: 33.355ms - ExecTreePrepareTime: 830.875us DataStreamSender (dst_id=22):(Total: 5s321ms, non-child: 5s321ms, % non-child: 100.00%) - BytesSent: 767.20 MB (804465914) - OverallThroughput: 144.17 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.87M (42870032) - SerializeBatchTime: 5s310ms - UncompressedRowBatchSize: 767.20 MB (804465914) CodeGen:(Total: 99.696ms, non-child: 99.696ms, % non-child: 100.00%) - CodegenTime: 1.550ms - CompileTime: 11.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 59.944ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.812ms HDFS_SCAN_NODE (id=2):(Total: 5s208ms, non-child: 5s208ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:7/1.61 GB 6:10/2.32 GB 7:15/3.56 GB 0:17/3.74 GB 4:13/2.95 GB 1:10/2.47 GB 2:7/1.57 GB 3:17/4.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06854% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:36 BytesRead(16s000ms): 78.03 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 113.50 MB, 131.43 MB, 185.23 MB, 231.82 MB - FooterProcessingTime: (Avg: 1.338ms ; Min: 623.091us ; Max: 2.766ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 280.93 MB (294579965) - BytesReadDataNodeCache: 0 - BytesReadLocal: 280.93 MB (294579965) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 280.93 MB (294579965) - CachedFileHandlesHitCount: 71 (71) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s165ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 135.40 MB (141974574) - PerReadThreadRawHdfsThroughput: 693.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.548ms - RowBatchQueuePutWaitTime: 58m35s - RowsRead: 42.87M (42870032) - RowsReturned: 42.87M (42870032) - RowsReturnedRate: 8.23 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1547) - ScannerThreadsTotalWallClockTime: 59m6s - MaterializeTupleTime(*): 3s306ms - ScannerThreadsSysTime: 389.938ms - ScannerThreadsUserTime: 7s908ms - ScannerThreadsVoluntaryContextSwitches: 73.12K (73116) - TotalRawHdfsReadTime(*): 405.036ms - TotalReadThroughput: 394.35 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 84 (84) - Files total: 96 (96) - RowGroups processed: 41.87K (41872) - RowGroups rejected: 0 (0) - RowGroups total: 41.87K (41872) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 42.87M (42870032) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 175.10K (175104) - Rows rejected: 0 (0) - Rows total: 42.87M (42870032) Filter 3 (2.00 MB): - Rows processed: 159.74K (159744) - Rows rejected: 0 (0) - Rows total: 42.87M (42870032) Instance 5f429df048b5534b:41bcce180000000c (host=foo.232.29:22000):(Total: 12m9s, non-child: 11m59s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 7:7/1.51 GB 2:14/3.23 GB 5:7/1.59 GB 6:10/2.40 GB 1:19/4.45 GB 0:14/3.37 GB 4:12/2.91 GB 3:10/2.33 GB Filter 1 arrival: 969ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 94.32 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.02 MB, 137.34 MB, 140.21 MB, 104.89 MB, 99.39 MB, 105.72 MB, 89.58 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.27 MB (148129799) - PerHostPeakMemUsage: 1.40 GB (1507296406) - RowsProduced: 36.62M (36619178) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m51s - TotalStorageWaitTime: 217.023ms - TotalThreadsInvoluntaryContextSwitches: 5.13K (5129) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 5s467ms - TotalThreadsUserTime: 28s886ms - TotalThreadsVoluntaryContextSwitches: 567.87K (567873) Fragment Instance Lifecycle Timings: - ExecTime: 12m9s - ExecTreeExecTime: 5s227ms - OpenTime: 63.377ms - ExecTreeOpenTime: 186.650us - PrepareTime: 38.242ms - ExecTreePrepareTime: 1.093ms DataStreamSender (dst_id=22):(Total: 4s545ms, non-child: 4s545ms, % non-child: 100.00%) - BytesSent: 656.80 MB (688703902) - OverallThroughput: 144.50 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.62M (36619178) - SerializeBatchTime: 4s535ms - UncompressedRowBatchSize: 656.80 MB (688703902) CodeGen:(Total: 91.181ms, non-child: 91.181ms, % non-child: 100.00%) - CodegenTime: 1.610ms - CompileTime: 9.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.025ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.241ms HDFS_SCAN_NODE (id=2):(Total: 5s198ms, non-child: 5s198ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:7/1.51 GB 2:14/3.23 GB 5:7/1.59 GB 6:10/2.40 GB 1:19/4.45 GB 0:14/3.37 GB 4:12/2.91 GB 3:10/2.33 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.18 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 119.54 MB, 200.25 MB, 215.20 MB - FooterProcessingTime: (Avg: 1.521ms ; Min: 815.756us ; Max: 2.947ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.92 - BytesRead: 239.15 MB (250768265) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.15 MB (250768265) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.15 MB (250768265) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s033ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877263) - PerReadThreadRawHdfsThroughput: 762.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.322ms - RowBatchQueuePutWaitTime: 59m19s - RowsRead: 36.62M (36619178) - RowsReturned: 36.62M (36619178) - RowsReturnedRate: 7.04 M/sec - ScanRangesComplete: 93 (93) - ScannerThreadsInvoluntaryContextSwitches: 3.36K (3361) - ScannerThreadsTotalWallClockTime: 59m49s - MaterializeTupleTime(*): 2s977ms - ScannerThreadsSysTime: 4s923ms - ScannerThreadsUserTime: 17s157ms - ScannerThreadsVoluntaryContextSwitches: 551.39K (551388) - TotalRawHdfsReadTime(*): 313.838ms - TotalReadThroughput: 336.16 KB/sec Filter 1 (8.00 KB): - Files processed: 93 (93) - Files rejected: 83 (83) - Files total: 93 (93) - RowGroups processed: 35.77K (35766) - RowGroups rejected: 0 (0) - RowGroups total: 35.77K (35766) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 36.62M (36619178) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 36.62M (36619178) Filter 3 (2.00 MB): - Rows processed: 116.74K (116736) - Rows rejected: 0 (0) - Rows total: 36.62M (36619178) Instance 5f429df048b5534b:41bcce180000003c (host=foo.232.14:22000):(Total: 12m9s, non-child: 11m57s, % non-child: 98.38%) Hdfs split stats (:<# splits>/): 4:16/3.60 GB 3:9/2.22 GB 2:8/1.77 GB 0:10/2.17 GB 6:13/2.89 GB 5:13/3.20 GB 1:14/3.11 GB 7:15/3.70 GB Filter 1 arrival: 1s045ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 94.34 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 137.36 MB, 123.03 MB, 101.78 MB, 99.08 MB, 97.56 MB, 92.87 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 142.44 MB (149356445) - PerHostPeakMemUsage: 1.35 GB (1446295791) - RowsProduced: 53.91M (53905215) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m46s - TotalStorageWaitTime: 375.661ms - TotalThreadsInvoluntaryContextSwitches: 6.26K (6258) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 6s736ms - TotalThreadsUserTime: 31s891ms - TotalThreadsVoluntaryContextSwitches: 785.66K (785660) Fragment Instance Lifecycle Timings: - ExecTime: 12m8s - ExecTreeExecTime: 5s323ms - OpenTime: 70.044ms - ExecTreeOpenTime: 179.083us - PrepareTime: 31.783ms - ExecTreePrepareTime: 1.416ms DataStreamSender (dst_id=22):(Total: 6s433ms, non-child: 6s433ms, % non-child: 100.00%) - BytesSent: 964.19 MB (1011021806) - OverallThroughput: 149.88 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 53.91M (53905215) - SerializeBatchTime: 6s419ms - UncompressedRowBatchSize: 964.19 MB (1011021806) CodeGen:(Total: 94.882ms, non-child: 94.882ms, % non-child: 100.00%) - CodegenTime: 1.535ms - CompileTime: 10.194ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 58.807ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.359ms HDFS_SCAN_NODE (id=2):(Total: 5s283ms, non-child: 5s283ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/3.60 GB 3:9/2.22 GB 2:8/1.77 GB 0:10/2.17 GB 6:13/2.89 GB 5:13/3.20 GB 1:14/3.11 GB 7:15/3.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 15 out of 15 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:45 BytesRead(16s000ms): 82.26 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 166.00 MB, 215.33 MB, 263.87 MB, 310.93 MB - FooterProcessingTime: (Avg: 1.990ms ; Min: 1.003ms ; Max: 3.852ms ; Number of samples: 15) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 351.91 MB (369006741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 351.91 MB (369006741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 351.91 MB (369006741) - CachedFileHandlesHitCount: 89 (89) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s566ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 15 (15) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 134.40 MB (140925916) - PerReadThreadRawHdfsThroughput: 720.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.073ms - RowBatchQueuePutWaitTime: 58m52s - RowsRead: 53.91M (53905215) - RowsReturned: 53.91M (53905215) - RowsReturnedRate: 10.20 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 3.84K (3843) - ScannerThreadsTotalWallClockTime: 59m17s - MaterializeTupleTime(*): 4s562ms - ScannerThreadsSysTime: 6s027ms - ScannerThreadsUserTime: 15s383ms - ScannerThreadsVoluntaryContextSwitches: 769.09K (769086) - TotalRawHdfsReadTime(*): 488.189ms - TotalReadThroughput: 494.66 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 83 (83) - Files total: 98 (98) - RowGroups processed: 52.65K (52649) - RowGroups rejected: 0 (0) - RowGroups total: 52.65K (52649) - Rows processed: 245.76K (245760) - Rows rejected: 0 (0) - Rows total: 53.91M (53905215) - Splits processed: 15 (15) - Splits rejected: 0 (0) - Splits total: 15 (15) Filter 2 (2.00 MB): - Rows processed: 197.63K (197632) - Rows rejected: 0 (0) - Rows total: 53.91M (53905215) Filter 3 (2.00 MB): - Rows processed: 197.63K (197632) - Rows rejected: 0 (0) - Rows total: 53.91M (53905215) Instance 5f429df048b5534b:41bcce1800000013 (host=foo.232.31:22000):(Total: 12m8s, non-child: 11m59s, % non-child: 98.79%) Hdfs split stats (:<# splits>/): 7:13/2.99 GB 2:11/2.57 GB 1:14/3.32 GB 3:15/3.70 GB 5:9/1.94 GB 6:10/2.46 GB 0:17/3.76 GB 4:8/1.97 GB Filter 1 arrival: 972ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.16 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.18 MB, 135.79 MB, 139.21 MB, 108.62 MB, 99.37 MB, 83.80 MB, 77.11 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4 - AverageThreadTokens: 5.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.25 MB (147064921) - PerHostPeakMemUsage: 1.42 GB (1528772547) - RowsProduced: 28.22M (28220427) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m53s - TotalStorageWaitTime: 221.177ms - TotalThreadsInvoluntaryContextSwitches: 2.90K (2903) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 586.909ms - TotalThreadsUserTime: 19s103ms - TotalThreadsVoluntaryContextSwitches: 49.65K (49651) Fragment Instance Lifecycle Timings: - ExecTime: 12m8s - ExecTreeExecTime: 5s152ms - OpenTime: 68.359ms - ExecTreeOpenTime: 198.667us - PrepareTime: 35.064ms - ExecTreePrepareTime: 773.334us DataStreamSender (dst_id=22):(Total: 3s605ms, non-child: 3s605ms, % non-child: 100.00%) - BytesSent: 506.05 MB (530629551) - OverallThroughput: 140.36 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.22M (28220427) - SerializeBatchTime: 3s596ms - UncompressedRowBatchSize: 506.05 MB (530629551) CodeGen:(Total: 94.410ms, non-child: 94.410ms, % non-child: 100.00%) - CodegenTime: 1.349ms - CompileTime: 9.850ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.470ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.381ms HDFS_SCAN_NODE (id=2):(Total: 5s129ms, non-child: 5s129ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/2.99 GB 2:11/2.57 GB 1:14/3.32 GB 3:15/3.70 GB 5:9/1.94 GB 6:10/2.46 GB 0:17/3.76 GB 4:8/1.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.23 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 146.05 MB, 184.72 MB - FooterProcessingTime: (Avg: 3.273ms ; Min: 963.882us ; Max: 16.534ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 184.72 MB (193688393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.72 MB (193688393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.72 MB (193688393) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 763.396ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828921) - PerReadThreadRawHdfsThroughput: 582.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.312ms - RowBatchQueuePutWaitTime: 59m - RowsRead: 28.22M (28220427) - RowsReturned: 28.22M (28220427) - RowsReturnedRate: 5.50 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.36K (1362) - ScannerThreadsTotalWallClockTime: 59m19s - MaterializeTupleTime(*): 2s175ms - ScannerThreadsSysTime: 195.968ms - ScannerThreadsUserTime: 9s628ms - ScannerThreadsVoluntaryContextSwitches: 32.90K (32897) - TotalRawHdfsReadTime(*): 316.952ms - TotalReadThroughput: 260.18 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 89 (89) - Files total: 97 (97) - RowGroups processed: 27.56K (27563) - RowGroups rejected: 0 (0) - RowGroups total: 27.56K (27563) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.22M (28220427) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 112.64K (112640) - Rows rejected: 0 (0) - Rows total: 28.22M (28220427) Filter 3 (2.00 MB): - Rows processed: 87.04K (87040) - Rows rejected: 0 (0) - Rows total: 28.22M (28220427) Instance 5f429df048b5534b:41bcce1800000057 (host=foo.232.25:22000):(Total: 12m7s, non-child: 11m57s, % non-child: 98.58%) Hdfs split stats (:<# splits>/): 0:13/3.05 GB 7:14/3.27 GB 5:10/2.26 GB 3:10/2.40 GB 2:11/2.71 GB 6:13/3.20 GB 1:9/2.22 GB 4:14/3.11 GB Filter 1 arrival: 1s248ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.48 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.88 MB, 135.94 MB, 139.05 MB, 117.55 MB, 97.29 MB, 99.83 MB, 66.77 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.40 MB (147220211) - PerHostPeakMemUsage: 1.41 GB (1513013883) - RowsProduced: 40.35M (40347465) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m49s - TotalStorageWaitTime: 216.296ms - TotalThreadsInvoluntaryContextSwitches: 6.32K (6322) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 3s782ms - TotalThreadsUserTime: 42s123ms - TotalThreadsVoluntaryContextSwitches: 334.37K (334366) Fragment Instance Lifecycle Timings: - ExecTime: 12m7s - ExecTreeExecTime: 5s226ms - OpenTime: 64.622ms - ExecTreeOpenTime: 186.030us - PrepareTime: 33.721ms - ExecTreePrepareTime: 743.066us DataStreamSender (dst_id=22):(Total: 5s022ms, non-child: 5s022ms, % non-child: 100.00%) - BytesSent: 725.47 MB (760711989) - OverallThroughput: 144.43 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 40.35M (40347465) - SerializeBatchTime: 5s012ms - UncompressedRowBatchSize: 725.47 MB (760711989) CodeGen:(Total: 92.312ms, non-child: 92.312ms, % non-child: 100.00%) - CodegenTime: 1.389ms - CompileTime: 10.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.796ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.148ms HDFS_SCAN_NODE (id=2):(Total: 5s195ms, non-child: 5s195ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/3.05 GB 7:14/3.27 GB 5:10/2.26 GB 3:10/2.40 GB 2:11/2.71 GB 6:13/3.20 GB 1:9/2.22 GB 4:14/3.11 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0% 3:0.06887% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:33 BytesRead(16s000ms): 81.57 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 134.43 MB, 215.02 MB, 240.42 MB - FooterProcessingTime: (Avg: 1.554ms ; Min: 489.574us ; Max: 3.896ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 262.82 MB (275586487) - BytesReadDataNodeCache: 0 - BytesReadLocal: 262.82 MB (275586487) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 262.82 MB (275586487) - CachedFileHandlesHitCount: 66 (66) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s168ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138829025) - PerReadThreadRawHdfsThroughput: 824.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.505ms - RowBatchQueuePutWaitTime: 58m51s - RowsRead: 40.35M (40347465) - RowsReturned: 40.35M (40347465) - RowsReturnedRate: 7.77 M/sec - ScanRangesComplete: 94 (94) - ScannerThreadsInvoluntaryContextSwitches: 4.43K (4435) - ScannerThreadsTotalWallClockTime: 59m48s - MaterializeTupleTime(*): 3s367ms - ScannerThreadsSysTime: 3s192ms - ScannerThreadsUserTime: 29s568ms - ScannerThreadsVoluntaryContextSwitches: 317.91K (317911) - TotalRawHdfsReadTime(*): 318.754ms - TotalReadThroughput: 370.44 KB/sec Filter 1 (8.00 KB): - Files processed: 94 (94) - Files rejected: 83 (83) - Files total: 94 (94) - RowGroups processed: 39.41K (39408) - RowGroups rejected: 0 (0) - RowGroups total: 39.41K (39408) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 40.35M (40347465) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 139.26K (139264) - Rows rejected: 0 (0) - Rows total: 40.35M (40347465) Filter 3 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 40.35M (40347465) Instance 5f429df048b5534b:41bcce1800000008 (host=foo.232.28:22000):(Total: 12m4s, non-child: 11m55s, % non-child: 98.79%) Hdfs split stats (:<# splits>/): 0:15/3.26 GB 3:9/2.22 GB 5:10/2.40 GB 2:12/2.87 GB 6:13/3.07 GB 7:15/3.70 GB 1:14/3.24 GB 4:6/1.48 GB Filter 1 arrival: 1s026ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 91.97 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.56 MB, 133.90 MB, 137.24 MB, 109.57 MB, 74.29 MB, 87.48 MB, 70.13 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4 - AverageThreadTokens: 5.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.38 MB (145103926) - PerHostPeakMemUsage: 1.43 GB (1534517528) - RowsProduced: 27.24M (27244447) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m49s - TotalStorageWaitTime: 153.377ms - TotalThreadsInvoluntaryContextSwitches: 2.06K (2058) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 680.895ms - TotalThreadsUserTime: 12s441ms - TotalThreadsVoluntaryContextSwitches: 43.72K (43715) Fragment Instance Lifecycle Timings: - ExecTime: 12m4s - ExecTreeExecTime: 5s142ms - OpenTime: 61.709ms - ExecTreeOpenTime: 172.006us - PrepareTime: 29.718ms - ExecTreePrepareTime: 767.818us DataStreamSender (dst_id=22):(Total: 3s549ms, non-child: 3s549ms, % non-child: 100.00%) - BytesSent: 491.34 MB (515207273) - OverallThroughput: 138.41 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 27.24M (27244447) - SerializeBatchTime: 3s542ms - UncompressedRowBatchSize: 491.34 MB (515207273) CodeGen:(Total: 82.887ms, non-child: 82.887ms, % non-child: 100.00%) - CodegenTime: 1.275ms - CompileTime: 9.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.966ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 21.570ms HDFS_SCAN_NODE (id=2):(Total: 5s121ms, non-child: 5s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:15/3.26 GB 3:9/2.22 GB 5:10/2.40 GB 2:12/2.87 GB 6:13/3.07 GB 7:15/3.70 GB 1:14/3.24 GB 4:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:24 BytesRead(16s000ms): 73.19 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 106.45 MB, 176.69 MB, 178.18 MB - FooterProcessingTime: (Avg: 1.764ms ; Min: 856.484us ; Max: 2.991ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 178.18 MB (186836397) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.18 MB (186836397) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.18 MB (186836397) - CachedFileHandlesHitCount: 46 (46) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 729.607ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.40 MB (136731801) - PerReadThreadRawHdfsThroughput: 821.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.355ms - RowBatchQueuePutWaitTime: 58m15s - RowsRead: 27.24M (27244447) - RowsReturned: 27.24M (27244447) - RowsReturnedRate: 5.32 M/sec - ScanRangesComplete: 94 (94) - ScannerThreadsInvoluntaryContextSwitches: 498 (498) - ScannerThreadsTotalWallClockTime: 58m27s - MaterializeTupleTime(*): 2s104ms - ScannerThreadsSysTime: 171.972ms - ScannerThreadsUserTime: 3s333ms - ScannerThreadsVoluntaryContextSwitches: 27.13K (27126) - TotalRawHdfsReadTime(*): 217.026ms - TotalReadThroughput: 252.71 KB/sec Filter 1 (8.00 KB): - Files processed: 94 (94) - Files rejected: 86 (86) - Files total: 94 (94) - RowGroups processed: 26.61K (26611) - RowGroups rejected: 0 (0) - RowGroups total: 26.61K (26611) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 27.24M (27244447) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 103.42K (103424) - Rows rejected: 0 (0) - Rows total: 27.24M (27244447) Filter 3 (2.00 MB): - Rows processed: 103.42K (103424) - Rows rejected: 0 (0) - Rows total: 27.24M (27244447) Instance 5f429df048b5534b:41bcce180000006a (host=foo.221.47:22000):(Total: 12m3s, non-child: 11m53s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 1:8/1.97 GB 2:13/2.98 GB 5:8/1.90 GB 0:14/3.45 GB 6:13/3.14 GB 3:13/3.20 GB 7:13/2.94 GB 4:13/3.07 GB Filter 1 arrival: 1s474ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.64 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.40 MB, 134.71 MB, 137.74 MB, 96.28 MB, 75.99 MB, 77.39 MB, 58.19 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.35 MB (146114647) - PerHostPeakMemUsage: 1.42 GB (1520540796) - RowsProduced: 35.56M (35559097) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m45s - TotalStorageWaitTime: 191.224ms - TotalThreadsInvoluntaryContextSwitches: 4.15K (4151) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 810.874ms - TotalThreadsUserTime: 28s886ms - TotalThreadsVoluntaryContextSwitches: 52.95K (52951) Fragment Instance Lifecycle Timings: - ExecTime: 12m3s - ExecTreeExecTime: 5s205ms - OpenTime: 63.627ms - ExecTreeOpenTime: 191.154us - PrepareTime: 32.154ms - ExecTreePrepareTime: 827.055us DataStreamSender (dst_id=22):(Total: 4s662ms, non-child: 4s662ms, % non-child: 100.00%) - BytesSent: 630.91 MB (661552566) - OverallThroughput: 135.32 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.56M (35559097) - SerializeBatchTime: 4s652ms - UncompressedRowBatchSize: 630.91 MB (661552566) CodeGen:(Total: 86.868ms, non-child: 86.868ms, % non-child: 100.00%) - CodegenTime: 1.320ms - CompileTime: 9.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.818ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.805ms HDFS_SCAN_NODE (id=2):(Total: 5s177ms, non-child: 5s177ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:8/1.97 GB 2:13/2.98 GB 5:8/1.90 GB 0:14/3.45 GB 6:13/3.14 GB 3:13/3.20 GB 7:13/2.94 GB 4:13/3.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.62 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 112.89 MB, 128.58 MB, 184.60 MB, 211.50 MB - FooterProcessingTime: (Avg: 2.273ms ; Min: 699.339us ; Max: 6.748ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 232.42 MB (243706146) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.42 MB (243706146) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.42 MB (243706146) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 968.811ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780114) - PerReadThreadRawHdfsThroughput: 833.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.442ms - RowBatchQueuePutWaitTime: 58m2s - RowsRead: 35.56M (35559097) - RowsReturned: 35.56M (35559097) - RowsReturnedRate: 6.87 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.27K (2268) - ScannerThreadsTotalWallClockTime: 58m19s - MaterializeTupleTime(*): 2s799ms - ScannerThreadsSysTime: 208.965ms - ScannerThreadsUserTime: 16s424ms - ScannerThreadsVoluntaryContextSwitches: 35.29K (35291) - TotalRawHdfsReadTime(*): 278.849ms - TotalReadThroughput: 329.18 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 85 (85) - Files total: 95 (95) - RowGroups processed: 34.73K (34730) - RowGroups rejected: 0 (0) - RowGroups total: 34.73K (34730) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.56M (35559097) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 122.88K (122880) - Rows rejected: 0 (0) - Rows total: 35.56M (35559097) Filter 3 (2.00 MB): - Rows processed: 119.81K (119808) - Rows rejected: 0 (0) - Rows total: 35.56M (35559097) Instance 5f429df048b5534b:41bcce180000003d (host=foo.232.19:22000):(Total: 12m3s, non-child: 11m52s, % non-child: 98.49%) Hdfs split stats (:<# splits>/): 2:12/2.83 GB 4:10/2.41 GB 3:19/4.29 GB 7:8/1.97 GB 1:9/2.15 GB 5:16/3.79 GB 6:6/1.42 GB 0:16/3.60 GB Filter 1 arrival: 985ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 94.81 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 137.62 MB, 138.09 MB, 130.54 MB, 95.15 MB, 98.56 MB, 95.84 MB, 85.31 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 142.32 MB (149236940) - PerHostPeakMemUsage: 1.36 GB (1462073058) - RowsProduced: 45.55M (45549625) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m43s - TotalStorageWaitTime: 244.439ms - TotalThreadsInvoluntaryContextSwitches: 4.64K (4643) - TotalThreadsTotalWallClockTime: 1h11m - TotalThreadsSysTime: 1s783ms - TotalThreadsUserTime: 27s027ms - TotalThreadsVoluntaryContextSwitches: 112.09K (112090) Fragment Instance Lifecycle Timings: - ExecTime: 12m3s - ExecTreeExecTime: 5s238ms - OpenTime: 73.203ms - ExecTreeOpenTime: 256.302us - PrepareTime: 44.386ms - ExecTreePrepareTime: 935.417us DataStreamSender (dst_id=22):(Total: 5s628ms, non-child: 5s628ms, % non-child: 100.00%) - BytesSent: 822.32 MB (862266204) - OverallThroughput: 146.09 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 45.55M (45549625) - SerializeBatchTime: 5s616ms - UncompressedRowBatchSize: 822.32 MB (862266204) CodeGen:(Total: 111.495ms, non-child: 111.495ms, % non-child: 100.00%) - CodegenTime: 1.491ms - CompileTime: 20.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.693ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 38.886ms HDFS_SCAN_NODE (id=2):(Total: 5s201ms, non-child: 5s201ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.83 GB 4:10/2.41 GB 3:19/4.29 GB 7:8/1.97 GB 1:9/2.15 GB 5:16/3.79 GB 6:6/1.42 GB 0:16/3.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.0692% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:39 BytesRead(16s000ms): 82.25 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 119.63 MB, 136.57 MB, 208.77 MB, 259.75 MB, 298.00 MB - FooterProcessingTime: (Avg: 1.732ms ; Min: 651.899us ; Max: 4.041ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 298.00 MB (312475162) - BytesReadDataNodeCache: 0 - BytesReadLocal: 298.00 MB (312475162) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 298.00 MB (312475162) - CachedFileHandlesHitCount: 76 (76) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s351ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 134.40 MB (140925630) - PerReadThreadRawHdfsThroughput: 796.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.305ms - RowBatchQueuePutWaitTime: 58m41s - RowsRead: 45.55M (45549625) - RowsReturned: 45.55M (45549625) - RowsReturnedRate: 8.76 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.58K (2578) - ScannerThreadsTotalWallClockTime: 58m59s - MaterializeTupleTime(*): 3s931ms - ScannerThreadsSysTime: 1s098ms - ScannerThreadsUserTime: 12s719ms - ScannerThreadsVoluntaryContextSwitches: 95.58K (95584) - TotalRawHdfsReadTime(*): 374.159ms - TotalReadThroughput: 422.06 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 83 (83) - Files total: 96 (96) - RowGroups processed: 44.49K (44488) - RowGroups rejected: 0 (0) - RowGroups total: 44.49K (44488) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 45.55M (45549625) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 161.79K (161792) - Rows rejected: 0 (0) - Rows total: 45.55M (45549625) Filter 3 (2.00 MB): - Rows processed: 182.27K (182272) - Rows rejected: 0 (0) - Rows total: 45.55M (45549625) Instance 5f429df048b5534b:41bcce1800000068 (host=foo.232.18:22000):(Total: 12m1s, non-child: 11m51s, % non-child: 98.54%) Hdfs split stats (:<# splits>/): 3:10/2.39 GB 0:6/1.41 GB 5:19/4.55 GB 7:8/1.90 GB 6:13/3.06 GB 2:6/1.48 GB 4:16/3.44 GB 1:18/4.37 GB Filter 1 arrival: 1s255ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 90.35 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 130.93 MB, 131.51 MB, 124.25 MB, 91.38 MB, 95.83 MB, 91.17 MB, 65.42 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.87 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 137.28 MB (143950035) - PerHostPeakMemUsage: 1.36 GB (1459405202) - RowsProduced: 42.54M (42539096) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m42s - TotalStorageWaitTime: 243.434ms - TotalThreadsInvoluntaryContextSwitches: 5.82K (5818) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 3s401ms - TotalThreadsUserTime: 36s896ms - TotalThreadsVoluntaryContextSwitches: 300.72K (300722) Fragment Instance Lifecycle Timings: - ExecTime: 12m1s - ExecTreeExecTime: 5s248ms - OpenTime: 65.260ms - ExecTreeOpenTime: 170.968us - PrepareTime: 30.978ms - ExecTreePrepareTime: 974.877us DataStreamSender (dst_id=22):(Total: 5s226ms, non-child: 5s226ms, % non-child: 100.00%) - BytesSent: 767.17 MB (804439351) - OverallThroughput: 146.78 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.54M (42539096) - SerializeBatchTime: 5s215ms - UncompressedRowBatchSize: 767.17 MB (804439351) CodeGen:(Total: 90.201ms, non-child: 90.201ms, % non-child: 100.00%) - CodegenTime: 1.429ms - CompileTime: 9.971ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.186ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.565ms HDFS_SCAN_NODE (id=2):(Total: 5s217ms, non-child: 5s217ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:10/2.39 GB 0:6/1.41 GB 5:19/4.55 GB 7:8/1.90 GB 6:13/3.06 GB 2:6/1.48 GB 4:16/3.44 GB 1:18/4.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.0694% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:39 BytesRead(16s000ms): 68.72 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 99.96 MB, 147.12 MB, 206.80 MB, 243.92 MB, 278.57 MB - FooterProcessingTime: (Avg: 1.880ms ; Min: 907.318us ; Max: 3.525ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 278.57 MB (292105975) - BytesReadDataNodeCache: 0 - BytesReadLocal: 278.57 MB (292105975) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 278.57 MB (292105975) - CachedFileHandlesHitCount: 73 (73) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s242ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 129.40 MB (135683152) - PerReadThreadRawHdfsThroughput: 786.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.335ms - RowBatchQueuePutWaitTime: 58m9s - RowsRead: 42.54M (42539096) - RowsReturned: 42.54M (42539096) - RowsReturnedRate: 8.15 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 3.88K (3881) - ScannerThreadsTotalWallClockTime: 58m38s - MaterializeTupleTime(*): 3s621ms - ScannerThreadsSysTime: 2s753ms - ScannerThreadsUserTime: 23s654ms - ScannerThreadsVoluntaryContextSwitches: 284.58K (284584) - TotalRawHdfsReadTime(*): 354.266ms - TotalReadThroughput: 395.92 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 83 (83) - Files total: 96 (96) - RowGroups processed: 41.55K (41547) - RowGroups rejected: 0 (0) - RowGroups total: 41.55K (41547) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 42.54M (42539096) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 166.20K (166198) - Rows rejected: 0 (0) - Rows total: 42.54M (42539096) Filter 3 (2.00 MB): - Rows processed: 181.25K (181248) - Rows rejected: 0 (0) - Rows total: 42.54M (42539096) Instance 5f429df048b5534b:41bcce180000000f (host=foo.232.20:22000):(Total: 11m58s, non-child: 11m47s, % non-child: 98.49%) Hdfs split stats (:<# splits>/): 1:8/1.83 GB 2:13/3.06 GB 5:14/3.18 GB 6:14/2.90 GB 4:11/2.47 GB 7:11/2.55 GB 3:12/2.83 GB 0:16/3.81 GB Filter 1 arrival: 1s314ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.36 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 133.86 MB, 134.58 MB, 117.43 MB, 107.37 MB, 92.74 MB, 98.94 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.87 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.41 MB (147228403) - PerHostPeakMemUsage: 1.37 GB (1474452829) - RowsProduced: 44.31M (44313685) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m38s - TotalStorageWaitTime: 272.908ms - TotalThreadsInvoluntaryContextSwitches: 4.92K (4919) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 1s642ms - TotalThreadsUserTime: 27s638ms - TotalThreadsVoluntaryContextSwitches: 121.20K (121202) Fragment Instance Lifecycle Timings: - ExecTime: 11m58s - ExecTreeExecTime: 5s259ms - OpenTime: 62.490ms - ExecTreeOpenTime: 219.314us - PrepareTime: 30.324ms - ExecTreePrepareTime: 905.353us DataStreamSender (dst_id=22):(Total: 5s526ms, non-child: 5s526ms, % non-child: 100.00%) - BytesSent: 799.50 MB (838334501) - OverallThroughput: 144.66 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 44.31M (44313685) - SerializeBatchTime: 5s515ms - UncompressedRowBatchSize: 799.50 MB (838334501) CodeGen:(Total: 87.006ms, non-child: 87.006ms, % non-child: 100.00%) - CodegenTime: 1.257ms - CompileTime: 9.920ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.569ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.066ms HDFS_SCAN_NODE (id=2):(Total: 5s225ms, non-child: 5s225ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:8/1.83 GB 2:13/3.06 GB 5:14/3.18 GB 6:14/2.90 GB 4:11/2.47 GB 7:11/2.55 GB 3:12/2.83 GB 0:16/3.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:39 BytesRead(16s000ms): 77.59 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 112.86 MB, 182.41 MB, 210.86 MB, 275.57 MB - FooterProcessingTime: (Avg: 1.750ms ; Min: 701.881us ; Max: 3.644ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 290.46 MB (304567933) - BytesReadDataNodeCache: 0 - BytesReadLocal: 290.46 MB (304567933) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 290.46 MB (304567933) - CachedFileHandlesHitCount: 75 (75) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s318ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828973) - PerReadThreadRawHdfsThroughput: 748.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.056ms - RowBatchQueuePutWaitTime: 58m2s - RowsRead: 44.31M (44313685) - RowsReturned: 44.31M (44313685) - RowsReturnedRate: 8.48 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.87K (2870) - ScannerThreadsTotalWallClockTime: 58m19s - MaterializeTupleTime(*): 3s828ms - ScannerThreadsSysTime: 1s008ms - ScannerThreadsUserTime: 13s466ms - ScannerThreadsVoluntaryContextSwitches: 104.93K (104929) - TotalRawHdfsReadTime(*): 388.258ms - TotalReadThroughput: 415.11 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 86 (86) - Files total: 99 (99) - RowGroups processed: 43.28K (43281) - RowGroups rejected: 0 (0) - RowGroups total: 43.28K (43281) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 44.31M (44313685) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 174.08K (174080) - Rows rejected: 0 (0) - Rows total: 44.31M (44313685) Filter 3 (2.00 MB): - Rows processed: 197.63K (197632) - Rows rejected: 0 (0) - Rows total: 44.31M (44313685) Instance 5f429df048b5534b:41bcce1800000049 (host=foo.221.42:22000):(Total: 11m58s, non-child: 11m46s, % non-child: 98.35%) Hdfs split stats (:<# splits>/): 7:13/2.93 GB 2:21/5.03 GB 6:13/2.78 GB 4:13/2.97 GB 3:12/2.75 GB 0:11/2.71 GB 1:7/1.66 GB 5:8/1.85 GB Filter 1 arrival: 1s562ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 95.09 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 137.98 MB, 138.24 MB, 139.25 MB, 98.84 MB, 94.82 MB, 93.34 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 143.34 MB (150304391) - PerHostPeakMemUsage: 1.43 GB (1539857554) - RowsProduced: 54.42M (54422450) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m36s - TotalStorageWaitTime: 298.966ms - TotalThreadsInvoluntaryContextSwitches: 6.21K (6212) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 3s956ms - TotalThreadsUserTime: 35s647ms - TotalThreadsVoluntaryContextSwitches: 375.64K (375640) Fragment Instance Lifecycle Timings: - ExecTime: 11m58s - ExecTreeExecTime: 5s330ms - OpenTime: 62.670ms - ExecTreeOpenTime: 179.678us - PrepareTime: 35.306ms - ExecTreePrepareTime: 907.700us DataStreamSender (dst_id=22):(Total: 6s467ms, non-child: 6s467ms, % non-child: 100.00%) - BytesSent: 970.53 MB (1017676833) - OverallThroughput: 150.07 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 54.42M (54422450) - SerializeBatchTime: 6s452ms - UncompressedRowBatchSize: 970.53 MB (1017676833) CodeGen:(Total: 85.994ms, non-child: 85.994ms, % non-child: 100.00%) - CodegenTime: 1.695ms - CompileTime: 9.775ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.906ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.896ms HDFS_SCAN_NODE (id=2):(Total: 5s288ms, non-child: 5s288ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/2.93 GB 2:21/5.03 GB 6:13/2.78 GB 4:13/2.97 GB 3:12/2.75 GB 0:11/2.71 GB 1:7/1.66 GB 5:8/1.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06964% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:48 BytesRead(16s000ms): 77.82 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 113.19 MB, 146.57 MB, 202.58 MB, 269.89 MB - FooterProcessingTime: (Avg: 1.402ms ; Min: 538.941us ; Max: 3.390ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.91 - BytesRead: 356.56 MB (373879155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 356.56 MB (373879155) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 356.56 MB (373879155) - CachedFileHandlesHitCount: 92 (92) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s580ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 135.40 MB (141974415) - PerReadThreadRawHdfsThroughput: 702.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.519ms - RowBatchQueuePutWaitTime: 58m5s - RowsRead: 54.42M (54422450) - RowsReturned: 54.42M (54422450) - RowsReturnedRate: 10.29 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 3.84K (3841) - ScannerThreadsTotalWallClockTime: 58m49s - MaterializeTupleTime(*): 4s538ms - ScannerThreadsSysTime: 3s145ms - ScannerThreadsUserTime: 19s341ms - ScannerThreadsVoluntaryContextSwitches: 358.16K (358158) - TotalRawHdfsReadTime(*): 507.592ms - TotalReadThroughput: 508.52 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 82 (82) - Files total: 98 (98) - RowGroups processed: 53.16K (53155) - RowGroups rejected: 0 (0) - RowGroups total: 53.16K (53155) - Rows processed: 262.14K (262144) - Rows rejected: 0 (0) - Rows total: 54.42M (54422450) - Splits processed: 16 (16) - Splits rejected: 0 (0) - Splits total: 16 (16) Filter 2 (2.00 MB): - Rows processed: 227.33K (227328) - Rows rejected: 0 (0) - Rows total: 54.42M (54422450) Filter 3 (2.00 MB): - Rows processed: 217.09K (217088) - Rows rejected: 0 (0) - Rows total: 54.42M (54422450) Instance 5f429df048b5534b:41bcce1800000011 (host=foo.221.28:22000):(Total: 11m57s, non-child: 11m48s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 7:14/3.32 GB 3:9/2.15 GB 6:9/2.04 GB 1:12/2.83 GB 5:13/3.20 GB 4:13/3.07 GB 0:15/3.53 GB 2:11/2.57 GB Filter 1 arrival: 1s689ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 89.42 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.58 MB, 129.82 MB, 134.16 MB, 105.79 MB, 78.48 MB, 77.64 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.36 MB (141933391) - PerHostPeakMemUsage: 1.38 GB (1485233861) - RowsProduced: 31.83M (31826534) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m41s - TotalStorageWaitTime: 171.794ms - TotalThreadsInvoluntaryContextSwitches: 4.36K (4357) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 1s657ms - TotalThreadsUserTime: 29s401ms - TotalThreadsVoluntaryContextSwitches: 213.08K (213083) Fragment Instance Lifecycle Timings: - ExecTime: 11m57s - ExecTreeExecTime: 5s171ms - OpenTime: 67.378ms - ExecTreeOpenTime: 189.851us - PrepareTime: 31.507ms - ExecTreePrepareTime: 794.953us DataStreamSender (dst_id=22):(Total: 4s173ms, non-child: 4s173ms, % non-child: 100.00%) - BytesSent: 569.07 MB (596716365) - OverallThroughput: 136.37 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.83M (31826534) - SerializeBatchTime: 4s165ms - UncompressedRowBatchSize: 569.07 MB (596716365) CodeGen:(Total: 93.356ms, non-child: 93.356ms, % non-child: 100.00%) - CodegenTime: 1.336ms - CompileTime: 11.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.574ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.619ms HDFS_SCAN_NODE (id=2):(Total: 5s144ms, non-child: 5s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:14/3.32 GB 3:9/2.15 GB 6:9/2.04 GB 1:12/2.83 GB 5:13/3.20 GB 4:13/3.07 GB 0:15/3.53 GB 2:11/2.57 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0.06988% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:27 BytesRead(16s000ms): 77.32 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 112.54 MB, 130.48 MB, 184.31 MB - FooterProcessingTime: (Avg: 1.343ms ; Min: 867.672us ; Max: 2.676ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 208.14 MB (218245815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.14 MB (218245815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.14 MB (218245815) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 865.952ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133586064) - PerReadThreadRawHdfsThroughput: 827.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.657ms - RowBatchQueuePutWaitTime: 57m39s - RowsRead: 31.83M (31826534) - RowsReturned: 31.83M (31826534) - RowsReturnedRate: 6.19 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.65K (2646) - ScannerThreadsTotalWallClockTime: 58m2s - MaterializeTupleTime(*): 2s451ms - ScannerThreadsSysTime: 1s168ms - ScannerThreadsUserTime: 18s634ms - ScannerThreadsVoluntaryContextSwitches: 195.86K (195856) - TotalRawHdfsReadTime(*): 251.530ms - TotalReadThroughput: 297.67 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 87 (87) - Files total: 96 (96) - RowGroups processed: 31.09K (31086) - RowGroups rejected: 0 (0) - RowGroups total: 31.09K (31086) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.83M (31826534) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 31.83M (31826534) Filter 3 (2.00 MB): - Rows processed: 104.45K (104448) - Rows rejected: 0 (0) - Rows total: 31.83M (31826534) Instance 5f429df048b5534b:41bcce1800000001 (host=foo.221.39:22000):(Total: 11m56s, non-child: 11m47s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 3:14/2.69 GB 6:9/2.22 GB 2:10/2.18 GB 1:12/2.89 GB 0:11/2.57 GB 4:12/2.67 GB 7:17/4.03 GB 5:13/3.10 GB Filter 1 arrival: 1s551ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 74.01 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.20 MB, 107.58 MB, 108.24 MB, 66.52 MB, 80.85 MB, 66.53 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.80 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 113.33 MB (118831373) - PerHostPeakMemUsage: 1.37 GB (1474043505) - RowsProduced: 34.00M (33997811) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m40s - TotalStorageWaitTime: 174.785ms - TotalThreadsInvoluntaryContextSwitches: 3.85K (3848) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 665.896ms - TotalThreadsUserTime: 23s892ms - TotalThreadsVoluntaryContextSwitches: 51.67K (51667) Fragment Instance Lifecycle Timings: - ExecTime: 11m56s - ExecTreeExecTime: 5s169ms - OpenTime: 65.770ms - ExecTreeOpenTime: 172.839us - PrepareTime: 40.454ms - ExecTreePrepareTime: 843.044us DataStreamSender (dst_id=22):(Total: 4s225ms, non-child: 4s225ms, % non-child: 100.00%) - BytesSent: 610.42 MB (640073534) - OverallThroughput: 144.46 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.00M (33997811) - SerializeBatchTime: 4s217ms - UncompressedRowBatchSize: 610.42 MB (640073534) CodeGen:(Total: 93.987ms, non-child: 93.987ms, % non-child: 100.00%) - CodegenTime: 1.337ms - CompileTime: 10.354ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.217ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.890ms HDFS_SCAN_NODE (id=2):(Total: 5s145ms, non-child: 5s145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/2.69 GB 6:9/2.22 GB 2:10/2.18 GB 1:12/2.89 GB 0:11/2.57 GB 4:12/2.67 GB 7:17/4.03 GB 5:13/3.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:33 BytesRead(16s000ms): 59.25 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 86.18 MB, 100.39 MB, 158.01 MB, 183.14 MB - FooterProcessingTime: (Avg: 1.321ms ; Min: 516.216us ; Max: 3.027ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.80 - BytesRead: 223.01 MB (233847388) - BytesReadDataNodeCache: 0 - BytesReadLocal: 223.01 MB (233847388) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 223.01 MB (233847388) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 915.232ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 105.39 MB (110511544) - PerReadThreadRawHdfsThroughput: 897.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.035ms - RowBatchQueuePutWaitTime: 57m1s - RowsRead: 34.00M (33997811) - RowsReturned: 34.00M (33997811) - RowsReturnedRate: 6.61 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2094) - ScannerThreadsTotalWallClockTime: 57m21s - MaterializeTupleTime(*): 2s582ms - ScannerThreadsSysTime: 179.970ms - ScannerThreadsUserTime: 12s902ms - ScannerThreadsVoluntaryContextSwitches: 34.77K (34771) - TotalRawHdfsReadTime(*): 248.426ms - TotalReadThroughput: 318.72 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 87 (87) - Files total: 98 (98) - RowGroups processed: 33.21K (33207) - RowGroups rejected: 0 (0) - RowGroups total: 33.21K (33207) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 34.00M (33997811) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 34.00M (33997811) Filter 3 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 34.00M (33997811) Instance 5f429df048b5534b:41bcce1800000055 (host=foo.221.52:22000):(Total: 11m56s, non-child: 11m47s, % non-child: 98.70%) Hdfs split stats (:<# splits>/): 7:13/3.00 GB 4:12/2.96 GB 3:12/2.83 GB 2:13/2.91 GB 1:19/4.41 GB 0:8/1.77 GB 6:12/2.65 GB 5:10/2.22 GB Filter 1 arrival: 1s408ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.17 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 130.92 MB, 131.06 MB, 134.15 MB, 103.86 MB, 82.64 MB, 74.38 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.26 MB (141834095) - PerHostPeakMemUsage: 1.40 GB (1498813388) - RowsProduced: 31.87M (31868050) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m40s - TotalStorageWaitTime: 212.979ms - TotalThreadsInvoluntaryContextSwitches: 4.18K (4184) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 5s830ms - TotalThreadsUserTime: 23s675ms - TotalThreadsVoluntaryContextSwitches: 770.83K (770826) Fragment Instance Lifecycle Timings: - ExecTime: 11m56s - ExecTreeExecTime: 5s183ms - OpenTime: 66.795ms - ExecTreeOpenTime: 197.260us - PrepareTime: 39.214ms - ExecTreePrepareTime: 749.689us DataStreamSender (dst_id=22):(Total: 4s055ms, non-child: 4s055ms, % non-child: 100.00%) - BytesSent: 569.57 MB (597234343) - OverallThroughput: 140.45 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.87M (31868050) - SerializeBatchTime: 4s046ms - UncompressedRowBatchSize: 569.57 MB (597234343) CodeGen:(Total: 94.610ms, non-child: 94.610ms, % non-child: 100.00%) - CodegenTime: 1.426ms - CompileTime: 11.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.340ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.269ms HDFS_SCAN_NODE (id=2):(Total: 5s160ms, non-child: 5s160ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.00 GB 4:12/2.96 GB 3:12/2.83 GB 2:13/2.91 GB 1:19/4.41 GB 0:8/1.77 GB 6:12/2.65 GB 5:10/2.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:27 BytesRead(16s000ms): 77.37 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 112.53 MB, 134.95 MB, 184.25 MB - FooterProcessingTime: (Avg: 1.718ms ; Min: 630.285us ; Max: 5.296ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 208.17 MB (218282781) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.17 MB (218282781) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.17 MB (218282781) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 861.024ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585967) - PerReadThreadRawHdfsThroughput: 707.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.537ms - RowBatchQueuePutWaitTime: 57m39s - RowsRead: 31.87M (31868050) - RowsReturned: 31.87M (31868050) - RowsReturnedRate: 6.17 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.56K (2559) - ScannerThreadsTotalWallClockTime: 57m59s - MaterializeTupleTime(*): 2s441ms - ScannerThreadsSysTime: 5s354ms - ScannerThreadsUserTime: 13s069ms - ScannerThreadsVoluntaryContextSwitches: 754.12K (754119) - TotalRawHdfsReadTime(*): 294.115ms - TotalReadThroughput: 297.93 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 90 (90) - Files total: 99 (99) - RowGroups processed: 31.13K (31126) - RowGroups rejected: 0 (0) - RowGroups total: 31.13K (31126) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.87M (31868050) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 91.14K (91136) - Rows rejected: 0 (0) - Rows total: 31.87M (31868050) Filter 3 (2.00 MB): - Rows processed: 91.14K (91136) - Rows rejected: 0 (0) - Rows total: 31.87M (31868050) Instance 5f429df048b5534b:41bcce1800000005 (host=foo.232.44:22000):(Total: 11m56s, non-child: 11m45s, % non-child: 98.56%) Hdfs split stats (:<# splits>/): 7:15/3.34 GB 2:9/2.15 GB 3:15/3.55 GB 6:12/2.53 GB 1:9/2.15 GB 0:14/3.12 GB 4:17/4.12 GB 5:7/1.59 GB Filter 1 arrival: 722ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 83.01 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.22 MB, 120.93 MB, 120.76 MB, 73.75 MB, 77.34 MB, 66.32 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.81 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 126.37 MB (132506349) - PerHostPeakMemUsage: 1.36 GB (1459149788) - RowsProduced: 38.77M (38768521) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m38s - TotalStorageWaitTime: 228.432ms - TotalThreadsInvoluntaryContextSwitches: 4.70K (4704) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 1s408ms - TotalThreadsUserTime: 31s037ms - TotalThreadsVoluntaryContextSwitches: 87.49K (87488) Fragment Instance Lifecycle Timings: - ExecTime: 11m56s - ExecTreeExecTime: 5s225ms - OpenTime: 63.457ms - ExecTreeOpenTime: 229.459us - PrepareTime: 25.383ms - ExecTreePrepareTime: 528.182us DataStreamSender (dst_id=22):(Total: 5s026ms, non-child: 5s026ms, % non-child: 100.00%) - BytesSent: 693.39 MB (727067941) - OverallThroughput: 137.95 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.77M (38768521) - SerializeBatchTime: 5s016ms - UncompressedRowBatchSize: 693.39 MB (727067941) CodeGen:(Total: 84.002ms, non-child: 84.002ms, % non-child: 100.00%) - CodegenTime: 1.398ms - CompileTime: 11.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.278ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 21.103ms HDFS_SCAN_NODE (id=2):(Total: 5s193ms, non-child: 5s193ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:15/3.34 GB 2:9/2.15 GB 3:15/3.55 GB 6:12/2.53 GB 1:9/2.15 GB 0:14/3.12 GB 4:17/4.12 GB 5:7/1.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.06988% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:36 BytesRead(16s000ms): 68.87 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 100.18 MB, 124.85 MB, 171.95 MB, 206.34 MB - FooterProcessingTime: (Avg: 1.824ms ; Min: 747.560us ; Max: 3.732ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.81 - BytesRead: 253.76 MB (266091077) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.76 MB (266091077) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.76 MB (266091077) - CachedFileHandlesHitCount: 67 (67) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s127ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 118.39 MB (124143225) - PerReadThreadRawHdfsThroughput: 767.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.065ms - RowBatchQueuePutWaitTime: 56m58s - RowsRead: 38.77M (38768521) - RowsReturned: 38.77M (38768521) - RowsReturnedRate: 7.47 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.83K (2832) - ScannerThreadsTotalWallClockTime: 57m23s - MaterializeTupleTime(*): 3s274ms - ScannerThreadsSysTime: 763.882ms - ScannerThreadsUserTime: 18s334ms - ScannerThreadsVoluntaryContextSwitches: 71.34K (71340) - TotalRawHdfsReadTime(*): 330.686ms - TotalReadThroughput: 363.18 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 86 (86) - Files total: 98 (98) - RowGroups processed: 37.87K (37865) - RowGroups rejected: 0 (0) - RowGroups total: 37.87K (37865) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 38.77M (38768521) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 159.74K (159744) - Rows rejected: 0 (0) - Rows total: 38.77M (38768521) Filter 3 (2.00 MB): - Rows processed: 168.96K (168960) - Rows rejected: 0 (0) - Rows total: 38.77M (38768521) Instance 5f429df048b5534b:41bcce1800000024 (host=foo.221.36:22000):(Total: 11m54s, non-child: 11m42s, % non-child: 98.39%) Hdfs split stats (:<# splits>/): 7:4/938.33 MB 2:11/2.64 GB 4:16/3.68 GB 6:13/2.46 GB 1:13/3.13 GB 3:12/2.67 GB 0:15/3.63 GB 5:15/3.63 GB Filter 1 arrival: 1s583ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 85.61 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.38 MB, 124.54 MB, 109.84 MB, 100.76 MB, 88.21 MB, 89.06 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 128.30 MB (134528568) - PerHostPeakMemUsage: 1.36 GB (1456874272) - RowsProduced: 52.91M (52912570) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m32s - TotalStorageWaitTime: 250.629ms - TotalThreadsInvoluntaryContextSwitches: 6.58K (6578) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 6s319ms - TotalThreadsUserTime: 36s386ms - TotalThreadsVoluntaryContextSwitches: 677.55K (677552) Fragment Instance Lifecycle Timings: - ExecTime: 11m54s - ExecTreeExecTime: 5s385ms - OpenTime: 63.326ms - ExecTreeOpenTime: 239.145us - PrepareTime: 42.499ms - ExecTreePrepareTime: 1.032ms DataStreamSender (dst_id=22):(Total: 6s056ms, non-child: 6s056ms, % non-child: 100.00%) - BytesSent: 952.65 MB (998925670) - OverallThroughput: 157.28 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 52.91M (52912570) - SerializeBatchTime: 6s044ms - UncompressedRowBatchSize: 952.65 MB (998925670) CodeGen:(Total: 86.751ms, non-child: 86.751ms, % non-child: 100.00%) - CodegenTime: 1.472ms - CompileTime: 10.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.343ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.128ms HDFS_SCAN_NODE (id=2):(Total: 5s342ms, non-child: 5s342ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:4/938.33 MB 2:11/2.64 GB 4:16/3.68 GB 6:13/2.46 GB 1:13/3.13 GB 3:12/2.67 GB 0:15/3.63 GB 5:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 15 out of 15 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:99.86% 1:0.1404% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:45 BytesRead(16s000ms): 73.45 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 106.84 MB, 178.73 MB, 233.87 MB, 303.97 MB - FooterProcessingTime: (Avg: 1.793ms ; Min: 586.563us ; Max: 6.673ms ; Number of samples: 15) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.91 - BytesRead: 345.82 MB (362621666) - BytesReadDataNodeCache: 0 - BytesReadLocal: 345.82 MB (362621666) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 345.82 MB (362621666) - CachedFileHandlesHitCount: 88 (88) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s535ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 15 (15) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.39 MB (126240473) - PerReadThreadRawHdfsThroughput: 689.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.912ms - RowBatchQueuePutWaitTime: 57m28s - RowsRead: 52.91M (52912570) - RowsReturned: 52.91M (52912570) - RowsReturnedRate: 9.90 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 4.42K (4416) - ScannerThreadsTotalWallClockTime: 58m14s - MaterializeTupleTime(*): 4s402ms - ScannerThreadsSysTime: 5s608ms - ScannerThreadsUserTime: 20s805ms - ScannerThreadsVoluntaryContextSwitches: 661.47K (661472) - TotalRawHdfsReadTime(*): 501.905ms - TotalReadThroughput: 497.36 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 84 (84) - Files total: 99 (99) - RowGroups processed: 51.68K (51679) - RowGroups rejected: 0 (0) - RowGroups total: 51.68K (51679) - Rows processed: 245.76K (245760) - Rows rejected: 0 (0) - Rows total: 52.91M (52912570) - Splits processed: 15 (15) - Splits rejected: 0 (0) - Splits total: 15 (15) Filter 2 (2.00 MB): - Rows processed: 197.63K (197632) - Rows rejected: 0 (0) - Rows total: 52.91M (52912570) Filter 3 (2.00 MB): - Rows processed: 197.63K (197632) - Rows rejected: 0 (0) - Rows total: 52.91M (52912570) Instance 5f429df048b5534b:41bcce1800000006 (host=foo.221.49:22000):(Total: 11m52s, non-child: 11m43s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 3:6/1.35 GB 4:15/3.32 GB 6:15/3.40 GB 1:11/2.45 GB 5:12/2.66 GB 2:8/1.97 GB 0:14/3.40 GB 7:18/4.05 GB Filter 1 arrival: 1s440ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.79 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.28 MB, 134.73 MB, 139.20 MB, 106.60 MB, 91.76 MB, 78.08 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.34 MB (147162065) - PerHostPeakMemUsage: 1.39 GB (1493206787) - RowsProduced: 32.88M (32880500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m36s - TotalStorageWaitTime: 151.819ms - TotalThreadsInvoluntaryContextSwitches: 3.88K (3878) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 4s115ms - TotalThreadsUserTime: 20s933ms - TotalThreadsVoluntaryContextSwitches: 517.13K (517132) Fragment Instance Lifecycle Timings: - ExecTime: 11m52s - ExecTreeExecTime: 5s186ms - OpenTime: 62.964ms - ExecTreeOpenTime: 202.718us - PrepareTime: 28.056ms - ExecTreePrepareTime: 491.455us DataStreamSender (dst_id=22):(Total: 4s209ms, non-child: 4s209ms, % non-child: 100.00%) - BytesSent: 585.65 MB (614095340) - OverallThroughput: 139.12 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.88M (32880500) - SerializeBatchTime: 4s200ms - UncompressedRowBatchSize: 585.65 MB (614095340) CodeGen:(Total: 86.531ms, non-child: 86.531ms, % non-child: 100.00%) - CodegenTime: 1.302ms - CompileTime: 11.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.568ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.045ms HDFS_SCAN_NODE (id=2):(Total: 5s158ms, non-child: 5s158ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:6/1.35 GB 4:15/3.32 GB 6:15/3.40 GB 1:11/2.45 GB 5:12/2.66 GB 2:8/1.97 GB 0:14/3.40 GB 7:18/4.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0% 3:0% 4:0% 5:0.07037% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:27 BytesRead(16s000ms): 79.57 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 119.75 MB, 128.71 MB, 191.50 MB - FooterProcessingTime: (Avg: 1.258ms ; Min: 953.296us ; Max: 2.076ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 215.42 MB (225885443) - BytesReadDataNodeCache: 0 - BytesReadLocal: 215.42 MB (225885443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 215.42 MB (225885443) - CachedFileHandlesHitCount: 54 (54) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 894.473ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828854) - PerReadThreadRawHdfsThroughput: 931.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.011ms - RowBatchQueuePutWaitTime: 57m44s - RowsRead: 32.88M (32880500) - RowsReturned: 32.88M (32880500) - RowsReturnedRate: 6.37 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.12K (2115) - ScannerThreadsTotalWallClockTime: 58m4s - MaterializeTupleTime(*): 2s574ms - ScannerThreadsSysTime: 3s638ms - ScannerThreadsUserTime: 9s714ms - ScannerThreadsVoluntaryContextSwitches: 500.17K (500166) - TotalRawHdfsReadTime(*): 231.357ms - TotalReadThroughput: 310.25 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 90 (90) - Files total: 99 (99) - RowGroups processed: 32.12K (32115) - RowGroups rejected: 0 (0) - RowGroups total: 32.12K (32115) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 32.88M (32880500) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 95.23K (95232) - Rows rejected: 0 (0) - Rows total: 32.88M (32880500) Filter 3 (2.00 MB): - Rows processed: 105.47K (105472) - Rows rejected: 0 (0) - Rows total: 32.88M (32880500) Instance 5f429df048b5534b:41bcce180000001c (host=foo.221.15:22000):(Total: 11m49s, non-child: 11m40s, % non-child: 98.73%) Hdfs split stats (:<# splits>/): 3:9/2.08 GB 5:10/2.46 GB 4:21/5.04 GB 1:11/2.52 GB 6:6/1.43 GB 2:14/3.20 GB 7:12/2.85 GB 0:12/2.82 GB Filter 1 arrival: 1s813ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.92 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.20 MB, 136.48 MB, 140.27 MB, 110.34 MB, 90.69 MB, 79.31 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.29 MB (148150760) - PerHostPeakMemUsage: 1.42 GB (1528716801) - RowsProduced: 28.23M (28228608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m33s - TotalStorageWaitTime: 168.579ms - TotalThreadsInvoluntaryContextSwitches: 2.57K (2572) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 616.903ms - TotalThreadsUserTime: 17s311ms - TotalThreadsVoluntaryContextSwitches: 44.47K (44474) Fragment Instance Lifecycle Timings: - ExecTime: 11m49s - ExecTreeExecTime: 5s148ms - OpenTime: 63.852ms - ExecTreeOpenTime: 188.482us - PrepareTime: 29.352ms - ExecTreePrepareTime: 889.482us DataStreamSender (dst_id=22):(Total: 3s794ms, non-child: 3s794ms, % non-child: 100.00%) - BytesSent: 508.86 MB (533578049) - OverallThroughput: 134.11 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.23M (28228608) - SerializeBatchTime: 3s786ms - UncompressedRowBatchSize: 508.86 MB (533578049) CodeGen:(Total: 87.882ms, non-child: 87.882ms, % non-child: 100.00%) - CodegenTime: 1.372ms - CompileTime: 10.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.639ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.690ms HDFS_SCAN_NODE (id=2):(Total: 5s126ms, non-child: 5s126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/2.08 GB 5:10/2.46 GB 4:21/5.04 GB 1:11/2.52 GB 6:6/1.43 GB 2:14/3.20 GB 7:12/2.85 GB 0:12/2.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s935ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.22 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 133.89 MB, 184.95 MB - FooterProcessingTime: (Avg: 4.133ms ; Min: 739.491us ; Max: 14.371ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 184.95 MB (193936496) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.95 MB (193936496) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.95 MB (193936496) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 775.934ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877386) - PerReadThreadRawHdfsThroughput: 762.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.672ms - RowBatchQueuePutWaitTime: 57m41s - RowsRead: 28.23M (28228608) - RowsReturned: 28.23M (28228608) - RowsReturnedRate: 5.51 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.05K (1053) - ScannerThreadsTotalWallClockTime: 57m49s - MaterializeTupleTime(*): 2s231ms - ScannerThreadsSysTime: 160.972ms - ScannerThreadsUserTime: 7s220ms - ScannerThreadsVoluntaryContextSwitches: 27.84K (27837) - TotalRawHdfsReadTime(*): 242.657ms - TotalReadThroughput: 267.50 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 87 (87) - Files total: 95 (95) - RowGroups processed: 27.57K (27571) - RowGroups rejected: 0 (0) - RowGroups total: 27.57K (27571) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.23M (28228608) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 86.02K (86016) - Rows rejected: 0 (0) - Rows total: 28.23M (28228608) Filter 3 (2.00 MB): - Rows processed: 82.94K (82944) - Rows rejected: 0 (0) - Rows total: 28.23M (28228608) Instance 5f429df048b5534b:41bcce1800000053 (host=foo.221.17:22000):(Total: 11m49s, non-child: 11m38s, % non-child: 98.47%) Hdfs split stats (:<# splits>/): 2:8/1.97 GB 7:21/4.91 GB 4:7/1.66 GB 5:13/3.08 GB 3:15/3.54 GB 6:7/1.66 GB 0:13/3.13 GB 1:11/2.64 GB Filter 1 arrival: 1s752ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.97 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 134.72 MB, 135.12 MB, 135.66 MB, 102.56 MB, 100.32 MB, 96.06 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.48 MB (147305040) - PerHostPeakMemUsage: 1.43 GB (1532785948) - RowsProduced: 46.48M (46483558) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m29s - TotalStorageWaitTime: 335.395ms - TotalThreadsInvoluntaryContextSwitches: 4.53K (4530) - TotalThreadsTotalWallClockTime: 1h10m - TotalThreadsSysTime: 1s327ms - TotalThreadsUserTime: 24s906ms - TotalThreadsVoluntaryContextSwitches: 110.42K (110423) Fragment Instance Lifecycle Timings: - ExecTime: 11m49s - ExecTreeExecTime: 5s240ms - OpenTime: 67.523ms - ExecTreeOpenTime: 175.370us - PrepareTime: 43.191ms - ExecTreePrepareTime: 1.755ms DataStreamSender (dst_id=22):(Total: 5s571ms, non-child: 5s571ms, % non-child: 100.00%) - BytesSent: 839.36 MB (880128871) - OverallThroughput: 150.66 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 46.48M (46483558) - SerializeBatchTime: 5s558ms - UncompressedRowBatchSize: 839.36 MB (880128871) CodeGen:(Total: 97.150ms, non-child: 97.150ms, % non-child: 100.00%) - CodegenTime: 1.410ms - CompileTime: 10.123ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.264ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 30.246ms HDFS_SCAN_NODE (id=2):(Total: 5s207ms, non-child: 5s207ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:8/1.97 GB 7:21/4.91 GB 4:7/1.66 GB 5:13/3.08 GB 3:15/3.54 GB 6:7/1.66 GB 0:13/3.13 GB 1:11/2.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:39 BytesRead(16s000ms): 82.26 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 119.66 MB, 149.55 MB, 215.30 MB, 282.02 MB - FooterProcessingTime: (Avg: 2.554ms ; Min: 547.811us ; Max: 11.325ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 304.25 MB (319033663) - BytesReadDataNodeCache: 0 - BytesReadLocal: 304.25 MB (319033663) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 304.25 MB (319033663) - CachedFileHandlesHitCount: 77 (77) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s362ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828603) - PerReadThreadRawHdfsThroughput: 755.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.114ms - RowBatchQueuePutWaitTime: 57m46s - RowsRead: 46.48M (46483558) - RowsReturned: 46.48M (46483558) - RowsReturnedRate: 8.93 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.54K (2541) - ScannerThreadsTotalWallClockTime: 58m15s - MaterializeTupleTime(*): 3s873ms - ScannerThreadsSysTime: 636.901ms - ScannerThreadsUserTime: 10s835ms - ScannerThreadsVoluntaryContextSwitches: 93.78K (93779) - TotalRawHdfsReadTime(*): 402.597ms - TotalReadThroughput: 439.74 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 82 (82) - Files total: 95 (95) - RowGroups processed: 45.40K (45399) - RowGroups rejected: 0 (0) - RowGroups total: 45.40K (45399) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 46.48M (46483558) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 188.42K (188416) - Rows rejected: 0 (0) - Rows total: 46.48M (46483558) Filter 3 (2.00 MB): - Rows processed: 182.27K (182272) - Rows rejected: 0 (0) - Rows total: 46.48M (46483558) Instance 5f429df048b5534b:41bcce180000001f (host=foo.232.27:22000):(Total: 11m47s, non-child: 11m38s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 2:8/1.85 GB 0:14/3.45 GB 5:13/3.00 GB 1:13/3.01 GB 6:10/2.25 GB 4:12/2.89 GB 3:16/3.90 GB 7:9/2.08 GB Filter 1 arrival: 1s156ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 87.02 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.42 MB, 126.71 MB, 109.61 MB, 95.29 MB, 88.78 MB, 62.80 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5 - AverageThreadTokens: 5.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 130.78 MB (137135781) - PerHostPeakMemUsage: 1.34 GB (1442870921) - RowsProduced: 37.31M (37313469) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m30s - TotalStorageWaitTime: 216.693ms - TotalThreadsInvoluntaryContextSwitches: 6.04K (6040) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 6s267ms - TotalThreadsUserTime: 37s751ms - TotalThreadsVoluntaryContextSwitches: 467.65K (467649) Fragment Instance Lifecycle Timings: - ExecTime: 11m47s - ExecTreeExecTime: 5s192ms - OpenTime: 70.650ms - ExecTreeOpenTime: 249.946us - PrepareTime: 29.924ms - ExecTreePrepareTime: 1.616ms DataStreamSender (dst_id=22):(Total: 4s442ms, non-child: 4s442ms, % non-child: 100.00%) - BytesSent: 670.36 MB (702920011) - OverallThroughput: 150.90 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.31M (37313469) - SerializeBatchTime: 4s431ms - UncompressedRowBatchSize: 670.36 MB (702920011) CodeGen:(Total: 93.466ms, non-child: 93.466ms, % non-child: 100.00%) - CodegenTime: 1.316ms - CompileTime: 10.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 58.730ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.298ms HDFS_SCAN_NODE (id=2):(Total: 5s166ms, non-child: 5s166ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:8/1.85 GB 0:14/3.45 GB 5:13/3.00 GB 1:13/3.01 GB 6:10/2.25 GB 4:12/2.89 GB 3:16/3.90 GB 7:9/2.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s922ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:33 BytesRead(16s000ms): 74.13 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 107.83 MB, 163.81 MB, 202.92 MB, 235.02 MB - FooterProcessingTime: (Avg: 1.626ms ; Min: 636.622us ; Max: 3.538ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 243.97 MB (255823385) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.97 MB (255823385) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.97 MB (255823385) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s086ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.90 MB (128867517) - PerReadThreadRawHdfsThroughput: 801.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.962ms - RowBatchQueuePutWaitTime: 56m58s - RowsRead: 37.31M (37313469) - RowsReturned: 37.31M (37313469) - RowsReturnedRate: 7.22 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 4.36K (4364) - ScannerThreadsTotalWallClockTime: 57m34s - MaterializeTupleTime(*): 3s147ms - ScannerThreadsSysTime: 5s725ms - ScannerThreadsUserTime: 26s383ms - ScannerThreadsVoluntaryContextSwitches: 451.90K (451897) - TotalRawHdfsReadTime(*): 304.292ms - TotalReadThroughput: 353.61 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 84 (84) - Files total: 95 (95) - RowGroups processed: 36.44K (36444) - RowGroups rejected: 0 (0) - RowGroups total: 36.44K (36444) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.31M (37313469) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 135.48K (135479) - Rows rejected: 0 (0) - Rows total: 37.31M (37313469) Filter 3 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 37.31M (37313469) Instance 5f429df048b5534b:41bcce180000005d (host=foo.232.50:22000):(Total: 11m47s, non-child: 11m38s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 3:11/2.65 GB 4:11/2.54 GB 1:13/2.72 GB 6:7/1.73 GB 7:15/3.50 GB 2:16/3.88 GB 0:13/2.81 GB 5:11/2.71 GB Filter 1 arrival: 371ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 57.21 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 82.80 MB, 83.88 MB, 75.51 MB, 76.56 MB, 69.95 MB, 59.01 MB ThreadUsage(16s000ms): 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4 - AverageThreadTokens: 4.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 89.42 MB (93760696) - PerHostPeakMemUsage: 1.33 GB (1430724863) - RowsProduced: 36.86M (36860476) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m30s - TotalStorageWaitTime: 206.663ms - TotalThreadsInvoluntaryContextSwitches: 4.62K (4624) - TotalThreadsTotalWallClockTime: 57m32s - TotalThreadsSysTime: 910.859ms - TotalThreadsUserTime: 28s841ms - TotalThreadsVoluntaryContextSwitches: 73.96K (73960) Fragment Instance Lifecycle Timings: - ExecTime: 11m47s - ExecTreeExecTime: 5s201ms - OpenTime: 63.214ms - ExecTreeOpenTime: 175.637us - PrepareTime: 34.628ms - ExecTreePrepareTime: 1.003ms DataStreamSender (dst_id=22):(Total: 4s544ms, non-child: 4s544ms, % non-child: 100.00%) - BytesSent: 658.32 MB (690301194) - OverallThroughput: 144.85 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.86M (36860476) - SerializeBatchTime: 4s535ms - UncompressedRowBatchSize: 658.32 MB (690301194) CodeGen:(Total: 90.668ms, non-child: 90.668ms, % non-child: 100.00%) - CodegenTime: 1.399ms - CompileTime: 9.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.962ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.942ms HDFS_SCAN_NODE (id=2):(Total: 5s175ms, non-child: 5s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:11/2.65 GB 4:11/2.54 GB 1:13/2.72 GB 6:7/1.73 GB 7:15/3.50 GB 2:16/3.88 GB 0:13/2.81 GB 5:11/2.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:36 BytesRead(16s000ms): 47.80 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 69.53 MB, 89.58 MB, 161.24 MB, 191.86 MB, 241.00 MB - FooterProcessingTime: (Avg: 1.790ms ; Min: 748.367us ; Max: 3.468ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 241.00 MB (252705053) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.00 MB (252705053) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.00 MB (252705053) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s060ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 82.39 MB (86394066) - PerReadThreadRawHdfsThroughput: 865.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.890ms - RowBatchQueuePutWaitTime: 45m27s - RowsRead: 36.86M (36860476) - RowsReturned: 36.86M (36860476) - RowsReturnedRate: 7.12 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.85K (2854) - ScannerThreadsTotalWallClockTime: 45m45s - MaterializeTupleTime(*): 3s111ms - ScannerThreadsSysTime: 399.937ms - ScannerThreadsUserTime: 17s359ms - ScannerThreadsVoluntaryContextSwitches: 58.22K (58221) - TotalRawHdfsReadTime(*): 278.515ms - TotalReadThroughput: 349.55 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 85 (85) - Files total: 97 (97) - RowGroups processed: 36.00K (36002) - RowGroups rejected: 0 (0) - RowGroups total: 36.00K (36002) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 36.86M (36860476) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 168.96K (168960) - Rows rejected: 0 (0) - Rows total: 36.86M (36860476) Filter 3 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 36.86M (36860476) Instance 5f429df048b5534b:41bcce1800000079 (host=foo.232.35:22000):(Total: 11m47s, non-child: 11m37s, % non-child: 98.58%) Hdfs split stats (:<# splits>/): 1:8/1.63 GB 4:10/2.19 GB 5:11/2.71 GB 3:10/2.46 GB 2:10/2.46 GB 7:12/2.83 GB 6:18/4.12 GB 0:18/4.30 GB Filter 1 arrival: 992ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.52 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.04 MB, 134.71 MB, 121.79 MB, 91.65 MB, 93.68 MB, 65.14 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.35 MB (147171037) - PerHostPeakMemUsage: 1.30 GB (1400725701) - RowsProduced: 38.84M (38844247) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m29s - TotalStorageWaitTime: 272.703ms - TotalThreadsInvoluntaryContextSwitches: 5.49K (5492) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 4s719ms - TotalThreadsUserTime: 36s123ms - TotalThreadsVoluntaryContextSwitches: 420.11K (420113) Fragment Instance Lifecycle Timings: - ExecTime: 11m47s - ExecTreeExecTime: 5s235ms - OpenTime: 57.722ms - ExecTreeOpenTime: 203.033us - PrepareTime: 29.993ms - ExecTreePrepareTime: 680.575us DataStreamSender (dst_id=22):(Total: 4s771ms, non-child: 4s771ms, % non-child: 100.00%) - BytesSent: 698.16 MB (732073454) - OverallThroughput: 146.32 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.84M (38844247) - SerializeBatchTime: 4s761ms - UncompressedRowBatchSize: 698.16 MB (732073454) CodeGen:(Total: 78.096ms, non-child: 78.096ms, % non-child: 100.00%) - CodegenTime: 1.334ms - CompileTime: 9.058ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 47.669ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 20.848ms HDFS_SCAN_NODE (id=2):(Total: 5s204ms, non-child: 5s204ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:8/1.63 GB 4:10/2.19 GB 5:11/2.71 GB 3:10/2.46 GB 2:10/2.46 GB 7:12/2.83 GB 6:18/4.12 GB 0:18/4.30 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.75 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 113.09 MB, 157.67 MB, 211.85 MB, 248.16 MB - FooterProcessingTime: (Avg: 1.578ms ; Min: 641.944us ; Max: 3.087ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 254.13 MB (266479705) - BytesReadDataNodeCache: 0 - BytesReadLocal: 254.13 MB (266479705) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 254.13 MB (266479705) - CachedFileHandlesHitCount: 67 (67) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s137ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828471) - PerReadThreadRawHdfsThroughput: 703.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.029ms - RowBatchQueuePutWaitTime: 57m8s - RowsRead: 38.84M (38844247) - RowsReturned: 38.84M (38844247) - RowsReturnedRate: 7.46 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.82K (3820) - ScannerThreadsTotalWallClockTime: 57m40s - MaterializeTupleTime(*): 3s297ms - ScannerThreadsSysTime: 4s112ms - ScannerThreadsUserTime: 24s213ms - ScannerThreadsVoluntaryContextSwitches: 404.56K (404556) - TotalRawHdfsReadTime(*): 361.283ms - TotalReadThroughput: 368.60 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 85 (85) - Files total: 97 (97) - RowGroups processed: 37.94K (37940) - RowGroups rejected: 0 (0) - RowGroups total: 37.94K (37940) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 38.84M (38844247) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 157.70K (157696) - Rows rejected: 0 (0) - Rows total: 38.84M (38844247) Filter 3 (2.00 MB): - Rows processed: 157.70K (157696) - Rows rejected: 0 (0) - Rows total: 38.84M (38844247) Instance 5f429df048b5534b:41bcce180000004b (host=foo.232.42:22000):(Total: 11m45s, non-child: 11m35s, % non-child: 98.57%) Hdfs split stats (:<# splits>/): 3:17/4.06 GB 0:11/2.68 GB 7:10/2.33 GB 2:9/2.08 GB 1:10/2.35 GB 4:13/3.01 GB 5:10/2.42 GB 6:15/3.63 GB Filter 1 arrival: 732ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.26 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 133.83 MB, 134.51 MB, 116.49 MB, 86.81 MB, 74.24 MB, 72.14 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4 - AverageThreadTokens: 5.84 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.39 MB (147209686) - PerHostPeakMemUsage: 1.22 GB (1314224634) - RowsProduced: 39.18M (39183180) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m28s - TotalStorageWaitTime: 244.257ms - TotalThreadsInvoluntaryContextSwitches: 3.41K (3408) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 902.860ms - TotalThreadsUserTime: 18s142ms - TotalThreadsVoluntaryContextSwitches: 58.55K (58555) Fragment Instance Lifecycle Timings: - ExecTime: 11m45s - ExecTreeExecTime: 5s203ms - OpenTime: 78.169ms - ExecTreeOpenTime: 163.429us - PrepareTime: 34.045ms - ExecTreePrepareTime: 1.132ms DataStreamSender (dst_id=22):(Total: 4s800ms, non-child: 4s800ms, % non-child: 100.00%) - BytesSent: 705.29 MB (739547048) - OverallThroughput: 146.92 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.18M (39183180) - SerializeBatchTime: 4s789ms - UncompressedRowBatchSize: 705.29 MB (739547048) CodeGen:(Total: 104.842ms, non-child: 104.842ms, % non-child: 100.00%) - CodegenTime: 1.626ms - CompileTime: 11.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 65.544ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.136ms HDFS_SCAN_NODE (id=2):(Total: 5s177ms, non-child: 5s177ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:17/4.06 GB 0:11/2.68 GB 7:10/2.33 GB 2:9/2.08 GB 1:10/2.35 GB 4:13/3.01 GB 5:10/2.42 GB 6:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.07087% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.64 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 112.93 MB, 163.72 MB, 210.28 MB, 256.43 MB - FooterProcessingTime: (Avg: 2.031ms ; Min: 907.309us ; Max: 3.738ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 256.43 MB (268886179) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.43 MB (268886179) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.43 MB (268886179) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s154ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828874) - PerReadThreadRawHdfsThroughput: 696.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.559ms - RowBatchQueuePutWaitTime: 56m42s - RowsRead: 39.18M (39183180) - RowsReturned: 39.18M (39183180) - RowsReturnedRate: 7.57 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1685) - ScannerThreadsTotalWallClockTime: 56m52s - MaterializeTupleTime(*): 3s368ms - ScannerThreadsSysTime: 273.956ms - ScannerThreadsUserTime: 5s932ms - ScannerThreadsVoluntaryContextSwitches: 42.91K (42910) - TotalRawHdfsReadTime(*): 367.985ms - TotalReadThroughput: 372.20 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 84 (84) - Files total: 95 (95) - RowGroups processed: 38.27K (38271) - RowGroups rejected: 0 (0) - RowGroups total: 38.27K (38271) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.18M (39183180) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 126.98K (126976) - Rows rejected: 0 (0) - Rows total: 39.18M (39183180) Filter 3 (2.00 MB): - Rows processed: 157.70K (157696) - Rows rejected: 0 (0) - Rows total: 39.18M (39183180) Instance 5f429df048b5534b:41bcce180000001b (host=foo.221.14:22000):(Total: 11m45s, non-child: 11m35s, % non-child: 98.56%) Hdfs split stats (:<# splits>/): 6:8/1.97 GB 3:15/3.63 GB 7:9/2.22 GB 2:10/2.42 GB 0:10/2.33 GB 1:18/4.16 GB 4:13/3.14 GB 5:12/2.78 GB Filter 1 arrival: 1s943ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 87.43 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.82 MB, 132.93 MB, 122.30 MB, 99.28 MB, 84.66 MB, 79.49 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.18 MB (144897292) - PerHostPeakMemUsage: 1.25 GB (1338050302) - RowsProduced: 41.84M (41843076) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m27s - TotalStorageWaitTime: 217.733ms - TotalThreadsInvoluntaryContextSwitches: 5.59K (5589) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 1s936ms - TotalThreadsUserTime: 37s619ms - TotalThreadsVoluntaryContextSwitches: 126.51K (126510) Fragment Instance Lifecycle Timings: - ExecTime: 11m45s - ExecTreeExecTime: 5s196ms - OpenTime: 72.232ms - ExecTreeOpenTime: 208.354us - PrepareTime: 39.197ms - ExecTreePrepareTime: 1.100ms DataStreamSender (dst_id=22):(Total: 4s921ms, non-child: 4s921ms, % non-child: 100.00%) - BytesSent: 754.20 MB (790839625) - OverallThroughput: 153.25 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.84M (41843076) - SerializeBatchTime: 4s911ms - UncompressedRowBatchSize: 754.20 MB (790839625) CodeGen:(Total: 101.347ms, non-child: 101.347ms, % non-child: 100.00%) - CodegenTime: 1.419ms - CompileTime: 11.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 59.670ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.764ms HDFS_SCAN_NODE (id=2):(Total: 5s168ms, non-child: 5s168ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:8/1.97 GB 3:15/3.63 GB 7:9/2.22 GB 2:10/2.42 GB 0:10/2.33 GB 1:18/4.16 GB 4:13/3.14 GB 5:12/2.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:36 BytesRead(16s000ms): 73.33 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 106.67 MB, 172.40 MB, 211.25 MB, 274.12 MB - FooterProcessingTime: (Avg: 1.951ms ; Min: 605.839us ; Max: 4.782ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 274.12 MB (287432170) - BytesReadDataNodeCache: 0 - BytesReadLocal: 274.12 MB (287432170) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 274.12 MB (287432170) - CachedFileHandlesHitCount: 70 (70) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s226ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.40 MB (136731700) - PerReadThreadRawHdfsThroughput: 812.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.174ms - RowBatchQueuePutWaitTime: 57m7s - RowsRead: 41.84M (41843076) - RowsReturned: 41.84M (41843076) - RowsReturnedRate: 8.10 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 3.82K (3820) - ScannerThreadsTotalWallClockTime: 57m34s - MaterializeTupleTime(*): 3s497ms - ScannerThreadsSysTime: 1s392ms - ScannerThreadsUserTime: 25s033ms - ScannerThreadsVoluntaryContextSwitches: 110.69K (110691) - TotalRawHdfsReadTime(*): 337.306ms - TotalReadThroughput: 398.15 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 83 (83) - Files total: 95 (95) - RowGroups processed: 40.87K (40869) - RowGroups rejected: 0 (0) - RowGroups total: 40.87K (40869) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 41.84M (41843076) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 169.98K (169984) - Rows rejected: 0 (0) - Rows total: 41.84M (41843076) Filter 3 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 41.84M (41843076) Instance 5f429df048b5534b:41bcce1800000061 (host=foo.232.46:22000):(Total: 11m43s, non-child: 11m33s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 2:7/1.59 GB 3:16/3.68 GB 1:13/2.80 GB 6:10/2.35 GB 0:14/3.25 GB 5:18/4.16 GB 7:11/2.71 GB 4:8/1.87 GB Filter 1 arrival: 783ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.30 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 130.12 MB, 118.00 MB, 78.34 MB, 65.72 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.83 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 134.40 MB (140930986) - PerHostPeakMemUsage: 1.27 GB (1359098584) - RowsProduced: 37.07M (37067662) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m26s - TotalStorageWaitTime: 254.321ms - TotalThreadsInvoluntaryContextSwitches: 3.33K (3327) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 807.875ms - TotalThreadsUserTime: 20s092ms - TotalThreadsVoluntaryContextSwitches: 52.59K (52592) Fragment Instance Lifecycle Timings: - ExecTime: 11m43s - ExecTreeExecTime: 5s202ms - OpenTime: 60.637ms - ExecTreeOpenTime: 199.196us - PrepareTime: 35.118ms - ExecTreePrepareTime: 811.313us DataStreamSender (dst_id=22):(Total: 4s529ms, non-child: 4s529ms, % non-child: 100.00%) - BytesSent: 666.32 MB (698682506) - OverallThroughput: 147.10 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.07M (37067662) - SerializeBatchTime: 4s519ms - UncompressedRowBatchSize: 666.32 MB (698682506) CodeGen:(Total: 90.184ms, non-child: 90.184ms, % non-child: 100.00%) - CodegenTime: 1.545ms - CompileTime: 9.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.838ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 30.234ms HDFS_SCAN_NODE (id=2):(Total: 5s173ms, non-child: 5s173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:7/1.59 GB 3:16/3.68 GB 1:13/2.80 GB 6:10/2.35 GB 0:14/3.25 GB 5:18/4.16 GB 7:11/2.71 GB 4:8/1.87 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0% 3:0.07112% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 72.45 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 105.86 MB, 150.69 MB, 189.82 MB - FooterProcessingTime: (Avg: 4.419ms ; Min: 815.807us ; Max: 19.290ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 242.80 MB (254590108) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.80 MB (254590108) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.80 MB (254590108) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s083ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.40 MB (132537378) - PerReadThreadRawHdfsThroughput: 865.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.668ms - RowBatchQueuePutWaitTime: 56m31s - RowsRead: 37.07M (37067662) - RowsReturned: 37.07M (37067662) - RowsReturnedRate: 7.16 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1680) - ScannerThreadsTotalWallClockTime: 56m40s - MaterializeTupleTime(*): 3s103ms - ScannerThreadsSysTime: 243.961ms - ScannerThreadsUserTime: 8s446ms - ScannerThreadsVoluntaryContextSwitches: 36.72K (36720) - TotalRawHdfsReadTime(*): 280.680ms - TotalReadThroughput: 353.41 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 36.20K (36203) - RowGroups rejected: 0 (0) - RowGroups total: 36.20K (36203) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.07M (37067662) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 124.93K (124928) - Rows rejected: 0 (0) - Rows total: 37.07M (37067662) Filter 3 (2.00 MB): - Rows processed: 109.57K (109568) - Rows rejected: 0 (0) - Rows total: 37.07M (37067662) Instance 5f429df048b5534b:41bcce1800000047 (host=foo.232.24:22000):(Total: 11m43s, non-child: 11m34s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 2:15/3.41 GB 0:10/2.06 GB 5:16/3.87 GB 4:9/2.15 GB 7:10/2.47 GB 6:15/3.66 GB 1:11/2.51 GB 3:11/2.38 GB Filter 1 arrival: 1s295ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.86 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.56 MB, 130.87 MB, 117.64 MB, 104.34 MB, 90.10 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.89 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.08 MB (141638415) - PerHostPeakMemUsage: 1.32 GB (1416421510) - RowsProduced: 35.39M (35387886) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m27s - TotalStorageWaitTime: 244.777ms - TotalThreadsInvoluntaryContextSwitches: 5.49K (5494) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 8s043ms - TotalThreadsUserTime: 31s546ms - TotalThreadsVoluntaryContextSwitches: 800.66K (800662) Fragment Instance Lifecycle Timings: - ExecTime: 11m43s - ExecTreeExecTime: 5s187ms - OpenTime: 61.943ms - ExecTreeOpenTime: 166.315us - PrepareTime: 26.422ms - ExecTreePrepareTime: 505.787us DataStreamSender (dst_id=22):(Total: 4s251ms, non-child: 4s251ms, % non-child: 100.00%) - BytesSent: 633.94 MB (664732281) - OverallThroughput: 149.12 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.39M (35387886) - SerializeBatchTime: 4s242ms - UncompressedRowBatchSize: 633.94 MB (664732281) CodeGen:(Total: 80.963ms, non-child: 80.963ms, % non-child: 100.00%) - CodegenTime: 1.230ms - CompileTime: 9.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.945ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 19.504ms HDFS_SCAN_NODE (id=2):(Total: 5s160ms, non-child: 5s160ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:15/3.41 GB 0:10/2.06 GB 5:16/3.87 GB 4:9/2.15 GB 7:10/2.47 GB 6:15/3.66 GB 1:11/2.51 GB 3:11/2.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.14 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 112.20 MB, 183.96 MB, 207.87 MB - FooterProcessingTime: (Avg: 1.621ms ; Min: 739.584us ; Max: 3.021ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 231.75 MB (243009585) - BytesReadDataNodeCache: 0 - BytesReadLocal: 231.75 MB (243009585) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 231.75 MB (243009585) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s038ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585975) - PerReadThreadRawHdfsThroughput: 672.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.871ms - RowBatchQueuePutWaitTime: 56m50s - RowsRead: 35.39M (35387886) - RowsReturned: 35.39M (35387886) - RowsReturnedRate: 6.86 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.95K (3954) - ScannerThreadsTotalWallClockTime: 57m20s - MaterializeTupleTime(*): 2s956ms - ScannerThreadsSysTime: 7s545ms - ScannerThreadsUserTime: 20s486ms - ScannerThreadsVoluntaryContextSwitches: 784.83K (784832) - TotalRawHdfsReadTime(*): 344.514ms - TotalReadThroughput: 338.05 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 34.56K (34564) - RowGroups rejected: 0 (0) - RowGroups total: 34.56K (34564) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.39M (35387886) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 135.17K (135168) - Rows rejected: 0 (0) - Rows total: 35.39M (35387886) Filter 3 (2.00 MB): - Rows processed: 113.66K (113664) - Rows rejected: 0 (0) - Rows total: 35.39M (35387886) Instance 5f429df048b5534b:41bcce1800000077 (host=foo.221.29:22000):(Total: 11m42s, non-child: 11m32s, % non-child: 98.53%) Hdfs split stats (:<# splits>/): 0:6/1.33 GB 1:8/1.97 GB 7:11/2.71 GB 3:17/4.05 GB 4:13/3.13 GB 2:10/2.47 GB 5:17/3.99 GB 6:13/2.93 GB Filter 1 arrival: 1s679ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 82.96 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.31 MB, 120.73 MB, 107.22 MB, 96.34 MB, 96.90 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 125.42 MB (131515899) - PerHostPeakMemUsage: 1.22 GB (1307896255) - RowsProduced: 43.51M (43508939) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 289.439ms - TotalThreadsInvoluntaryContextSwitches: 3.99K (3988) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 2s139ms - TotalThreadsUserTime: 20s822ms - TotalThreadsVoluntaryContextSwitches: 160.49K (160486) Fragment Instance Lifecycle Timings: - ExecTime: 11m42s - ExecTreeExecTime: 5s216ms - OpenTime: 71.762ms - ExecTreeOpenTime: 266.825us - PrepareTime: 33.442ms - ExecTreePrepareTime: 1.030ms DataStreamSender (dst_id=22):(Total: 5s016ms, non-child: 5s016ms, % non-child: 100.00%) - BytesSent: 783.89 MB (821970734) - OverallThroughput: 156.25 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 43.51M (43508939) - SerializeBatchTime: 5s006ms - UncompressedRowBatchSize: 783.89 MB (821970734) CodeGen:(Total: 99.321ms, non-child: 99.321ms, % non-child: 100.00%) - CodegenTime: 1.437ms - CompileTime: 10.305ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.321ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.171ms HDFS_SCAN_NODE (id=2):(Total: 5s188ms, non-child: 5s188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:6/1.33 GB 1:8/1.97 GB 7:11/2.71 GB 3:17/4.05 GB 4:13/3.13 GB 2:10/2.47 GB 5:17/3.99 GB 6:13/2.93 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s919ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:39 BytesRead(16s000ms): 64.48 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 93.79 MB, 104.25 MB, 186.46 MB, 240.27 MB - FooterProcessingTime: (Avg: 2.589ms ; Min: 839.494us ; Max: 5.900ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.92 - BytesRead: 285.07 MB (298921807) - BytesReadDataNodeCache: 0 - BytesReadLocal: 285.07 MB (298921807) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 285.07 MB (298921807) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s265ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 117.39 MB (123094758) - PerReadThreadRawHdfsThroughput: 827.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.150ms - RowBatchQueuePutWaitTime: 57m - RowsRead: 43.51M (43508939) - RowsReturned: 43.51M (43508939) - RowsReturnedRate: 8.39 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.27K (2271) - ScannerThreadsTotalWallClockTime: 57m28s - MaterializeTupleTime(*): 3s631ms - ScannerThreadsSysTime: 1s557ms - ScannerThreadsUserTime: 8s121ms - ScannerThreadsVoluntaryContextSwitches: 145.00K (145004) - TotalRawHdfsReadTime(*): 344.322ms - TotalReadThroughput: 416.43 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 82 (82) - Files total: 95 (95) - RowGroups processed: 42.49K (42495) - RowGroups rejected: 0 (0) - RowGroups total: 42.49K (42495) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 43.51M (43508939) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 172.03K (172032) - Rows rejected: 0 (0) - Rows total: 43.51M (43508939) Filter 3 (2.00 MB): - Rows processed: 172.03K (172032) - Rows rejected: 0 (0) - Rows total: 43.51M (43508939) Instance 5f429df048b5534b:41bcce1800000058 (host=foo.221.51:22000):(Total: 11m41s, non-child: 11m29s, % non-child: 98.41%) Hdfs split stats (:<# splits>/): 5:10/2.46 GB 1:10/2.16 GB 7:11/2.57 GB 4:15/3.63 GB 6:11/2.57 GB 3:13/2.80 GB 0:11/2.71 GB 2:16/3.94 GB Filter 1 arrival: 1s410ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 94.24 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 136.89 MB, 137.18 MB, 120.30 MB, 94.78 MB, 100.19 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.90 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.41 MB (148274685) - PerHostPeakMemUsage: 1.34 GB (1434765277) - RowsProduced: 50.12M (50121636) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m20s - TotalStorageWaitTime: 305.308ms - TotalThreadsInvoluntaryContextSwitches: 5.04K (5038) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 4s139ms - TotalThreadsUserTime: 25s802ms - TotalThreadsVoluntaryContextSwitches: 440.55K (440550) Fragment Instance Lifecycle Timings: - ExecTime: 11m40s - ExecTreeExecTime: 5s237ms - OpenTime: 69.205ms - ExecTreeOpenTime: 191.442us - PrepareTime: 46.968ms - ExecTreePrepareTime: 871.238us DataStreamSender (dst_id=22):(Total: 5s818ms, non-child: 5s818ms, % non-child: 100.00%) - BytesSent: 902.01 MB (945829999) - OverallThroughput: 155.03 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 50.12M (50121636) - SerializeBatchTime: 5s805ms - UncompressedRowBatchSize: 902.01 MB (945829999) CodeGen:(Total: 103.427ms, non-child: 103.427ms, % non-child: 100.00%) - CodegenTime: 1.442ms - CompileTime: 13.577ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.362ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 34.932ms HDFS_SCAN_NODE (id=2):(Total: 5s203ms, non-child: 5s203ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:10/2.46 GB 1:10/2.16 GB 7:11/2.57 GB 4:15/3.63 GB 6:11/2.57 GB 3:13/2.80 GB 0:11/2.71 GB 2:16/3.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s915ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:42 BytesRead(16s000ms): 82.20 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 198.75 MB, 283.01 MB - FooterProcessingTime: (Avg: 1.817ms ; Min: 793.982us ; Max: 3.883ms ; Number of samples: 14) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 327.83 MB (343752530) - BytesReadDataNodeCache: 0 - BytesReadLocal: 327.83 MB (343752530) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 327.83 MB (343752530) - CachedFileHandlesHitCount: 83 (83) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s448ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 14 (14) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877395) - PerReadThreadRawHdfsThroughput: 669.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.729ms - RowBatchQueuePutWaitTime: 57m3s - RowsRead: 50.12M (50121636) - RowsReturned: 50.12M (50121636) - RowsReturnedRate: 9.63 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.00K (2995) - ScannerThreadsTotalWallClockTime: 57m17s - MaterializeTupleTime(*): 4s128ms - ScannerThreadsSysTime: 3s481ms - ScannerThreadsUserTime: 10s973ms - ScannerThreadsVoluntaryContextSwitches: 424.31K (424305) - TotalRawHdfsReadTime(*): 489.675ms - TotalReadThroughput: 479.22 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 83 (83) - Files total: 97 (97) - RowGroups processed: 48.95K (48955) - RowGroups rejected: 0 (0) - RowGroups total: 48.95K (48955) - Rows processed: 229.38K (229376) - Rows rejected: 0 (0) - Rows total: 50.12M (50121636) - Splits processed: 14 (14) - Splits rejected: 0 (0) - Splits total: 14 (14) Filter 2 (2.00 MB): - Rows processed: 194.56K (194560) - Rows rejected: 0 (0) - Rows total: 50.12M (50121636) Filter 3 (2.00 MB): - Rows processed: 201.04K (201042) - Rows rejected: 0 (0) - Rows total: 50.12M (50121636) Instance 5f429df048b5534b:41bcce1800000059 (host=foo.221.11:22000):(Total: 11m40s, non-child: 11m31s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 4:14/3.24 GB 5:16/3.57 GB 0:11/2.43 GB 2:10/2.42 GB 3:17/3.79 GB 7:6/1.41 GB 1:9/2.02 GB 6:15/3.63 GB Filter 1 arrival: 1s808ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 86.38 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.24 MB, 125.45 MB, 121.73 MB, 93.74 MB, 92.69 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 130.34 MB (136674298) - PerHostPeakMemUsage: 1.39 GB (1488551165) - RowsProduced: 38.81M (38810073) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 235.905ms - TotalThreadsInvoluntaryContextSwitches: 5.36K (5359) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 4s839ms - TotalThreadsUserTime: 34s147ms - TotalThreadsVoluntaryContextSwitches: 395.33K (395331) Fragment Instance Lifecycle Timings: - ExecTime: 11m40s - ExecTreeExecTime: 5s179ms - OpenTime: 61.975ms - ExecTreeOpenTime: 215.473us - PrepareTime: 37.449ms - ExecTreePrepareTime: 1.176ms DataStreamSender (dst_id=22):(Total: 4s520ms, non-child: 4s520ms, % non-child: 100.00%) - BytesSent: 698.09 MB (731999312) - OverallThroughput: 154.43 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.81M (38810073) - SerializeBatchTime: 4s510ms - UncompressedRowBatchSize: 698.09 MB (731999312) CodeGen:(Total: 88.560ms, non-child: 88.560ms, % non-child: 100.00%) - CodegenTime: 1.415ms - CompileTime: 9.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.887ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.212ms HDFS_SCAN_NODE (id=2):(Total: 5s155ms, non-child: 5s155ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:14/3.24 GB 5:16/3.57 GB 0:11/2.43 GB 2:10/2.42 GB 3:17/3.79 GB 7:6/1.41 GB 1:9/2.02 GB 6:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s922ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.07143% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:36 BytesRead(16s000ms): 72.68 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 105.71 MB, 149.65 MB, 208.22 MB - FooterProcessingTime: (Avg: 1.820ms ; Min: 623.339us ; Max: 3.944ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.91 - BytesRead: 253.92 MB (266250049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.92 MB (266250049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.92 MB (266250049) - CachedFileHandlesHitCount: 68 (68) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s105ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.40 MB (128343133) - PerReadThreadRawHdfsThroughput: 766.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.461ms - RowBatchQueuePutWaitTime: 56m50s - RowsRead: 38.81M (38810073) - RowsReturned: 38.81M (38810073) - RowsReturnedRate: 7.53 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 3.67K (3667) - ScannerThreadsTotalWallClockTime: 57m17s - MaterializeTupleTime(*): 3s164ms - ScannerThreadsSysTime: 4s255ms - ScannerThreadsUserTime: 22s462ms - ScannerThreadsVoluntaryContextSwitches: 378.93K (378929) - TotalRawHdfsReadTime(*): 331.096ms - TotalReadThroughput: 371.44 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 86 (86) - Files total: 98 (98) - RowGroups processed: 37.91K (37905) - RowGroups rejected: 0 (0) - RowGroups total: 37.91K (37905) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 38.81M (38810073) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 152.58K (152576) - Rows rejected: 0 (0) - Rows total: 38.81M (38810073) Filter 3 (2.00 MB): - Rows processed: 158.72K (158720) - Rows rejected: 0 (0) - Rows total: 38.81M (38810073) Instance 5f429df048b5534b:41bcce1800000036 (host=foo.232.40:22000):(Total: 11m40s, non-child: 11m30s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 3:8/1.90 GB 1:6/1.48 GB 0:9/1.76 GB 5:14/3.13 GB 7:10/2.43 GB 2:11/2.54 GB 6:22/5.24 GB 4:17/4.06 GB Filter 1 arrival: 700ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.55 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.22 MB, 134.80 MB, 124.51 MB, 91.22 MB, 64.95 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.23 MB (147047029) - PerHostPeakMemUsage: 1.36 GB (1459154958) - RowsProduced: 36.59M (36587667) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 203.949ms - TotalThreadsInvoluntaryContextSwitches: 4.72K (4721) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 761.883ms - TotalThreadsUserTime: 32s595ms - TotalThreadsVoluntaryContextSwitches: 51.71K (51714) Fragment Instance Lifecycle Timings: - ExecTime: 11m40s - ExecTreeExecTime: 5s172ms - OpenTime: 78.627ms - ExecTreeOpenTime: 229.699us - PrepareTime: 34.192ms - ExecTreePrepareTime: 868.107us DataStreamSender (dst_id=22):(Total: 4s491ms, non-child: 4s491ms, % non-child: 100.00%) - BytesSent: 657.06 MB (688976388) - OverallThroughput: 146.30 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.59M (36587667) - SerializeBatchTime: 4s481ms - UncompressedRowBatchSize: 657.06 MB (688976388) CodeGen:(Total: 106.885ms, non-child: 106.885ms, % non-child: 100.00%) - CodegenTime: 1.586ms - CompileTime: 10.447ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 67.056ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.895ms HDFS_SCAN_NODE (id=2):(Total: 5s144ms, non-child: 5s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:8/1.90 GB 1:6/1.48 GB 0:9/1.76 GB 5:14/3.13 GB 7:10/2.43 GB 2:11/2.54 GB 6:22/5.24 GB 4:17/4.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 157.69 MB, 203.27 MB - FooterProcessingTime: (Avg: 1.372ms ; Min: 614.934us ; Max: 3.622ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.86 - BytesRead: 239.12 MB (250739928) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.12 MB (250739928) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.12 MB (250739928) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s069ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828674) - PerReadThreadRawHdfsThroughput: 865.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.147ms - RowBatchQueuePutWaitTime: 56m22s - RowsRead: 36.59M (36587667) - RowsReturned: 36.59M (36587667) - RowsReturnedRate: 7.11 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.06K (3062) - ScannerThreadsTotalWallClockTime: 56m44s - MaterializeTupleTime(*): 3s050ms - ScannerThreadsSysTime: 192.969ms - ScannerThreadsUserTime: 21s229ms - ScannerThreadsVoluntaryContextSwitches: 35.83K (35825) - TotalRawHdfsReadTime(*): 276.232ms - TotalReadThroughput: 349.55 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 35.73K (35735) - RowGroups rejected: 0 (0) - RowGroups total: 35.73K (35735) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 36.59M (36587667) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 116.74K (116736) - Rows rejected: 0 (0) - Rows total: 36.59M (36587667) Filter 3 (2.00 MB): - Rows processed: 116.74K (116736) - Rows rejected: 0 (0) - Rows total: 36.59M (36587667) Instance 5f429df048b5534b:41bcce180000000b (host=foo.232.26:22000):(Total: 11m39s, non-child: 11m30s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 2:10/2.08 GB 0:11/2.56 GB 4:13/3.13 GB 3:11/2.57 GB 6:11/2.63 GB 1:13/3.09 GB 5:12/2.82 GB 7:15/3.63 GB Filter 1 arrival: 1s249ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 81.27 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 117.82 MB, 118.18 MB, 100.86 MB, 102.78 MB, 86.48 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.90 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 123.27 MB (129254331) - PerHostPeakMemUsage: 1.35 GB (1451386358) - RowsProduced: 36.12M (36115092) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 237.847ms - TotalThreadsInvoluntaryContextSwitches: 4.75K (4748) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 4s485ms - TotalThreadsUserTime: 29s109ms - TotalThreadsVoluntaryContextSwitches: 286.28K (286281) Fragment Instance Lifecycle Timings: - ExecTime: 11m39s - ExecTreeExecTime: 5s189ms - OpenTime: 61.658ms - ExecTreeOpenTime: 176.362us - PrepareTime: 30.244ms - ExecTreePrepareTime: 757.039us DataStreamSender (dst_id=22):(Total: 4s321ms, non-child: 4s321ms, % non-child: 100.00%) - BytesSent: 643.76 MB (675032712) - OverallThroughput: 148.98 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.12M (36115092) - SerializeBatchTime: 4s312ms - UncompressedRowBatchSize: 643.76 MB (675032712) CodeGen:(Total: 86.001ms, non-child: 86.001ms, % non-child: 100.00%) - CodegenTime: 1.372ms - CompileTime: 10.387ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.266ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.881ms HDFS_SCAN_NODE (id=2):(Total: 5s161ms, non-child: 5s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.08 GB 0:11/2.56 GB 4:13/3.13 GB 3:11/2.57 GB 6:11/2.63 GB 1:13/3.09 GB 5:12/2.82 GB 7:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 68.47 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 99.60 MB, 101.84 MB, 178.81 MB, 202.82 MB - FooterProcessingTime: (Avg: 2.040ms ; Min: 1.053ms ; Max: 3.602ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 236.44 MB (247921041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 236.44 MB (247921041) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 236.44 MB (247921041) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s053ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 115.39 MB (120997544) - PerReadThreadRawHdfsThroughput: 722.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.540ms - RowBatchQueuePutWaitTime: 56m36s - RowsRead: 36.12M (36115092) - RowsReturned: 36.12M (36115092) - RowsReturnedRate: 7.00 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 3.20K (3198) - ScannerThreadsTotalWallClockTime: 57m4s - MaterializeTupleTime(*): 3s011ms - ScannerThreadsSysTime: 3s950ms - ScannerThreadsUserTime: 18s093ms - ScannerThreadsVoluntaryContextSwitches: 270.69K (270691) - TotalRawHdfsReadTime(*): 327.030ms - TotalReadThroughput: 346.61 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 35.27K (35273) - RowGroups rejected: 0 (0) - RowGroups total: 35.27K (35273) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 36.12M (36115092) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 142.34K (142336) - Rows rejected: 0 (0) - Rows total: 36.12M (36115092) Filter 3 (2.00 MB): - Rows processed: 142.34K (142336) - Rows rejected: 0 (0) - Rows total: 36.12M (36115092) Instance 5f429df048b5534b:41bcce1800000041 (host=foo.221.33:22000):(Total: 11m39s, non-child: 11m29s, % non-child: 98.59%) Hdfs split stats (:<# splits>/): 1:12/2.83 GB 6:12/2.55 GB 2:19/4.11 GB 7:12/2.83 GB 5:7/1.56 GB 0:8/1.84 GB 4:13/2.80 GB 3:17/4.02 GB Filter 1 arrival: 1s578ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 94.54 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.42 MB, 137.71 MB, 132.04 MB, 103.39 MB, 95.83 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.44 MB (148306370) - PerHostPeakMemUsage: 1.40 GB (1500362839) - RowsProduced: 38.19M (38194944) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m22s - TotalStorageWaitTime: 257.226ms - TotalThreadsInvoluntaryContextSwitches: 5.24K (5243) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 5s200ms - TotalThreadsUserTime: 31s854ms - TotalThreadsVoluntaryContextSwitches: 368.80K (368798) Fragment Instance Lifecycle Timings: - ExecTime: 11m39s - ExecTreeExecTime: 5s216ms - OpenTime: 66.260ms - ExecTreeOpenTime: 256.124us - PrepareTime: 37.476ms - ExecTreePrepareTime: 628.366us DataStreamSender (dst_id=22):(Total: 4s589ms, non-child: 4s589ms, % non-child: 100.00%) - BytesSent: 686.08 MB (719406246) - OverallThroughput: 149.48 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.19M (38194944) - SerializeBatchTime: 4s580ms - UncompressedRowBatchSize: 686.08 MB (719406246) CodeGen:(Total: 88.543ms, non-child: 88.543ms, % non-child: 100.00%) - CodegenTime: 3.099ms - CompileTime: 10.154ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.434ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 22.817ms HDFS_SCAN_NODE (id=2):(Total: 5s185ms, non-child: 5s185ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:12/2.83 GB 6:12/2.55 GB 2:19/4.11 GB 7:12/2.83 GB 5:7/1.56 GB 0:8/1.84 GB 4:13/2.80 GB 3:17/4.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:33 BytesRead(16s000ms): 82.13 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 119.46 MB, 165.26 MB, 211.78 MB - FooterProcessingTime: (Avg: 1.802ms ; Min: 731.165us ; Max: 4.040ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 250.04 MB (262182766) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.04 MB (262182766) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.04 MB (262182766) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s120ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877178) - PerReadThreadRawHdfsThroughput: 693.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.849ms - RowBatchQueuePutWaitTime: 56m51s - RowsRead: 38.19M (38194944) - RowsReturned: 38.19M (38194944) - RowsReturnedRate: 7.37 M/sec - ScanRangesComplete: 100 (100) - ScannerThreadsInvoluntaryContextSwitches: 3.61K (3612) - ScannerThreadsTotalWallClockTime: 57m39s - MaterializeTupleTime(*): 3s240ms - ScannerThreadsSysTime: 4s599ms - ScannerThreadsUserTime: 20s401ms - ScannerThreadsVoluntaryContextSwitches: 353.03K (353033) - TotalRawHdfsReadTime(*): 360.581ms - TotalReadThroughput: 366.29 KB/sec Filter 1 (8.00 KB): - Files processed: 100 (100) - Files rejected: 89 (89) - Files total: 100 (100) - RowGroups processed: 37.30K (37305) - RowGroups rejected: 0 (0) - RowGroups total: 37.30K (37305) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 38.19M (38194944) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 129.02K (129024) - Rows rejected: 0 (0) - Rows total: 38.19M (38194944) Filter 3 (2.00 MB): - Rows processed: 129.02K (129024) - Rows rejected: 0 (0) - Rows total: 38.19M (38194944) Instance 5f429df048b5534b:41bcce1800000050 (host=foo.232.41:22000):(Total: 11m39s, non-child: 11m29s, % non-child: 98.64%) Hdfs split stats (:<# splits>/): 5:11/2.57 GB 2:10/2.46 GB 0:11/2.51 GB 7:13/3.07 GB 6:17/3.68 GB 4:13/3.14 GB 1:14/3.19 GB 3:8/1.75 GB Filter 1 arrival: 674ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 87.68 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.46 MB, 133.77 MB, 128.77 MB, 71.24 MB, 74.74 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.85 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 137.35 MB (144021180) - PerHostPeakMemUsage: 1.24 GB (1330584364) - RowsProduced: 33.20M (33200904) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 249.896ms - TotalThreadsInvoluntaryContextSwitches: 3.70K (3702) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 3s620ms - TotalThreadsUserTime: 21s240ms - TotalThreadsVoluntaryContextSwitches: 345.84K (345843) Fragment Instance Lifecycle Timings: - ExecTime: 11m39s - ExecTreeExecTime: 5s175ms - OpenTime: 90.334ms - ExecTreeOpenTime: 236.905us - PrepareTime: 33.980ms - ExecTreePrepareTime: 942.841us DataStreamSender (dst_id=22):(Total: 4s219ms, non-child: 4s219ms, % non-child: 100.00%) - BytesSent: 594.03 MB (622889818) - OverallThroughput: 140.77 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.20M (33200904) - SerializeBatchTime: 4s210ms - UncompressedRowBatchSize: 594.03 MB (622889818) CodeGen:(Total: 117.301ms, non-child: 117.301ms, % non-child: 100.00%) - CodegenTime: 2.155ms - CompileTime: 15.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 72.473ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.490ms HDFS_SCAN_NODE (id=2):(Total: 5s147ms, non-child: 5s147ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:11/2.57 GB 2:10/2.46 GB 0:11/2.51 GB 7:13/3.07 GB 6:17/3.68 GB 4:13/3.14 GB 1:14/3.19 GB 3:8/1.75 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 73.84 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 134.16 MB, 184.79 MB - FooterProcessingTime: (Avg: 1.481ms ; Min: 470.412us ; Max: 3.251ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 217.41 MB (227971374) - BytesReadDataNodeCache: 0 - BytesReadLocal: 217.41 MB (227971374) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 217.41 MB (227971374) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 954.696ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 129.40 MB (135682841) - PerReadThreadRawHdfsThroughput: 651.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.076ms - RowBatchQueuePutWaitTime: 56m15s - RowsRead: 33.20M (33200904) - RowsReturned: 33.20M (33200904) - RowsReturnedRate: 6.45 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.22K (2217) - ScannerThreadsTotalWallClockTime: 56m37s - MaterializeTupleTime(*): 2s782ms - ScannerThreadsSysTime: 3s135ms - ScannerThreadsUserTime: 10s671ms - ScannerThreadsVoluntaryContextSwitches: 330.28K (330276) - TotalRawHdfsReadTime(*): 333.946ms - TotalReadThroughput: 318.95 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 32.43K (32429) - RowGroups rejected: 0 (0) - RowGroups total: 32.43K (32429) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 33.20M (33200904) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 123.90K (123904) - Rows rejected: 0 (0) - Rows total: 33.20M (33200904) Filter 3 (2.00 MB): - Rows processed: 124.93K (124928) - Rows rejected: 0 (0) - Rows total: 33.20M (33200904) Instance 5f429df048b5534b:41bcce1800000046 (host=foo.232.37:22000):(Total: 11m39s, non-child: 11m30s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 0:13/3.17 GB 1:10/2.13 GB 6:14/3.28 GB 7:10/2.46 GB 2:8/1.86 GB 5:15/3.47 GB 3:9/2.22 GB 4:14/3.26 GB Filter 1 arrival: 735ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.48 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 129.72 MB, 130.24 MB, 123.04 MB, 80.10 MB, 75.15 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.88 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.45 MB (142027762) - PerHostPeakMemUsage: 1.34 GB (1437776842) - RowsProduced: 30.74M (30741572) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m23s - TotalStorageWaitTime: 182.355ms - TotalThreadsInvoluntaryContextSwitches: 3.17K (3172) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s881ms - TotalThreadsUserTime: 19s661ms - TotalThreadsVoluntaryContextSwitches: 336.69K (336687) Fragment Instance Lifecycle Timings: - ExecTime: 11m39s - ExecTreeExecTime: 5s180ms - OpenTime: 70.061ms - ExecTreeOpenTime: 268.139us - PrepareTime: 33.425ms - ExecTreePrepareTime: 839.680us DataStreamSender (dst_id=22):(Total: 3s942ms, non-child: 3s942ms, % non-child: 100.00%) - BytesSent: 550.39 MB (577130894) - OverallThroughput: 139.60 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 30.74M (30741572) - SerializeBatchTime: 3s934ms - UncompressedRowBatchSize: 550.39 MB (577130894) CodeGen:(Total: 96.857ms, non-child: 96.857ms, % non-child: 100.00%) - CodegenTime: 1.560ms - CompileTime: 12.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.416ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.761ms HDFS_SCAN_NODE (id=2):(Total: 5s154ms, non-child: 5s154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/3.17 GB 1:10/2.13 GB 6:14/3.28 GB 7:10/2.46 GB 2:8/1.86 GB 5:15/3.47 GB 3:9/2.22 GB 4:14/3.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:27 BytesRead(16s000ms): 77.26 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 112.38 MB, 137.26 MB, 184.03 MB - FooterProcessingTime: (Avg: 1.977ms ; Min: 930.708us ; Max: 3.162ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.89 - BytesRead: 201.20 MB (210975887) - BytesReadDataNodeCache: 0 - BytesReadLocal: 201.20 MB (210975887) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 201.20 MB (210975887) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 902.569ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133586045) - PerReadThreadRawHdfsThroughput: 941.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.280ms - RowBatchQueuePutWaitTime: 56m20s - RowsRead: 30.74M (30741572) - RowsReturned: 30.74M (30741572) - RowsReturnedRate: 5.96 M/sec - ScanRangesComplete: 93 (93) - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1722) - ScannerThreadsTotalWallClockTime: 56m50s - MaterializeTupleTime(*): 2s661ms - ScannerThreadsSysTime: 2s371ms - ScannerThreadsUserTime: 9s499ms - ScannerThreadsVoluntaryContextSwitches: 321.31K (321306) - TotalRawHdfsReadTime(*): 213.691ms - TotalReadThroughput: 295.38 KB/sec Filter 1 (8.00 KB): - Files processed: 93 (93) - Files rejected: 84 (84) - Files total: 93 (93) - RowGroups processed: 30.02K (30025) - RowGroups rejected: 0 (0) - RowGroups total: 30.02K (30025) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 30.74M (30741572) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 105.47K (105472) - Rows rejected: 0 (0) - Rows total: 30.74M (30741572) Filter 3 (2.00 MB): - Rows processed: 105.47K (105472) - Rows rejected: 0 (0) - Rows total: 30.74M (30741572) Instance 5f429df048b5534b:41bcce1800000063 (host=foo.221.19:22000):(Total: 11m37s, non-child: 11m28s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 6:6/1.48 GB 5:13/3.14 GB 2:14/3.19 GB 7:9/2.09 GB 3:13/2.86 GB 4:11/2.51 GB 0:15/3.44 GB 1:16/3.77 GB Filter 1 arrival: 1s753ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 89.64 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.91 MB, 129.94 MB, 119.30 MB, 102.84 MB, 83.66 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.37 MB (141944199) - PerHostPeakMemUsage: 1.22 GB (1309530511) - RowsProduced: 38.08M (38077884) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m21s - TotalStorageWaitTime: 246.866ms - TotalThreadsInvoluntaryContextSwitches: 4.58K (4579) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 2s994ms - TotalThreadsUserTime: 29s584ms - TotalThreadsVoluntaryContextSwitches: 263.04K (263043) Fragment Instance Lifecycle Timings: - ExecTime: 11m37s - ExecTreeExecTime: 5s202ms - OpenTime: 65.897ms - ExecTreeOpenTime: 237.754us - PrepareTime: 33.656ms - ExecTreePrepareTime: 785.694us DataStreamSender (dst_id=22):(Total: 4s445ms, non-child: 4s445ms, % non-child: 100.00%) - BytesSent: 684.61 MB (717862561) - OverallThroughput: 154.01 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.08M (38077884) - SerializeBatchTime: 4s435ms - UncompressedRowBatchSize: 684.61 MB (717862561) CodeGen:(Total: 93.814ms, non-child: 93.814ms, % non-child: 100.00%) - CodegenTime: 1.632ms - CompileTime: 10.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.304ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.133ms HDFS_SCAN_NODE (id=2):(Total: 5s173ms, non-child: 5s173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:6/1.48 GB 5:13/3.14 GB 2:14/3.19 GB 7:9/2.09 GB 3:13/2.86 GB 4:11/2.51 GB 0:15/3.44 GB 1:16/3.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.35 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 112.52 MB, 176.80 MB, 208.20 MB - FooterProcessingTime: (Avg: 2.194ms ; Min: 910.980us ; Max: 5.614ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 249.50 MB (261623480) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.50 MB (261623480) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.50 MB (261623480) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s107ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.42 MB (133611448) - PerReadThreadRawHdfsThroughput: 710.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.282ms - RowBatchQueuePutWaitTime: 56m43s - RowsRead: 38.08M (38077888) - RowsReturned: 38.08M (38077884) - RowsReturnedRate: 7.36 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.95K (2954) - ScannerThreadsTotalWallClockTime: 57m25s - MaterializeTupleTime(*): 3s165ms - ScannerThreadsSysTime: 2s393ms - ScannerThreadsUserTime: 18s308ms - ScannerThreadsVoluntaryContextSwitches: 247.46K (247459) - TotalRawHdfsReadTime(*): 350.925ms - TotalReadThroughput: 366.30 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 37.19K (37190) - RowGroups rejected: 0 (0) - RowGroups total: 37.19K (37190) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 38.08M (38077888) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 159.75K (159748) - Rows rejected: 4 (4) - Rows total: 38.08M (38077888) Filter 3 (2.00 MB): - Rows processed: 159.74K (159744) - Rows rejected: 0 (0) - Rows total: 38.08M (38077884) Instance 5f429df048b5534b:41bcce1800000064 (host=foo.221.37:22000):(Total: 11m37s, non-child: 11m28s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 4:13/3.00 GB 3:17/4.12 GB 5:6/1.48 GB 1:8/1.84 GB 6:15/3.55 GB 0:10/2.42 GB 7:11/2.45 GB 2:16/3.56 GB Filter 1 arrival: 1s542ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.99 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 134.77 MB, 135.10 MB, 133.70 MB, 94.10 MB, 92.49 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.21 MB (147021112) - PerHostPeakMemUsage: 1.23 GB (1323240864) - RowsProduced: 37.09M (37092570) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m21s - TotalStorageWaitTime: 190.514ms - TotalThreadsInvoluntaryContextSwitches: 4.03K (4027) - TotalThreadsTotalWallClockTime: 1h9m - TotalThreadsSysTime: 3s546ms - TotalThreadsUserTime: 22s383ms - TotalThreadsVoluntaryContextSwitches: 360.50K (360499) Fragment Instance Lifecycle Timings: - ExecTime: 11m37s - ExecTreeExecTime: 5s211ms - OpenTime: 65.014ms - ExecTreeOpenTime: 207.675us - PrepareTime: 29.481ms - ExecTreePrepareTime: 883.715us DataStreamSender (dst_id=22):(Total: 4s432ms, non-child: 4s432ms, % non-child: 100.00%) - BytesSent: 667.26 MB (699676772) - OverallThroughput: 150.54 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.09M (37092570) - SerializeBatchTime: 4s423ms - UncompressedRowBatchSize: 667.26 MB (699676772) CodeGen:(Total: 88.058ms, non-child: 88.058ms, % non-child: 100.00%) - CodegenTime: 1.465ms - CompileTime: 9.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.582ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.616ms HDFS_SCAN_NODE (id=2):(Total: 5s183ms, non-child: 5s183ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:13/3.00 GB 3:17/4.12 GB 5:6/1.48 GB 1:8/1.84 GB 6:15/3.55 GB 0:10/2.42 GB 7:11/2.45 GB 2:16/3.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 82.16 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 160.88 MB, 223.69 MB - FooterProcessingTime: (Avg: 1.719ms ; Min: 778.648us ; Max: 3.405ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 243.11 MB (254917533) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.11 MB (254917533) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.11 MB (254917533) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s078ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828821) - PerReadThreadRawHdfsThroughput: 802.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.271ms - RowBatchQueuePutWaitTime: 56m49s - RowsRead: 37.09M (37092570) - RowsReturned: 37.09M (37092570) - RowsReturnedRate: 7.16 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.48K (2485) - ScannerThreadsTotalWallClockTime: 57m25s - MaterializeTupleTime(*): 3s127ms - ScannerThreadsSysTime: 3s013ms - ScannerThreadsUserTime: 11s267ms - ScannerThreadsVoluntaryContextSwitches: 344.88K (344876) - TotalRawHdfsReadTime(*): 303.071ms - TotalReadThroughput: 357.42 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 36.23K (36228) - RowGroups rejected: 0 (0) - RowGroups total: 36.23K (36228) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.09M (37092570) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 37.09M (37092570) Filter 3 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 37.09M (37092570) Instance 5f429df048b5534b:41bcce1800000067 (host=foo.232.48:22000):(Total: 11m37s, non-child: 11m28s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 2:10/2.46 GB 1:14/3.38 GB 7:18/4.09 GB 6:10/2.40 GB 5:11/2.50 GB 0:11/2.57 GB 3:8/1.71 GB 4:14/3.41 GB Filter 1 arrival: 741ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.70 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 134.48 MB, 135.15 MB, 124.30 MB, 89.10 MB, 66.63 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.26 MB (147072149) - PerHostPeakMemUsage: 1.35 GB (1451278507) - RowsProduced: 32.98M (32976633) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m22s - TotalStorageWaitTime: 223.878ms - TotalThreadsInvoluntaryContextSwitches: 4.60K (4597) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 1s923ms - TotalThreadsUserTime: 29s949ms - TotalThreadsVoluntaryContextSwitches: 108.10K (108101) Fragment Instance Lifecycle Timings: - ExecTime: 11m37s - ExecTreeExecTime: 5s189ms - OpenTime: 63.605ms - ExecTreeOpenTime: 213.165us - PrepareTime: 28.708ms - ExecTreePrepareTime: 772.335us DataStreamSender (dst_id=22):(Total: 4s046ms, non-child: 4s046ms, % non-child: 100.00%) - BytesSent: 589.50 MB (618134353) - OverallThroughput: 145.69 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.98M (32976633) - SerializeBatchTime: 4s036ms - UncompressedRowBatchSize: 589.50 MB (618134353) CodeGen:(Total: 87.383ms, non-child: 87.383ms, % non-child: 100.00%) - CodegenTime: 1.336ms - CompileTime: 9.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.875ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.252ms HDFS_SCAN_NODE (id=2):(Total: 5s164ms, non-child: 5s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.46 GB 1:14/3.38 GB 7:18/4.09 GB 6:10/2.40 GB 5:11/2.50 GB 0:11/2.57 GB 3:8/1.71 GB 4:14/3.41 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 157.70 MB, 191.34 MB - FooterProcessingTime: (Avg: 1.385ms ; Min: 556.748us ; Max: 3.192ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 215.24 MB (225694506) - BytesReadDataNodeCache: 0 - BytesReadLocal: 215.24 MB (225694506) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 215.24 MB (225694506) - CachedFileHandlesHitCount: 54 (54) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 964.932ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138829007) - PerReadThreadRawHdfsThroughput: 656.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.611ms - RowBatchQueuePutWaitTime: 56m15s - RowsRead: 32.98M (32976633) - RowsReturned: 32.98M (32976633) - RowsReturnedRate: 6.38 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 3.07K (3074) - ScannerThreadsTotalWallClockTime: 56m36s - MaterializeTupleTime(*): 2s772ms - ScannerThreadsSysTime: 1s421ms - ScannerThreadsUserTime: 19s685ms - ScannerThreadsVoluntaryContextSwitches: 92.36K (92359) - TotalRawHdfsReadTime(*): 327.743ms - TotalReadThroughput: 316.22 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 87 (87) - Files total: 96 (96) - RowGroups processed: 32.21K (32210) - RowGroups rejected: 0 (0) - RowGroups total: 32.21K (32210) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 32.98M (32976633) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 106.50K (106496) - Rows rejected: 0 (0) - Rows total: 32.98M (32976633) Filter 3 (2.00 MB): - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 32.98M (32976633) Instance 5f429df048b5534b:41bcce1800000071 (host=foo.221.12:22000):(Total: 11m36s, non-child: 11m27s, % non-child: 98.66%) Hdfs split stats (:<# splits>/): 1:6/1.34 GB 3:12/2.83 GB 4:10/2.34 GB 7:12/2.76 GB 6:15/3.44 GB 0:10/2.40 GB 2:14/3.45 GB 5:18/3.93 GB Filter 1 arrival: 2s004ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.05 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.47 MB, 135.58 MB, 132.75 MB, 99.49 MB, 85.94 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.30 MB (146068496) - PerHostPeakMemUsage: 1.39 GB (1490657978) - RowsProduced: 33.48M (33475150) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m20s - TotalStorageWaitTime: 224.533ms - TotalThreadsInvoluntaryContextSwitches: 5.69K (5694) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 9s875ms - TotalThreadsUserTime: 31s893ms - TotalThreadsVoluntaryContextSwitches: 957.54K (957541) Fragment Instance Lifecycle Timings: - ExecTime: 11m36s - ExecTreeExecTime: 5s198ms - OpenTime: 62.138ms - ExecTreeOpenTime: 176.899us - PrepareTime: 31.083ms - ExecTreePrepareTime: 858.016us DataStreamSender (dst_id=22):(Total: 4s044ms, non-child: 4s044ms, % non-child: 100.00%) - BytesSent: 600.36 MB (629524693) - OverallThroughput: 148.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.48M (33475150) - SerializeBatchTime: 4s036ms - UncompressedRowBatchSize: 600.36 MB (629524693) CodeGen:(Total: 87.530ms, non-child: 87.530ms, % non-child: 100.00%) - CodegenTime: 1.495ms - CompileTime: 9.864ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.307ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.901ms HDFS_SCAN_NODE (id=2):(Total: 5s174ms, non-child: 5s174ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:6/1.34 GB 3:12/2.83 GB 4:10/2.34 GB 7:12/2.76 GB 6:15/3.44 GB 0:10/2.40 GB 2:14/3.45 GB 5:18/3.93 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.07189% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.68 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 112.99 MB, 154.03 MB, 203.85 MB - FooterProcessingTime: (Avg: 1.886ms ; Min: 461.892us ; Max: 3.832ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 219.54 MB (230202676) - BytesReadDataNodeCache: 0 - BytesReadLocal: 219.54 MB (230202676) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 219.54 MB (230202676) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 989.809ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780223) - PerReadThreadRawHdfsThroughput: 863.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.678ms - RowBatchQueuePutWaitTime: 56m27s - RowsRead: 33.48M (33475150) - RowsReturned: 33.48M (33475150) - RowsReturnedRate: 6.47 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 4.21K (4207) - ScannerThreadsTotalWallClockTime: 57m17s - MaterializeTupleTime(*): 2s837ms - ScannerThreadsSysTime: 9s357ms - ScannerThreadsUserTime: 21s584ms - ScannerThreadsVoluntaryContextSwitches: 941.85K (941845) - TotalRawHdfsReadTime(*): 254.323ms - TotalReadThroughput: 323.23 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 32.70K (32696) - RowGroups rejected: 0 (0) - RowGroups total: 32.70K (32696) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 33.48M (33475150) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 33.48M (33475150) Filter 3 (2.00 MB): - Rows processed: 116.74K (116736) - Rows rejected: 0 (0) - Rows total: 33.48M (33475150) Instance 5f429df048b5534b:41bcce1800000065 (host=foo.232.51:22000):(Total: 11m35s, non-child: 11m26s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 0:13/2.99 GB 4:16/3.38 GB 6:6/1.48 GB 2:8/1.60 GB 7:17/3.63 GB 1:15/3.53 GB 5:13/3.07 GB 3:11/2.71 GB Filter 1 arrival: 354ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.46 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 129.77 MB, 130.48 MB, 109.85 MB, 80.40 MB, 61.63 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4 - AverageThreadTokens: 5.86 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.36 MB (141936720) - PerHostPeakMemUsage: 1.36 GB (1456006718) - RowsProduced: 34.47M (34465388) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m19s - TotalStorageWaitTime: 210.023ms - TotalThreadsInvoluntaryContextSwitches: 3.87K (3873) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 1s340ms - TotalThreadsUserTime: 26s723ms - TotalThreadsVoluntaryContextSwitches: 155.87K (155869) Fragment Instance Lifecycle Timings: - ExecTime: 11m35s - ExecTreeExecTime: 5s176ms - OpenTime: 59.550ms - ExecTreeOpenTime: 207.340us - PrepareTime: 30.593ms - ExecTreePrepareTime: 587.292us DataStreamSender (dst_id=22):(Total: 4s132ms, non-child: 4s132ms, % non-child: 100.00%) - BytesSent: 618.38 MB (648418449) - OverallThroughput: 149.65 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.47M (34465388) - SerializeBatchTime: 4s123ms - UncompressedRowBatchSize: 618.38 MB (648418449) CodeGen:(Total: 80.554ms, non-child: 80.554ms, % non-child: 100.00%) - CodegenTime: 1.476ms - CompileTime: 9.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 48.650ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 21.465ms HDFS_SCAN_NODE (id=2):(Total: 5s152ms, non-child: 5s152ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/2.99 GB 4:16/3.38 GB 6:6/1.48 GB 2:8/1.60 GB 7:17/3.63 GB 1:15/3.53 GB 5:13/3.07 GB 3:11/2.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.56 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 112.81 MB, 163.86 MB, 203.56 MB - FooterProcessingTime: (Avg: 1.603ms ; Min: 869.052us ; Max: 3.358ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 225.97 MB (236947644) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.97 MB (236947644) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.97 MB (236947644) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s006ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585747) - PerReadThreadRawHdfsThroughput: 709.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.144ms - RowBatchQueuePutWaitTime: 55m53s - RowsRead: 34.47M (34465388) - RowsReturned: 34.47M (34465388) - RowsReturnedRate: 6.69 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.42K (2421) - ScannerThreadsTotalWallClockTime: 56m17s - MaterializeTupleTime(*): 2s845ms - ScannerThreadsSysTime: 800.875ms - ScannerThreadsUserTime: 16s092ms - ScannerThreadsVoluntaryContextSwitches: 140.50K (140500) - TotalRawHdfsReadTime(*): 318.480ms - TotalReadThroughput: 333.90 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 89 (89) - Files total: 99 (99) - RowGroups processed: 33.66K (33664) - RowGroups rejected: 0 (0) - RowGroups total: 33.66K (33664) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.47M (34465388) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 34.47M (34465388) Filter 3 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 34.47M (34465388) Instance 5f429df048b5534b:41bcce1800000021 (host=foo.232.36:22000):(Total: 11m32s, non-child: 11m23s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 2:12/2.51 GB 5:9/2.22 GB 0:10/2.46 GB 1:12/2.81 GB 3:15/3.23 GB 7:12/2.77 GB 6:15/3.56 GB 4:13/3.07 GB Filter 1 arrival: 714ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.75 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 135.92 MB, 136.67 MB, 130.75 MB, 99.96 MB, 89.48 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.48 MB (148354556) - PerHostPeakMemUsage: 1.26 GB (1351808176) - RowsProduced: 31.93M (31929686) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m16s - TotalStorageWaitTime: 180.455ms - TotalThreadsInvoluntaryContextSwitches: 3.23K (3235) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 732.887ms - TotalThreadsUserTime: 19s992ms - TotalThreadsVoluntaryContextSwitches: 49.47K (49472) Fragment Instance Lifecycle Timings: - ExecTime: 11m32s - ExecTreeExecTime: 5s165ms - OpenTime: 71.028ms - ExecTreeOpenTime: 143.195us - PrepareTime: 30.032ms - ExecTreePrepareTime: 931.243us DataStreamSender (dst_id=22):(Total: 3s872ms, non-child: 3s872ms, % non-child: 100.00%) - BytesSent: 576.54 MB (604547474) - OverallThroughput: 148.87 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.93M (31929686) - SerializeBatchTime: 3s864ms - UncompressedRowBatchSize: 576.54 MB (604547474) CodeGen:(Total: 94.904ms, non-child: 94.904ms, % non-child: 100.00%) - CodegenTime: 1.262ms - CompileTime: 9.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.792ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.281ms HDFS_SCAN_NODE (id=2):(Total: 5s142ms, non-child: 5s142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.51 GB 5:9/2.22 GB 0:10/2.46 GB 1:12/2.81 GB 3:15/3.23 GB 7:12/2.77 GB 6:15/3.56 GB 4:13/3.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 159.45 MB, 208.51 MB - FooterProcessingTime: (Avg: 2.233ms ; Min: 917.708us ; Max: 5.086ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 208.51 MB (218640738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.51 MB (218640738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.51 MB (218640738) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 936.551ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877206) - PerReadThreadRawHdfsThroughput: 792.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.051ms - RowBatchQueuePutWaitTime: 56m34s - RowsRead: 31.93M (31929686) - RowsReturned: 31.93M (31929686) - RowsReturnedRate: 6.21 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1809) - ScannerThreadsTotalWallClockTime: 56m48s - MaterializeTupleTime(*): 2s720ms - ScannerThreadsSysTime: 243.961ms - ScannerThreadsUserTime: 10s144ms - ScannerThreadsVoluntaryContextSwitches: 34.21K (34209) - TotalRawHdfsReadTime(*): 263.195ms - TotalReadThroughput: 309.22 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 89 (89) - Files total: 98 (98) - RowGroups processed: 31.19K (31186) - RowGroups rejected: 0 (0) - RowGroups total: 31.19K (31186) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.93M (31929686) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 97.28K (97280) - Rows rejected: 0 (0) - Rows total: 31.93M (31929686) Filter 3 (2.00 MB): - Rows processed: 119.81K (119808) - Rows rejected: 0 (0) - Rows total: 31.93M (31929686) Instance 5f429df048b5534b:41bcce1800000019 (host=foo.221.50:22000):(Total: 11m32s, non-child: 11m22s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 3:9/1.95 GB 7:7/1.72 GB 0:12/2.96 GB 4:11/2.58 GB 2:9/2.00 GB 5:19/4.41 GB 1:11/2.64 GB 6:18/4.26 GB Filter 1 arrival: 1s419ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 81.99 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.05 MB, 123.46 MB, 108.06 MB, 100.07 MB, 85.21 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 129.28 MB (135559959) - PerHostPeakMemUsage: 1.35 GB (1445681303) - RowsProduced: 34.95M (34951870) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m15s - TotalStorageWaitTime: 240.981ms - TotalThreadsInvoluntaryContextSwitches: 3.92K (3918) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s841ms - TotalThreadsUserTime: 21s665ms - TotalThreadsVoluntaryContextSwitches: 283.92K (283920) Fragment Instance Lifecycle Timings: - ExecTime: 11m31s - ExecTreeExecTime: 5s191ms - OpenTime: 64.464ms - ExecTreeOpenTime: 195.527us - PrepareTime: 32.156ms - ExecTreePrepareTime: 701.381us DataStreamSender (dst_id=22):(Total: 4s094ms, non-child: 4s094ms, % non-child: 100.00%) - BytesSent: 627.24 MB (657705137) - OverallThroughput: 153.17 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.95M (34951870) - SerializeBatchTime: 4s085ms - UncompressedRowBatchSize: 627.24 MB (657705137) CodeGen:(Total: 90.035ms, non-child: 90.035ms, % non-child: 100.00%) - CodegenTime: 1.304ms - CompileTime: 9.739ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.499ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.360ms HDFS_SCAN_NODE (id=2):(Total: 5s165ms, non-child: 5s165ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/1.95 GB 7:7/1.72 GB 0:12/2.96 GB 4:11/2.58 GB 2:9/2.00 GB 5:19/4.41 GB 1:11/2.64 GB 6:18/4.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:99.86% 1:0.07246% 2:0% 3:0% 4:0% 5:0.07246% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 65.14 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 99.03 MB, 171.65 MB, 220.15 MB - FooterProcessingTime: (Avg: 1.711ms ; Min: 761.509us ; Max: 3.170ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 228.92 MB (240045049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 228.92 MB (240045049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 228.92 MB (240045049) - CachedFileHandlesHitCount: 61 (61) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s032ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 121.40 MB (127294525) - PerReadThreadRawHdfsThroughput: 685.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.138ms - RowBatchQueuePutWaitTime: 56m18s - RowsRead: 34.95M (34951870) - RowsReturned: 34.95M (34951870) - RowsReturnedRate: 6.77 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.46K (2459) - ScannerThreadsTotalWallClockTime: 56m52s - MaterializeTupleTime(*): 2s967ms - ScannerThreadsSysTime: 2s324ms - ScannerThreadsUserTime: 11s146ms - ScannerThreadsVoluntaryContextSwitches: 268.31K (268309) - TotalRawHdfsReadTime(*): 333.963ms - TotalReadThroughput: 339.49 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 34.14K (34138) - RowGroups rejected: 0 (0) - RowGroups total: 34.14K (34138) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 34.95M (34951870) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 128.00K (128000) - Rows rejected: 0 (0) - Rows total: 34.95M (34951870) Filter 3 (2.00 MB): - Rows processed: 132.10K (132096) - Rows rejected: 0 (0) - Rows total: 34.95M (34951870) Instance 5f429df048b5534b:41bcce180000007f (host=foo.221.44:22000):(Total: 11m31s, non-child: 11m22s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 5:8/1.97 GB 0:10/2.22 GB 1:9/2.22 GB 4:9/1.89 GB 7:10/2.24 GB 6:21/4.75 GB 2:16/3.67 GB 3:16/3.80 GB Filter 1 arrival: 1s501ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 89.42 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 129.53 MB, 130.19 MB, 132.41 MB, 88.33 MB, 74.80 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.43 MB (142010554) - PerHostPeakMemUsage: 1.39 GB (1493934538) - RowsProduced: 31.44M (31440541) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m16s - TotalStorageWaitTime: 223.729ms - TotalThreadsInvoluntaryContextSwitches: 4.36K (4355) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s227ms - TotalThreadsUserTime: 29s971ms - TotalThreadsVoluntaryContextSwitches: 227.52K (227517) Fragment Instance Lifecycle Timings: - ExecTime: 11m31s - ExecTreeExecTime: 5s166ms - OpenTime: 64.441ms - ExecTreeOpenTime: 281.952us - PrepareTime: 30.885ms - ExecTreePrepareTime: 877.803us DataStreamSender (dst_id=22):(Total: 3s881ms, non-child: 3s881ms, % non-child: 100.00%) - BytesSent: 565.54 MB (593007250) - OverallThroughput: 145.71 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.44M (31440541) - SerializeBatchTime: 3s872ms - UncompressedRowBatchSize: 565.54 MB (593007250) CodeGen:(Total: 88.985ms, non-child: 88.985ms, % non-child: 100.00%) - CodegenTime: 1.358ms - CompileTime: 11.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.156ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.303ms HDFS_SCAN_NODE (id=2):(Total: 5s143ms, non-child: 5s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:8/1.97 GB 0:10/2.22 GB 1:9/2.22 GB 4:9/1.89 GB 7:10/2.24 GB 6:21/4.75 GB 2:16/3.67 GB 3:16/3.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.07241% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:30 BytesRead(16s000ms): 72.60 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 105.61 MB, 146.87 MB, 203.71 MB - FooterProcessingTime: (Avg: 2.042ms ; Min: 757.318us ; Max: 7.511ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 205.95 MB (215949716) - BytesReadDataNodeCache: 0 - BytesReadLocal: 205.95 MB (215949716) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 205.95 MB (215949716) - CachedFileHandlesHitCount: 56 (56) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 911.633ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585891) - PerReadThreadRawHdfsThroughput: 699.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.778ms - RowBatchQueuePutWaitTime: 56m12s - RowsRead: 31.44M (31440541) - RowsReturned: 31.44M (31440541) - RowsReturnedRate: 6.11 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.92K (2917) - ScannerThreadsTotalWallClockTime: 56m55s - MaterializeTupleTime(*): 2s604ms - ScannerThreadsSysTime: 1s745ms - ScannerThreadsUserTime: 20s212ms - ScannerThreadsVoluntaryContextSwitches: 211.87K (211874) - TotalRawHdfsReadTime(*): 294.536ms - TotalReadThroughput: 305.41 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 89 (89) - Files total: 99 (99) - RowGroups processed: 30.71K (30709) - RowGroups rejected: 0 (0) - RowGroups total: 30.71K (30709) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 31.44M (31440541) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 31.44M (31440541) Filter 3 (2.00 MB): - Rows processed: 121.86K (121856) - Rows rejected: 0 (0) - Rows total: 31.44M (31440541) Instance 5f429df048b5534b:41bcce180000003b (host=foo.221.13:22000):(Total: 11m31s, non-child: 11m22s, % non-child: 98.66%) Hdfs split stats (:<# splits>/): 6:12/2.81 GB 3:12/2.85 GB 0:16/3.64 GB 4:7/1.43 GB 7:9/2.04 GB 5:15/3.31 GB 2:15/3.30 GB 1:15/3.30 GB Filter 1 arrival: 1s938ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 76.56 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 110.99 MB, 111.29 MB, 102.36 MB, 96.89 MB, 84.33 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5 - AverageThreadTokens: 5.90 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 116.16 MB (121804367) - PerHostPeakMemUsage: 1.24 GB (1326661336) - RowsProduced: 34.38M (34382701) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m15s - TotalStorageWaitTime: 280.289ms - TotalThreadsInvoluntaryContextSwitches: 3.80K (3804) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 3s803ms - TotalThreadsUserTime: 21s990ms - TotalThreadsVoluntaryContextSwitches: 449.34K (449338) Fragment Instance Lifecycle Timings: - ExecTime: 11m31s - ExecTreeExecTime: 5s173ms - OpenTime: 66.348ms - ExecTreeOpenTime: 185.888us - PrepareTime: 32.599ms - ExecTreePrepareTime: 1.020ms DataStreamSender (dst_id=22):(Total: 4s016ms, non-child: 4s016ms, % non-child: 100.00%) - BytesSent: 619.33 MB (649415862) - OverallThroughput: 154.18 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.38M (34382701) - SerializeBatchTime: 4s007ms - UncompressedRowBatchSize: 619.33 MB (649415862) CodeGen:(Total: 92.549ms, non-child: 92.549ms, % non-child: 100.00%) - CodegenTime: 1.583ms - CompileTime: 10.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.837ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.092ms HDFS_SCAN_NODE (id=2):(Total: 5s149ms, non-child: 5s149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:12/2.81 GB 3:12/2.85 GB 0:16/3.64 GB 4:7/1.43 GB 7:9/2.04 GB 5:15/3.31 GB 2:15/3.30 GB 1:15/3.30 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:99.86% 1:0.1449% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:33 BytesRead(16s000ms): 61.08 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 88.84 MB, 99.31 MB, 168.06 MB, 225.84 MB - FooterProcessingTime: (Avg: 2.051ms ; Min: 893.587us ; Max: 4.190ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.90 - BytesRead: 225.84 MB (236807007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.84 MB (236807007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.84 MB (236807007) - CachedFileHandlesHitCount: 61 (61) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 996.522ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 108.40 MB (113662865) - PerReadThreadRawHdfsThroughput: 590.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.628ms - RowBatchQueuePutWaitTime: 56m9s - RowsRead: 34.38M (34382701) - RowsReturned: 34.38M (34382701) - RowsReturnedRate: 6.68 M/sec - ScanRangesComplete: 101 (101) - ScannerThreadsInvoluntaryContextSwitches: 2.37K (2373) - ScannerThreadsTotalWallClockTime: 56m25s - MaterializeTupleTime(*): 2s841ms - ScannerThreadsSysTime: 3s345ms - ScannerThreadsUserTime: 11s623ms - ScannerThreadsVoluntaryContextSwitches: 434.02K (434020) - TotalRawHdfsReadTime(*): 382.689ms - TotalReadThroughput: 335.15 KB/sec Filter 1 (8.00 KB): - Files processed: 101 (101) - Files rejected: 90 (90) - Files total: 101 (101) - RowGroups processed: 33.58K (33583) - RowGroups rejected: 0 (0) - RowGroups total: 33.58K (33583) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 34.38M (34382701) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 34.38M (34382701) Filter 3 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 34.38M (34382701) Instance 5f429df048b5534b:41bcce1800000074 (host=foo.221.43:22000):(Total: 11m29s, non-child: 11m20s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 4:11/2.60 GB 1:14/3.18 GB 6:10/2.40 GB 2:10/2.46 GB 7:15/3.50 GB 3:13/3.08 GB 0:11/2.71 GB 5:12/2.88 GB Filter 1 arrival: 1s547ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.19 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.21 MB, 135.50 MB, 127.32 MB, 104.52 MB, 82.97 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.45 MB (147271903) - PerHostPeakMemUsage: 1.29 GB (1384844262) - RowsProduced: 35.52M (35522350) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m13s - TotalStorageWaitTime: 216.368ms - TotalThreadsInvoluntaryContextSwitches: 3.93K (3932) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 3s388ms - TotalThreadsUserTime: 21s344ms - TotalThreadsVoluntaryContextSwitches: 296.45K (296446) Fragment Instance Lifecycle Timings: - ExecTime: 11m29s - ExecTreeExecTime: 5s200ms - OpenTime: 63.727ms - ExecTreeOpenTime: 196.129us - PrepareTime: 34.995ms - ExecTreePrepareTime: 905.548us DataStreamSender (dst_id=22):(Total: 4s246ms, non-child: 4s246ms, % non-child: 100.00%) - BytesSent: 634.63 MB (665455140) - OverallThroughput: 149.43 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.52M (35522350) - SerializeBatchTime: 4s237ms - UncompressedRowBatchSize: 634.63 MB (665455140) CodeGen:(Total: 92.708ms, non-child: 92.708ms, % non-child: 100.00%) - CodegenTime: 1.546ms - CompileTime: 10.048ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.451ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.662ms HDFS_SCAN_NODE (id=2):(Total: 5s172ms, non-child: 5s172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:11/2.60 GB 1:14/3.18 GB 6:10/2.40 GB 2:10/2.46 GB 7:15/3.50 GB 3:13/3.08 GB 0:11/2.71 GB 5:12/2.88 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.20 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 168.73 MB, 221.01 MB - FooterProcessingTime: (Avg: 1.843ms ; Min: 724.349us ; Max: 3.190ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 232.22 MB (243497457) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.22 MB (243497457) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.22 MB (243497457) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s036ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828734) - PerReadThreadRawHdfsThroughput: 787.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.899ms - RowBatchQueuePutWaitTime: 56m21s - RowsRead: 35.52M (35522350) - RowsReturned: 35.52M (35522350) - RowsReturnedRate: 6.87 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.42K (2424) - ScannerThreadsTotalWallClockTime: 56m55s - MaterializeTupleTime(*): 2s981ms - ScannerThreadsSysTime: 2s812ms - ScannerThreadsUserTime: 10s457ms - ScannerThreadsVoluntaryContextSwitches: 280.74K (280744) - TotalRawHdfsReadTime(*): 295.027ms - TotalReadThroughput: 345.12 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 34.70K (34696) - RowGroups rejected: 0 (0) - RowGroups total: 34.70K (34696) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.52M (35522350) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 35.52M (35522350) Filter 3 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 35.52M (35522350) Instance 5f429df048b5534b:41bcce1800000032 (host=foo.221.30:22000):(Total: 11m29s, non-child: 11m20s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 3:7/1.69 GB 1:8/1.79 GB 6:11/2.52 GB 5:21/4.76 GB 4:7/1.60 GB 7:21/5.09 GB 0:13/3.09 GB 2:9/2.15 GB Filter 1 arrival: 1s683ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 91.20 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.52 MB, 138.88 MB, 127.05 MB, 102.79 MB, 65.14 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 144.38 MB (151395896) - PerHostPeakMemUsage: 1.32 GB (1419515909) - RowsProduced: 35.52M (35517455) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m13s - TotalStorageWaitTime: 198.973ms - TotalThreadsInvoluntaryContextSwitches: 4.55K (4549) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 5s382ms - TotalThreadsUserTime: 26s988ms - TotalThreadsVoluntaryContextSwitches: 525.59K (525588) Fragment Instance Lifecycle Timings: - ExecTime: 11m29s - ExecTreeExecTime: 5s162ms - OpenTime: 89.082ms - ExecTreeOpenTime: 187.783us - PrepareTime: 29.975ms - ExecTreePrepareTime: 758.959us DataStreamSender (dst_id=22):(Total: 4s065ms, non-child: 4s065ms, % non-child: 100.00%) - BytesSent: 637.85 MB (668832225) - OverallThroughput: 156.89 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.52M (35517455) - SerializeBatchTime: 4s056ms - UncompressedRowBatchSize: 637.85 MB (668832225) CodeGen:(Total: 112.836ms, non-child: 112.836ms, % non-child: 100.00%) - CodegenTime: 1.666ms - CompileTime: 10.388ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 77.291ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.634ms HDFS_SCAN_NODE (id=2):(Total: 5s137ms, non-child: 5s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:7/1.69 GB 1:8/1.79 GB 6:11/2.52 GB 5:21/4.76 GB 4:7/1.60 GB 7:21/5.09 GB 0:13/3.09 GB 2:9/2.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 78.48 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 187.12 MB, 225.80 MB - FooterProcessingTime: (Avg: 2.144ms ; Min: 658.200us ; Max: 8.410ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 232.52 MB (243816817) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.52 MB (243816817) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.52 MB (243816817) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s030ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 136.39 MB (143020068) - PerReadThreadRawHdfsThroughput: 891.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.299ms - RowBatchQueuePutWaitTime: 56m6s - RowsRead: 35.52M (35517455) - RowsReturned: 35.52M (35517455) - RowsReturnedRate: 6.91 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.10K (3098) - ScannerThreadsTotalWallClockTime: 56m51s - MaterializeTupleTime(*): 2s942ms - ScannerThreadsSysTime: 4s901ms - ScannerThreadsUserTime: 16s453ms - ScannerThreadsVoluntaryContextSwitches: 510.15K (510155) - TotalRawHdfsReadTime(*): 260.838ms - TotalReadThroughput: 345.83 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 34.69K (34691) - RowGroups rejected: 0 (0) - RowGroups total: 34.69K (34691) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.52M (35517455) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 129.02K (129024) - Rows rejected: 0 (0) - Rows total: 35.52M (35517455) Filter 3 (2.00 MB): - Rows processed: 118.78K (118784) - Rows rejected: 0 (0) - Rows total: 35.52M (35517455) Instance 5f429df048b5534b:41bcce180000006e (host=foo.221.24:22000):(Total: 11m29s, non-child: 11m20s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 7:10/2.43 GB 5:7/1.73 GB 3:13/2.99 GB 0:14/3.38 GB 4:16/3.94 GB 1:9/2.22 GB 6:10/2.40 GB 2:14/3.45 GB Filter 1 arrival: 1s736ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.40 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.22 MB, 135.56 MB, 122.75 MB, 105.52 MB, 77.66 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.41 MB (148280630) - PerHostPeakMemUsage: 1.29 GB (1390088687) - RowsProduced: 31.92M (31923586) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m14s - TotalStorageWaitTime: 183.456ms - TotalThreadsInvoluntaryContextSwitches: 3.48K (3477) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 671.896ms - TotalThreadsUserTime: 19s717ms - TotalThreadsVoluntaryContextSwitches: 48.26K (48264) Fragment Instance Lifecycle Timings: - ExecTime: 11m28s - ExecTreeExecTime: 5s136ms - OpenTime: 75.112ms - ExecTreeOpenTime: 182.187us - PrepareTime: 31.239ms - ExecTreePrepareTime: 903.654us DataStreamSender (dst_id=22):(Total: 3s781ms, non-child: 3s781ms, % non-child: 100.00%) - BytesSent: 576.34 MB (604341099) - OverallThroughput: 152.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.92M (31923586) - SerializeBatchTime: 3s773ms - UncompressedRowBatchSize: 576.34 MB (604341099) CodeGen:(Total: 100.126ms, non-child: 100.126ms, % non-child: 100.00%) - CodegenTime: 1.434ms - CompileTime: 10.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 62.548ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.170ms HDFS_SCAN_NODE (id=2):(Total: 5s114ms, non-child: 5s114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:10/2.43 GB 5:7/1.73 GB 3:13/2.99 GB 0:14/3.38 GB 4:16/3.94 GB 1:9/2.22 GB 6:10/2.40 GB 2:14/3.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.21 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 177.91 MB, 208.47 MB - FooterProcessingTime: (Avg: 3.585ms ; Min: 725.440us ; Max: 18.810ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 208.47 MB (218594830) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.47 MB (218594830) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.47 MB (218594830) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 943.004ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877259) - PerReadThreadRawHdfsThroughput: 650.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.343ms - RowBatchQueuePutWaitTime: 56m21s - RowsRead: 31.92M (31923586) - RowsReturned: 31.92M (31923586) - RowsReturnedRate: 6.24 M/sec - ScanRangesComplete: 93 (93) - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2094) - ScannerThreadsTotalWallClockTime: 56m50s - MaterializeTupleTime(*): 2s681ms - ScannerThreadsSysTime: 233.962ms - ScannerThreadsUserTime: 10s066ms - ScannerThreadsVoluntaryContextSwitches: 33.05K (33055) - TotalRawHdfsReadTime(*): 320.267ms - TotalReadThroughput: 310.05 KB/sec Filter 1 (8.00 KB): - Files processed: 93 (93) - Files rejected: 84 (84) - Files total: 93 (93) - RowGroups processed: 31.18K (31180) - RowGroups rejected: 0 (0) - RowGroups total: 31.18K (31180) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.92M (31923586) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 99.33K (99328) - Rows rejected: 0 (0) - Rows total: 31.92M (31923586) Filter 3 (2.00 MB): - Rows processed: 102.40K (102400) - Rows rejected: 0 (0) - Rows total: 31.92M (31923586) Instance 5f429df048b5534b:41bcce1800000027 (host=foo.221.27:22000):(Total: 11m28s, non-child: 11m18s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 4:13/3.02 GB 3:5/920.12 MB 2:13/3.15 GB 0:16/3.81 GB 7:14/3.26 GB 1:13/3.20 GB 5:14/3.38 GB 6:7/1.66 GB Filter 1 arrival: 1s740ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 83.79 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.64 MB, 121.79 MB, 106.04 MB, 91.56 MB, 67.85 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 4 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 126.28 MB (132412246) - PerHostPeakMemUsage: 1.20 GB (1292996464) - RowsProduced: 37.19M (37191945) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m12s - TotalStorageWaitTime: 196.683ms - TotalThreadsInvoluntaryContextSwitches: 4.52K (4520) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s391ms - TotalThreadsUserTime: 27s732ms - TotalThreadsVoluntaryContextSwitches: 179.74K (179740) Fragment Instance Lifecycle Timings: - ExecTime: 11m28s - ExecTreeExecTime: 5s167ms - OpenTime: 79.874ms - ExecTreeOpenTime: 221.327us - PrepareTime: 43.524ms - ExecTreePrepareTime: 1.004ms DataStreamSender (dst_id=22):(Total: 4s284ms, non-child: 4s284ms, % non-child: 100.00%) - BytesSent: 668.32 MB (700782819) - OverallThroughput: 155.98 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.19M (37191945) - SerializeBatchTime: 4s274ms - UncompressedRowBatchSize: 668.32 MB (700782819) CodeGen:(Total: 108.666ms, non-child: 108.666ms, % non-child: 100.00%) - CodegenTime: 1.367ms - CompileTime: 9.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 69.053ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.345ms HDFS_SCAN_NODE (id=2):(Total: 5s139ms, non-child: 5s139ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:13/3.02 GB 3:5/920.12 MB 2:13/3.15 GB 0:16/3.81 GB 7:14/3.26 GB 1:13/3.20 GB 5:14/3.38 GB 6:7/1.66 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:99.85% 1:0.1455% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:33 BytesRead(16s000ms): 68.69 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 99.92 MB, 102.16 MB, 183.31 MB - FooterProcessingTime: (Avg: 1.738ms ; Min: 729.286us ; Max: 3.857ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 243.37 MB (255196942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.37 MB (255196942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.37 MB (255196942) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s065ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 118.39 MB (124143165) - PerReadThreadRawHdfsThroughput: 803.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.090ms - RowBatchQueuePutWaitTime: 55m57s - RowsRead: 37.19M (37191945) - RowsReturned: 37.19M (37191945) - RowsReturnedRate: 7.24 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 3.05K (3046) - ScannerThreadsTotalWallClockTime: 56m36s - MaterializeTupleTime(*): 3s061ms - ScannerThreadsSysTime: 1s905ms - ScannerThreadsUserTime: 16s729ms - ScannerThreadsVoluntaryContextSwitches: 164.34K (164343) - TotalRawHdfsReadTime(*): 302.950ms - TotalReadThroughput: 362.50 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 84 (84) - Files total: 95 (95) - RowGroups processed: 36.33K (36326) - RowGroups rejected: 0 (0) - RowGroups total: 36.33K (36326) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.19M (37191945) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 141.31K (141312) - Rows rejected: 0 (0) - Rows total: 37.19M (37191945) Filter 3 (2.00 MB): - Rows processed: 144.99K (144988) - Rows rejected: 0 (0) - Rows total: 37.19M (37191945) Instance 5f429df048b5534b:41bcce180000007a (host=foo.221.26:22000):(Total: 11m27s, non-child: 11m18s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 4:12/2.90 GB 0:11/2.43 GB 7:17/4.07 GB 1:9/2.08 GB 2:7/1.44 GB 6:18/4.17 GB 5:10/2.23 GB 3:14/3.38 GB Filter 1 arrival: 1s746ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 95.19 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.30 MB, 138.52 MB, 123.99 MB, 107.47 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 142.22 MB (149130576) - PerHostPeakMemUsage: 1.21 GB (1302146071) - RowsProduced: 34.63M (34630033) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m12s - TotalStorageWaitTime: 200.409ms - TotalThreadsInvoluntaryContextSwitches: 3.95K (3949) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 3s664ms - TotalThreadsUserTime: 21s277ms - TotalThreadsVoluntaryContextSwitches: 344.47K (344471) Fragment Instance Lifecycle Timings: - ExecTime: 11m27s - ExecTreeExecTime: 5s161ms - OpenTime: 68.739ms - ExecTreeOpenTime: 237.845us - PrepareTime: 35.070ms - ExecTreePrepareTime: 805.696us DataStreamSender (dst_id=22):(Total: 4s024ms, non-child: 4s024ms, % non-child: 100.00%) - BytesSent: 623.28 MB (653558117) - OverallThroughput: 154.86 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.63M (34630033) - SerializeBatchTime: 4s014ms - UncompressedRowBatchSize: 623.28 MB (653558117) CodeGen:(Total: 98.120ms, non-child: 98.120ms, % non-child: 100.00%) - CodegenTime: 1.437ms - CompileTime: 13.880ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.615ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 30.119ms HDFS_SCAN_NODE (id=2):(Total: 5s136ms, non-child: 5s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:12/2.90 GB 0:11/2.43 GB 7:17/4.07 GB 1:9/2.08 GB 2:7/1.44 GB 6:18/4.17 GB 5:10/2.23 GB 3:14/3.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.22 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 119.60 MB, 183.06 MB - FooterProcessingTime: (Avg: 2.358ms ; Min: 706.451us ; Max: 6.281ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 226.29 MB (237278392) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.29 MB (237278392) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.29 MB (237278392) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s003ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 134.40 MB (140925844) - PerReadThreadRawHdfsThroughput: 760.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.414ms - RowBatchQueuePutWaitTime: 56m12s - RowsRead: 34.63M (34630033) - RowsReturned: 34.63M (34630033) - RowsReturnedRate: 6.74 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.45K (2454) - ScannerThreadsTotalWallClockTime: 56m27s - MaterializeTupleTime(*): 2s899ms - ScannerThreadsSysTime: 3s154ms - ScannerThreadsUserTime: 10s958ms - ScannerThreadsVoluntaryContextSwitches: 329.20K (329201) - TotalRawHdfsReadTime(*): 297.362ms - TotalReadThroughput: 337.29 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 88 (88) - Files total: 98 (98) - RowGroups processed: 33.82K (33824) - RowGroups rejected: 0 (0) - RowGroups total: 33.82K (33824) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.63M (34630033) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 117.76K (117760) - Rows rejected: 0 (0) - Rows total: 34.63M (34630033) Filter 3 (2.00 MB): - Rows processed: 126.98K (126976) - Rows rejected: 0 (0) - Rows total: 34.63M (34630033) Instance 5f429df048b5534b:41bcce1800000010 (host=foo.221.35:22000):(Total: 11m27s, non-child: 11m18s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 3:11/2.71 GB 1:9/1.95 GB 6:14/3.02 GB 0:15/3.26 GB 5:12/2.77 GB 7:12/2.81 GB 4:13/3.08 GB 2:14/3.23 GB Filter 1 arrival: 1s608ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 88.22 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.61 MB, 130.55 MB, 114.64 MB, 103.18 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.91 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 134.52 MB (141056175) - PerHostPeakMemUsage: 1.34 GB (1442599544) - RowsProduced: 33.68M (33684938) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m11s - TotalStorageWaitTime: 221.907ms - TotalThreadsInvoluntaryContextSwitches: 3.49K (3489) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 4s027ms - TotalThreadsUserTime: 18s125ms - TotalThreadsVoluntaryContextSwitches: 429.97K (429973) Fragment Instance Lifecycle Timings: - ExecTime: 11m27s - ExecTreeExecTime: 5s138ms - OpenTime: 76.536ms - ExecTreeOpenTime: 192.791us - PrepareTime: 35.090ms - ExecTreePrepareTime: 806.276us DataStreamSender (dst_id=22):(Total: 3s835ms, non-child: 3s835ms, % non-child: 100.00%) - BytesSent: 601.43 MB (630641198) - OverallThroughput: 156.82 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.68M (33684938) - SerializeBatchTime: 3s826ms - UncompressedRowBatchSize: 601.43 MB (630641198) CodeGen:(Total: 102.321ms, non-child: 102.321ms, % non-child: 100.00%) - CodegenTime: 1.412ms - CompileTime: 9.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 65.390ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.182ms HDFS_SCAN_NODE (id=2):(Total: 5s117ms, non-child: 5s117ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:11/2.71 GB 1:9/1.95 GB 6:14/3.02 GB 0:15/3.26 GB 5:12/2.77 GB 7:12/2.81 GB 4:13/3.08 GB 2:14/3.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s922ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0% 3:0.07289% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:30 BytesRead(16s000ms): 71.76 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 107.41 MB, 169.58 MB - FooterProcessingTime: (Avg: 1.227ms ; Min: 688.413us ; Max: 2.553ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.91 - BytesRead: 220.65 MB (231371203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 220.65 MB (231371203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 220.65 MB (231371203) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 981.789ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.52 MB (132663010) - PerReadThreadRawHdfsThroughput: 770.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.031ms - RowBatchQueuePutWaitTime: 55m59s - RowsRead: 33.68M (33684939) - RowsReturned: 33.68M (33684938) - RowsReturnedRate: 6.58 M/sec - ScanRangesComplete: 100 (100) - ScannerThreadsInvoluntaryContextSwitches: 2.11K (2107) - ScannerThreadsTotalWallClockTime: 56m12s - MaterializeTupleTime(*): 2s776ms - ScannerThreadsSysTime: 3s518ms - ScannerThreadsUserTime: 8s253ms - ScannerThreadsVoluntaryContextSwitches: 414.64K (414638) - TotalRawHdfsReadTime(*): 286.334ms - TotalReadThroughput: 329.13 KB/sec Filter 1 (8.00 KB): - Files processed: 100 (100) - Files rejected: 90 (90) - Files total: 100 (100) - RowGroups processed: 32.90K (32899) - RowGroups rejected: 0 (0) - RowGroups total: 32.90K (32899) - Rows processed: 163.84K (163841) - Rows rejected: 0 (0) - Rows total: 33.68M (33684939) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 138.24K (138241) - Rows rejected: 0 (0) - Rows total: 33.68M (33684939) Filter 3 (2.00 MB): - Rows processed: 138.24K (138241) - Rows rejected: 1 (1) - Rows total: 33.68M (33684939) Instance 5f429df048b5534b:41bcce180000006b (host=foo.221.25:22000):(Total: 11m26s, non-child: 11m18s, % non-child: 98.71%) Hdfs split stats (:<# splits>/): 0:15/3.37 GB 7:12/2.82 GB 2:9/2.08 GB 4:9/2.22 GB 3:13/3.01 GB 5:12/2.67 GB 6:12/2.68 GB 1:15/3.39 GB Filter 1 arrival: 1s759ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 86.87 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.21 MB, 126.39 MB, 112.02 MB, 97.03 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 130.17 MB (136497336) - PerHostPeakMemUsage: 1.32 GB (1416696524) - RowsProduced: 29.62M (29615147) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m12s - TotalStorageWaitTime: 198.169ms - TotalThreadsInvoluntaryContextSwitches: 2.81K (2814) - TotalThreadsTotalWallClockTime: 1h8m - TotalThreadsSysTime: 2s219ms - TotalThreadsUserTime: 16s136ms - TotalThreadsVoluntaryContextSwitches: 219.44K (219445) Fragment Instance Lifecycle Timings: - ExecTime: 11m26s - ExecTreeExecTime: 5s160ms - OpenTime: 59.965ms - ExecTreeOpenTime: 204.163us - PrepareTime: 31.558ms - ExecTreePrepareTime: 838.786us DataStreamSender (dst_id=22):(Total: 3s624ms, non-child: 3s624ms, % non-child: 100.00%) - BytesSent: 534.15 MB (560093397) - OverallThroughput: 147.38 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 29.62M (29615147) - SerializeBatchTime: 3s615ms - UncompressedRowBatchSize: 534.15 MB (560093397) CodeGen:(Total: 86.059ms, non-child: 86.059ms, % non-child: 100.00%) - CodegenTime: 1.245ms - CompileTime: 9.676ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.341ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.567ms HDFS_SCAN_NODE (id=2):(Total: 5s136ms, non-child: 5s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:15/3.37 GB 7:12/2.82 GB 2:9/2.08 GB 4:9/2.22 GB 3:13/3.01 GB 5:12/2.67 GB 6:12/2.68 GB 1:15/3.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0.07294% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:27 BytesRead(16s000ms): 72.24 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 105.08 MB, 167.38 MB - FooterProcessingTime: (Avg: 5.537ms ; Min: 2.465ms ; Max: 7.743ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 193.65 MB (203055552) - BytesReadDataNodeCache: 0 - BytesReadLocal: 193.65 MB (203055552) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 193.65 MB (203055552) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 862.481ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.40 MB (128343401) - PerReadThreadRawHdfsThroughput: 711.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.600ms - RowBatchQueuePutWaitTime: 56m6s - RowsRead: 29.62M (29615147) - RowsReturned: 29.62M (29615147) - RowsReturnedRate: 5.77 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.46K (1458) - ScannerThreadsTotalWallClockTime: 56m38s - MaterializeTupleTime(*): 2s523ms - ScannerThreadsSysTime: 1s761ms - ScannerThreadsUserTime: 6s825ms - ScannerThreadsVoluntaryContextSwitches: 204.25K (204245) - TotalRawHdfsReadTime(*): 272.218ms - TotalReadThroughput: 289.27 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 88 (88) - Files total: 97 (97) - RowGroups processed: 28.93K (28926) - RowGroups rejected: 0 (0) - RowGroups total: 28.93K (28926) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 29.62M (29615147) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 121.86K (121856) - Rows rejected: 0 (0) - Rows total: 29.62M (29615147) Filter 3 (2.00 MB): - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 29.62M (29615147) Instance 5f429df048b5534b:41bcce180000002f (host=foo.221.20:22000):(Total: 11m26s, non-child: 11m17s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 3:13/3.07 GB 1:11/2.52 GB 5:8/1.75 GB 2:13/3.02 GB 7:12/2.92 GB 4:13/3.09 GB 6:13/3.07 GB 0:14/3.03 GB Filter 1 arrival: 1s763ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.55 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.23 MB, 134.53 MB, 126.16 MB, 92.92 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.27 MB (146030756) - PerHostPeakMemUsage: 1.39 GB (1494618394) - RowsProduced: 35.56M (35555059) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m10s - TotalStorageWaitTime: 182.560ms - TotalThreadsInvoluntaryContextSwitches: 5.38K (5375) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 10s998ms - TotalThreadsUserTime: 28s783ms - TotalThreadsVoluntaryContextSwitches: 906.91K (906911) Fragment Instance Lifecycle Timings: - ExecTime: 11m26s - ExecTreeExecTime: 5s202ms - OpenTime: 57.243ms - ExecTreeOpenTime: 174.281us - PrepareTime: 27.318ms - ExecTreePrepareTime: 759.171us DataStreamSender (dst_id=22):(Total: 4s154ms, non-child: 4s154ms, % non-child: 100.00%) - BytesSent: 637.43 MB (668394194) - OverallThroughput: 153.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.56M (35555059) - SerializeBatchTime: 4s144ms - UncompressedRowBatchSize: 637.43 MB (668394194) CodeGen:(Total: 78.904ms, non-child: 78.904ms, % non-child: 100.00%) - CodegenTime: 1.333ms - CompileTime: 8.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 47.913ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 22.130ms HDFS_SCAN_NODE (id=2):(Total: 5s175ms, non-child: 5s175ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/3.07 GB 1:11/2.52 GB 5:8/1.75 GB 2:13/3.02 GB 7:12/2.92 GB 4:13/3.09 GB 6:13/3.07 GB 0:14/3.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s957ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.68 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 113.00 MB, 181.76 MB - FooterProcessingTime: (Avg: 1.537ms ; Min: 525.088us ; Max: 2.715ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.92 - BytesRead: 232.57 MB (243865757) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.57 MB (243865757) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.57 MB (243865757) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s026ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780339) - PerReadThreadRawHdfsThroughput: 852.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.197ms - RowBatchQueuePutWaitTime: 55m48s - RowsRead: 35.56M (35555059) - RowsReturned: 35.56M (35555059) - RowsReturnedRate: 6.87 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.87K (3866) - ScannerThreadsTotalWallClockTime: 56m18s - MaterializeTupleTime(*): 2s907ms - ScannerThreadsSysTime: 10s450ms - ScannerThreadsUserTime: 18s365ms - ScannerThreadsVoluntaryContextSwitches: 890.94K (890936) - TotalRawHdfsReadTime(*): 272.798ms - TotalReadThroughput: 346.90 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 34.73K (34726) - RowGroups rejected: 0 (0) - RowGroups total: 34.73K (34726) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.56M (35555059) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 130.05K (130048) - Rows rejected: 0 (0) - Rows total: 35.56M (35555059) Filter 3 (2.00 MB): - Rows processed: 120.83K (120832) - Rows rejected: 0 (0) - Rows total: 35.56M (35555059) Instance 5f429df048b5534b:41bcce1800000002 (host=foo.221.23:22000):(Total: 11m22s, non-child: 11m13s, % non-child: 98.71%) Hdfs split stats (:<# splits>/): 3:6/1.48 GB 1:5/1.17 GB 7:16/3.83 GB 5:16/3.88 GB 0:9/2.07 GB 6:21/4.91 GB 2:10/2.33 GB 4:12/2.96 GB Filter 1 arrival: 1s788ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.28 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.54 MB, 126.53 MB, 101.20 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.42 MB (147246013) - PerHostPeakMemUsage: 1.32 GB (1417043785) - RowsProduced: 31.05M (31052610) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m7s - TotalStorageWaitTime: 162.718ms - TotalThreadsInvoluntaryContextSwitches: 3.50K (3495) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 673.895ms - TotalThreadsUserTime: 21s219ms - TotalThreadsVoluntaryContextSwitches: 48.23K (48235) Fragment Instance Lifecycle Timings: - ExecTime: 11m21s - ExecTreeExecTime: 5s150ms - OpenTime: 60.616ms - ExecTreeOpenTime: 159.558us - PrepareTime: 32.812ms - ExecTreePrepareTime: 808.463us DataStreamSender (dst_id=22):(Total: 3s619ms, non-child: 3s619ms, % non-child: 100.00%) - BytesSent: 560.72 MB (587957467) - OverallThroughput: 154.92 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.05M (31052610) - SerializeBatchTime: 3s612ms - UncompressedRowBatchSize: 560.72 MB (587957467) CodeGen:(Total: 83.374ms, non-child: 83.374ms, % non-child: 100.00%) - CodegenTime: 1.519ms - CompileTime: 10.303ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.492ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.069ms HDFS_SCAN_NODE (id=2):(Total: 5s129ms, non-child: 5s129ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:6/1.48 GB 1:5/1.17 GB 7:16/3.83 GB 5:16/3.88 GB 0:9/2.07 GB 6:21/4.91 GB 2:10/2.33 GB 4:12/2.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.26 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 179.16 MB - FooterProcessingTime: (Avg: 1.655ms ; Min: 405.457us ; Max: 2.989ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 203.49 MB (213375803) - BytesReadDataNodeCache: 0 - BytesReadLocal: 203.49 MB (213375803) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 203.49 MB (213375803) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 909.326ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828519) - PerReadThreadRawHdfsThroughput: 872.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.721ms - RowBatchQueuePutWaitTime: 55m49s - RowsRead: 31.05M (31052610) - RowsReturned: 31.05M (31052610) - RowsReturnedRate: 6.05 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.14K (2142) - ScannerThreadsTotalWallClockTime: 56m8s - MaterializeTupleTime(*): 2s583ms - ScannerThreadsSysTime: 223.963ms - ScannerThreadsUserTime: 11s973ms - ScannerThreadsVoluntaryContextSwitches: 33.20K (33198) - TotalRawHdfsReadTime(*): 233.181ms - TotalReadThroughput: 305.98 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 86 (86) - Files total: 95 (95) - RowGroups processed: 30.33K (30330) - RowGroups rejected: 0 (0) - RowGroups total: 30.33K (30330) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.05M (31052610) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 107.52K (107520) - Rows rejected: 0 (0) - Rows total: 31.05M (31052610) Filter 3 (2.00 MB): - Rows processed: 96.65K (96652) - Rows rejected: 0 (0) - Rows total: 31.05M (31052610) Instance 5f429df048b5534b:41bcce180000005b (host=foo.221.48:22000):(Total: 11m20s, non-child: 11m12s, % non-child: 98.78%) Hdfs split stats (:<# splits>/): 2:16/3.76 GB 3:9/1.93 GB 1:10/2.29 GB 6:15/3.55 GB 5:11/2.55 GB 0:15/3.41 GB 7:11/2.56 GB 4:13/2.54 GB Filter 1 arrival: 1s451ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 83.46 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.01 MB, 121.59 MB, 116.81 MB, 80.58 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 126.55 MB (132696943) - PerHostPeakMemUsage: 1.32 GB (1419969646) - RowsProduced: 25.25M (25247135) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m7s - TotalStorageWaitTime: 150.417ms - TotalThreadsInvoluntaryContextSwitches: 4.68K (4680) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 3s113ms - TotalThreadsUserTime: 32s261ms - TotalThreadsVoluntaryContextSwitches: 295.05K (295050) Fragment Instance Lifecycle Timings: - ExecTime: 11m20s - ExecTreeExecTime: 5s175ms - OpenTime: 65.953ms - ExecTreeOpenTime: 200.825us - PrepareTime: 32.918ms - ExecTreePrepareTime: 949.221us DataStreamSender (dst_id=22):(Total: 3s039ms, non-child: 3s039ms, % non-child: 100.00%) - BytesSent: 453.69 MB (475732438) - OverallThroughput: 149.26 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 25.25M (25247135) - SerializeBatchTime: 3s033ms - UncompressedRowBatchSize: 453.69 MB (475732438) CodeGen:(Total: 92.878ms, non-child: 92.878ms, % non-child: 100.00%) - CodegenTime: 1.498ms - CompileTime: 11.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.760ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.518ms HDFS_SCAN_NODE (id=2):(Total: 5s159ms, non-child: 5s159ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:16/3.76 GB 3:9/1.93 GB 1:10/2.29 GB 6:15/3.55 GB 5:11/2.55 GB 0:15/3.41 GB 7:11/2.56 GB 4:13/2.54 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:92 PARQUET/SNAPPY:24 BytesRead(16s000ms): 69.23 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 100.69 MB, 153.39 MB - FooterProcessingTime: (Avg: 1.724ms ; Min: 958.369us ; Max: 3.223ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 165.70 MB (173746592) - BytesReadDataNodeCache: 0 - BytesReadLocal: 165.70 MB (173746592) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 165.70 MB (173746592) - CachedFileHandlesHitCount: 45 (45) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 735.514ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 118.65 MB (124411072) - PerReadThreadRawHdfsThroughput: 857.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.312ms - RowBatchQueuePutWaitTime: 55m18s - RowsRead: 25.25M (25247135) - RowsReturned: 25.25M (25247135) - RowsReturnedRate: 4.89 M/sec - ScanRangesComplete: 100 (100) - ScannerThreadsInvoluntaryContextSwitches: 3.54K (3544) - ScannerThreadsTotalWallClockTime: 55m59s - MaterializeTupleTime(*): 2s089ms - ScannerThreadsSysTime: 2s712ms - ScannerThreadsUserTime: 24s536ms - ScannerThreadsVoluntaryContextSwitches: 280.09K (280089) - TotalRawHdfsReadTime(*): 193.158ms - TotalReadThroughput: 249.89 KB/sec Filter 1 (8.00 KB): - Files processed: 100 (100) - Files rejected: 92 (92) - Files total: 100 (100) - RowGroups processed: 24.66K (24659) - RowGroups rejected: 0 (0) - RowGroups total: 24.66K (24659) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 25.25M (25247135) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 92.16K (92160) - Rows rejected: 0 (0) - Rows total: 25.25M (25247135) Filter 3 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 25.25M (25247135) Instance 5f429df048b5534b:41bcce1800000012 (host=foo.221.40:22000):(Total: 11m20s, non-child: 11m11s, % non-child: 98.74%) Hdfs split stats (:<# splits>/): 5:12/2.76 GB 4:12/2.76 GB 1:8/1.97 GB 2:15/3.20 GB 7:12/2.82 GB 0:12/2.88 GB 6:11/2.48 GB 3:15/3.64 GB Filter 1 arrival: 1s555ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 94.18 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.76 MB, 136.93 MB, 121.53 MB, 82.36 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.32 MB (148183228) - PerHostPeakMemUsage: 1.23 GB (1324343334) - RowsProduced: 29.30M (29298895) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m6s - TotalStorageWaitTime: 163.027ms - TotalThreadsInvoluntaryContextSwitches: 4.21K (4213) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 570.911ms - TotalThreadsUserTime: 29s933ms - TotalThreadsVoluntaryContextSwitches: 43.96K (43962) Fragment Instance Lifecycle Timings: - ExecTime: 11m20s - ExecTreeExecTime: 5s147ms - OpenTime: 63.635ms - ExecTreeOpenTime: 197.879us - PrepareTime: 23.757ms - ExecTreePrepareTime: 566.072us DataStreamSender (dst_id=22):(Total: 3s339ms, non-child: 3s339ms, % non-child: 100.00%) - BytesSent: 528.59 MB (554263707) - OverallThroughput: 158.28 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 29.30M (29298895) - SerializeBatchTime: 3s332ms - UncompressedRowBatchSize: 528.59 MB (554263707) CodeGen:(Total: 82.375ms, non-child: 82.375ms, % non-child: 100.00%) - CodegenTime: 1.282ms - CompileTime: 10.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.340ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 19.167ms HDFS_SCAN_NODE (id=2):(Total: 5s128ms, non-child: 5s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:12/2.76 GB 4:12/2.76 GB 1:8/1.97 GB 2:15/3.20 GB 7:12/2.82 GB 0:12/2.88 GB 6:11/2.48 GB 3:15/3.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.20 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 171.10 MB - FooterProcessingTime: (Avg: 1.912ms ; Min: 906.317us ; Max: 5.526ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 191.27 MB (200559414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.27 MB (200559414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.27 MB (200559414) - CachedFileHandlesHitCount: 48 (48) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 840.893ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877315) - PerReadThreadRawHdfsThroughput: 755.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.366ms - RowBatchQueuePutWaitTime: 55m27s - RowsRead: 29.30M (29298895) - RowsReturned: 29.30M (29298895) - RowsReturnedRate: 5.71 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.04K (3036) - ScannerThreadsTotalWallClockTime: 55m51s - MaterializeTupleTime(*): 2s339ms - ScannerThreadsSysTime: 176.971ms - ScannerThreadsUserTime: 21s543ms - ScannerThreadsVoluntaryContextSwitches: 29.19K (29193) - TotalRawHdfsReadTime(*): 253.336ms - TotalReadThroughput: 288.66 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 89 (89) - Files total: 97 (97) - RowGroups processed: 28.62K (28616) - RowGroups rejected: 0 (0) - RowGroups total: 28.62K (28616) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 29.30M (29298895) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 96.26K (96256) - Rows rejected: 0 (0) - Rows total: 29.30M (29298895) Filter 3 (2.00 MB): - Rows processed: 77.82K (77824) - Rows rejected: 0 (0) - Rows total: 29.30M (29298895) Instance 5f429df048b5534b:41bcce180000006c (host=foo.221.45:22000):(Total: 11m19s, non-child: 11m11s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 3:16/3.81 GB 0:6/1.41 GB 7:14/3.17 GB 5:8/1.84 GB 2:15/3.56 GB 1:15/3.63 GB 6:8/1.84 GB 4:14/3.38 GB Filter 1 arrival: 1s486ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 83.79 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.88 MB, 100.88 MB, 93.01 MB ThreadUsage(16s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 126.37 MB (132512127) - PerHostPeakMemUsage: 1.22 GB (1309290671) - RowsProduced: 32.51M (32505451) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m5s - TotalStorageWaitTime: 181.931ms - TotalThreadsInvoluntaryContextSwitches: 3.91K (3910) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 3s945ms - TotalThreadsUserTime: 21s476ms - TotalThreadsVoluntaryContextSwitches: 408.79K (408787) Fragment Instance Lifecycle Timings: - ExecTime: 11m19s - ExecTreeExecTime: 5s132ms - OpenTime: 76.270ms - ExecTreeOpenTime: 207.676us - PrepareTime: 33.849ms - ExecTreePrepareTime: 895.390us DataStreamSender (dst_id=22):(Total: 3s739ms, non-child: 3s739ms, % non-child: 100.00%) - BytesSent: 581.85 MB (610113978) - OverallThroughput: 155.59 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.51M (32505451) - SerializeBatchTime: 3s731ms - UncompressedRowBatchSize: 581.85 MB (610113978) CodeGen:(Total: 104.482ms, non-child: 104.482ms, % non-child: 100.00%) - CodegenTime: 1.406ms - CompileTime: 14.908ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.289ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.817ms HDFS_SCAN_NODE (id=2):(Total: 5s110ms, non-child: 5s110ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:16/3.81 GB 0:6/1.41 GB 7:14/3.17 GB 5:8/1.84 GB 2:15/3.56 GB 1:15/3.63 GB 6:8/1.84 GB 4:14/3.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 68.67 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 99.89 MB, 108.13 MB, 201.62 MB - FooterProcessingTime: (Avg: 1.999ms ; Min: 805.151us ; Max: 5.310ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 213.06 MB (223408638) - BytesReadDataNodeCache: 0 - BytesReadLocal: 213.06 MB (223408638) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 213.06 MB (223408638) - CachedFileHandlesHitCount: 56 (56) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 942.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 118.39 MB (124143243) - PerReadThreadRawHdfsThroughput: 831.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.682ms - RowBatchQueuePutWaitTime: 55m19s - RowsRead: 32.51M (32505451) - RowsReturned: 32.51M (32505451) - RowsReturnedRate: 6.36 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.50K (2504) - ScannerThreadsTotalWallClockTime: 55m59s - MaterializeTupleTime(*): 2s608ms - ScannerThreadsSysTime: 3s523ms - ScannerThreadsUserTime: 11s864ms - ScannerThreadsVoluntaryContextSwitches: 393.72K (393719) - TotalRawHdfsReadTime(*): 256.280ms - TotalReadThroughput: 321.79 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 31.75K (31751) - RowGroups rejected: 0 (0) - RowGroups total: 31.75K (31751) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 32.51M (32505451) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 32.51M (32505451) Filter 3 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 32.51M (32505451) Instance 5f429df048b5534b:41bcce180000001e (host=foo.221.32:22000):(Total: 11m19s, non-child: 11m11s, % non-child: 98.81%) Hdfs split stats (:<# splits>/): 0:9/2.00 GB 6:12/2.96 GB 1:11/2.38 GB 2:10/2.46 GB 7:18/4.44 GB 3:12/2.61 GB 4:11/2.45 GB 5:14/3.16 GB Filter 1 arrival: 1s611ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.84 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.31 MB, 136.44 MB, 84.37 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.38 MB (148248517) - PerHostPeakMemUsage: 1.38 GB (1478564799) - RowsProduced: 24.58M (24580724) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m6s - TotalStorageWaitTime: 157.373ms - TotalThreadsInvoluntaryContextSwitches: 4.29K (4289) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 4s484ms - TotalThreadsUserTime: 29s385ms - TotalThreadsVoluntaryContextSwitches: 423.66K (423662) Fragment Instance Lifecycle Timings: - ExecTime: 11m19s - ExecTreeExecTime: 5s113ms - OpenTime: 63.767ms - ExecTreeOpenTime: 209.495us - PrepareTime: 32.761ms - ExecTreePrepareTime: 837.275us DataStreamSender (dst_id=22):(Total: 2s913ms, non-child: 2s913ms, % non-child: 100.00%) - BytesSent: 441.05 MB (462471440) - OverallThroughput: 151.39 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 24.58M (24580724) - SerializeBatchTime: 2s907ms - UncompressedRowBatchSize: 441.05 MB (462471440) CodeGen:(Total: 90.728ms, non-child: 90.728ms, % non-child: 100.00%) - CodegenTime: 1.410ms - CompileTime: 9.757ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.846ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.522ms HDFS_SCAN_NODE (id=2):(Total: 5s096ms, non-child: 5s096ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:9/2.00 GB 6:12/2.96 GB 1:11/2.38 GB 2:10/2.46 GB 7:18/4.44 GB 3:12/2.61 GB 4:11/2.45 GB 5:14/3.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:21 BytesRead(16s000ms): 82.18 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 131.06 MB - FooterProcessingTime: (Avg: 2.907ms ; Min: 651.539us ; Max: 9.016ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 160.53 MB (168328969) - BytesReadDataNodeCache: 0 - BytesReadLocal: 160.53 MB (168328969) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 160.53 MB (168328969) - CachedFileHandlesHitCount: 41 (41) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 704.669ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877317) - PerReadThreadRawHdfsThroughput: 772.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.556ms - RowBatchQueuePutWaitTime: 55m32s - RowsRead: 24.58M (24580724) - RowsReturned: 24.58M (24580724) - RowsReturnedRate: 4.82 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 3.23K (3235) - ScannerThreadsTotalWallClockTime: 55m59s - MaterializeTupleTime(*): 1s994ms - ScannerThreadsSysTime: 4s076ms - ScannerThreadsUserTime: 21s982ms - ScannerThreadsVoluntaryContextSwitches: 408.66K (408656) - TotalRawHdfsReadTime(*): 207.888ms - TotalReadThroughput: 242.27 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 90 (90) - Files total: 97 (97) - RowGroups processed: 24.01K (24008) - RowGroups rejected: 0 (0) - RowGroups total: 24.01K (24008) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 24.58M (24580724) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Filter 2 (2.00 MB): - Rows processed: 60.42K (60416) - Rows rejected: 0 (0) - Rows total: 24.58M (24580724) Filter 3 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 24.58M (24580724) Instance 5f429df048b5534b:41bcce180000004f (host=foo.221.38:22000):(Total: 11m17s, non-child: 11m9s, % non-child: 98.74%) Hdfs split stats (:<# splits>/): 5:10/2.14 GB 1:9/2.02 GB 7:18/4.23 GB 3:17/4.01 GB 4:8/1.97 GB 6:12/2.81 GB 0:10/2.24 GB 2:12/2.96 GB Filter 1 arrival: 1s557ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.33 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.48 MB, 135.78 MB, 121.05 MB, 81.53 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.32 MB (147132611) - PerHostPeakMemUsage: 1.31 GB (1403689644) - RowsProduced: 29.28M (29276887) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m3s - TotalStorageWaitTime: 152.489ms - TotalThreadsInvoluntaryContextSwitches: 4.14K (4141) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 602.905ms - TotalThreadsUserTime: 29s469ms - TotalThreadsVoluntaryContextSwitches: 44.41K (44410) Fragment Instance Lifecycle Timings: - ExecTime: 11m17s - ExecTreeExecTime: 5s152ms - OpenTime: 70.592ms - ExecTreeOpenTime: 189.075us - PrepareTime: 28.605ms - ExecTreePrepareTime: 857.833us DataStreamSender (dst_id=22):(Total: 3s348ms, non-child: 3s348ms, % non-child: 100.00%) - BytesSent: 523.23 MB (548647031) - OverallThroughput: 156.27 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 29.28M (29276887) - SerializeBatchTime: 3s340ms - UncompressedRowBatchSize: 523.23 MB (548647031) CodeGen:(Total: 93.183ms, non-child: 93.183ms, % non-child: 100.00%) - CodegenTime: 1.566ms - CompileTime: 10.322ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 59.023ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.276ms HDFS_SCAN_NODE (id=2):(Total: 5s133ms, non-child: 5s133ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:10/2.14 GB 1:9/2.02 GB 7:18/4.23 GB 3:17/4.01 GB 4:8/1.97 GB 6:12/2.81 GB 0:10/2.24 GB 2:12/2.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 173.35 MB - FooterProcessingTime: (Avg: 1.397ms ; Min: 656.268us ; Max: 2.813ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 191.28 MB (200568960) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.28 MB (200568960) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.28 MB (200568960) - CachedFileHandlesHitCount: 48 (48) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 864.809ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828688) - PerReadThreadRawHdfsThroughput: 948.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.887ms - RowBatchQueuePutWaitTime: 55m24s - RowsRead: 29.28M (29276887) - RowsReturned: 29.28M (29276887) - RowsReturnedRate: 5.70 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.91K (2913) - ScannerThreadsTotalWallClockTime: 55m44s - MaterializeTupleTime(*): 2s412ms - ScannerThreadsSysTime: 161.972ms - ScannerThreadsUserTime: 20s854ms - ScannerThreadsVoluntaryContextSwitches: 29.23K (29227) - TotalRawHdfsReadTime(*): 201.592ms - TotalReadThroughput: 289.10 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 88 (88) - Files total: 96 (96) - RowGroups processed: 28.59K (28595) - RowGroups rejected: 0 (0) - RowGroups total: 28.59K (28595) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 29.28M (29276887) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 115.71K (115712) - Rows rejected: 0 (0) - Rows total: 29.28M (29276887) Filter 3 (2.00 MB): - Rows processed: 104.45K (104448) - Rows rejected: 0 (0) - Rows total: 29.28M (29276887) Instance 5f429df048b5534b:41bcce180000003e (host=foo.221.46:22000):(Total: 11m17s, non-child: 11m9s, % non-child: 98.74%) Hdfs split stats (:<# splits>/): 6:7/1.66 GB 4:19/4.54 GB 7:11/2.64 GB 2:11/2.64 GB 3:12/2.81 GB 0:12/2.77 GB 1:11/2.56 GB 5:12/2.96 GB Filter 1 arrival: 1s480ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.02 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.64 MB, 121.80 MB, 78.07 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.41 MB (141984498) - PerHostPeakMemUsage: 1.38 GB (1481371800) - RowsProduced: 28.17M (28167163) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m3s - TotalStorageWaitTime: 151.499ms - TotalThreadsInvoluntaryContextSwitches: 3.66K (3661) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 771.880ms - TotalThreadsUserTime: 26s782ms - TotalThreadsVoluntaryContextSwitches: 66.03K (66029) Fragment Instance Lifecycle Timings: - ExecTime: 11m17s - ExecTreeExecTime: 5s140ms - OpenTime: 61.732ms - ExecTreeOpenTime: 281.124us - PrepareTime: 35.059ms - ExecTreePrepareTime: 1.137ms DataStreamSender (dst_id=22):(Total: 3s301ms, non-child: 3s301ms, % non-child: 100.00%) - BytesSent: 508.01 MB (532682472) - OverallThroughput: 153.89 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.17M (28167163) - SerializeBatchTime: 3s293ms - UncompressedRowBatchSize: 508.01 MB (532682472) CodeGen:(Total: 87.224ms, non-child: 87.224ms, % non-child: 100.00%) - CodegenTime: 1.240ms - CompileTime: 9.984ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.647ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.981ms HDFS_SCAN_NODE (id=2):(Total: 5s121ms, non-child: 5s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:7/1.66 GB 4:19/4.54 GB 7:11/2.64 GB 2:11/2.64 GB 3:12/2.81 GB 0:12/2.77 GB 1:11/2.56 GB 5:12/2.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:24 BytesRead(16s000ms): 77.43 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.63 MB, 164.18 MB - FooterProcessingTime: (Avg: 1.383ms ; Min: 307.383us ; Max: 3.248ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 184.35 MB (193302212) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.35 MB (193302212) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.35 MB (193302212) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 812.970ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585853) - PerReadThreadRawHdfsThroughput: 831.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.688ms - RowBatchQueuePutWaitTime: 55m15s - RowsRead: 28.17M (28167163) - RowsReturned: 28.17M (28167163) - RowsReturnedRate: 5.50 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.47K (2468) - ScannerThreadsTotalWallClockTime: 55m33s - MaterializeTupleTime(*): 2s310ms - ScannerThreadsSysTime: 341.945ms - ScannerThreadsUserTime: 18s374ms - ScannerThreadsVoluntaryContextSwitches: 50.51K (50506) - TotalRawHdfsReadTime(*): 221.777ms - TotalReadThroughput: 279.45 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 87 (87) - Files total: 95 (95) - RowGroups processed: 27.51K (27511) - RowGroups rejected: 0 (0) - RowGroups total: 27.51K (27511) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.17M (28167163) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 95.23K (95232) - Rows rejected: 0 (0) - Rows total: 28.17M (28167163) Filter 3 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 28.17M (28167163) Instance 5f429df048b5534b:41bcce1800000048 (host=foo.221.21:22000):(Total: 11m17s, non-child: 11m8s, % non-child: 98.70%) Hdfs split stats (:<# splits>/): 5:6/1.28 GB 1:11/2.71 GB 4:11/2.38 GB 0:16/3.94 GB 7:18/4.12 GB 2:11/2.58 GB 3:9/2.18 GB 6:14/3.20 GB Filter 1 arrival: 1s759ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 91.98 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.18 MB, 133.48 MB, 116.30 MB, 91.90 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.40 MB (146174383) - PerHostPeakMemUsage: 1.40 GB (1500370086) - RowsProduced: 30.74M (30740586) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m2s - TotalStorageWaitTime: 182.103ms - TotalThreadsInvoluntaryContextSwitches: 3.33K (3331) - TotalThreadsTotalWallClockTime: 1h7m - TotalThreadsSysTime: 684.895ms - TotalThreadsUserTime: 20s663ms - TotalThreadsVoluntaryContextSwitches: 47.10K (47101) Fragment Instance Lifecycle Timings: - ExecTime: 11m17s - ExecTreeExecTime: 5s139ms - OpenTime: 67.906ms - ExecTreeOpenTime: 208.574us - PrepareTime: 34.935ms - ExecTreePrepareTime: 717.507us DataStreamSender (dst_id=22):(Total: 3s559ms, non-child: 3s559ms, % non-child: 100.00%) - BytesSent: 554.92 MB (581879563) - OverallThroughput: 155.92 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 30.74M (30740586) - SerializeBatchTime: 3s550ms - UncompressedRowBatchSize: 554.92 MB (581879563) CodeGen:(Total: 96.868ms, non-child: 96.868ms, % non-child: 100.00%) - CodegenTime: 1.555ms - CompileTime: 11.724ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 55.102ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.442ms HDFS_SCAN_NODE (id=2):(Total: 5s118ms, non-child: 5s118ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:6/1.28 GB 1:11/2.71 GB 4:11/2.38 GB 0:16/3.94 GB 7:18/4.12 GB 2:11/2.58 GB 3:9/2.18 GB 6:14/3.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s935ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:27 BytesRead(16s000ms): 77.38 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 112.56 MB, 188.75 MB - FooterProcessingTime: (Avg: 1.638ms ; Min: 553.438us ; Max: 3.126ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 201.34 MB (211119856) - BytesReadDataNodeCache: 0 - BytesReadLocal: 201.34 MB (211119856) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 201.34 MB (211119856) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 895.177ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780424) - PerReadThreadRawHdfsThroughput: 821.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.287ms - RowBatchQueuePutWaitTime: 55m25s - RowsRead: 30.74M (30740586) - RowsReturned: 30.74M (30740586) - RowsReturnedRate: 6.01 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.09K (2091) - ScannerThreadsTotalWallClockTime: 55m55s - MaterializeTupleTime(*): 2s520ms - ScannerThreadsSysTime: 233.963ms - ScannerThreadsUserTime: 11s547ms - ScannerThreadsVoluntaryContextSwitches: 32.05K (32045) - TotalRawHdfsReadTime(*): 245.126ms - TotalReadThroughput: 304.76 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 87 (87) - Files total: 96 (96) - RowGroups processed: 30.02K (30025) - RowGroups rejected: 0 (0) - RowGroups total: 30.02K (30025) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 30.74M (30740586) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 107.52K (107520) - Rows rejected: 0 (0) - Rows total: 30.74M (30740586) Filter 3 (2.00 MB): - Rows processed: 109.57K (109568) - Rows rejected: 0 (0) - Rows total: 30.74M (30740586) Instance 5f429df048b5534b:41bcce180000007e (host=foo.187.47:22000):(Total: 11m10s, non-child: 11m, % non-child: 98.52%) Hdfs split stats (:<# splits>/): 5:7/1.63 GB 7:14/3.31 GB 4:14/3.03 GB 3:14/3.12 GB 2:10/2.43 GB 0:9/1.81 GB 6:12/2.76 GB 1:19/4.43 GB Filter 1 arrival: 2s227ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 89.33 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.11 MB, 135.10 MB, 116.25 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.19 MB (145947325) - PerHostPeakMemUsage: 1.23 GB (1315490468) - RowsProduced: 46.16M (46158097) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m52s - TotalStorageWaitTime: 260.895ms - TotalThreadsInvoluntaryContextSwitches: 3.72K (3723) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 908.860ms - TotalThreadsUserTime: 18s599ms - TotalThreadsVoluntaryContextSwitches: 73.66K (73661) Fragment Instance Lifecycle Timings: - ExecTime: 11m10s - ExecTreeExecTime: 5s181ms - OpenTime: 65.244ms - ExecTreeOpenTime: 175.783us - PrepareTime: 41.913ms - ExecTreePrepareTime: 468.886us DataStreamSender (dst_id=22):(Total: 4s693ms, non-child: 4s693ms, % non-child: 100.00%) - BytesSent: 832.82 MB (873271972) - OverallThroughput: 177.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 46.16M (46158097) - SerializeBatchTime: 4s683ms - UncompressedRowBatchSize: 832.82 MB (873271972) CodeGen:(Total: 102.921ms, non-child: 102.921ms, % non-child: 100.00%) - CodegenTime: 1.608ms - CompileTime: 9.773ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.149ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 38.431ms HDFS_SCAN_NODE (id=2):(Total: 5s153ms, non-child: 5s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:7/1.63 GB 7:14/3.31 GB 4:14/3.03 GB 3:14/3.12 GB 2:10/2.43 GB 0:9/1.81 GB 6:12/2.76 GB 1:19/4.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:99.93% 1:0% 2:0% 3:0% 4:0% 5:0.07474% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:42 BytesRead(16s000ms): 74.06 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB, 112.83 MB - FooterProcessingTime: (Avg: 1.561ms ; Min: 643.416us ; Max: 2.942ms ; Number of samples: 14) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 302.06 MB (316731313) - BytesReadDataNodeCache: 0 - BytesReadLocal: 302.06 MB (316731313) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 302.06 MB (316731313) - CachedFileHandlesHitCount: 80 (80) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s296ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 14 (14) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137779790) - PerReadThreadRawHdfsThroughput: 826.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.074ms - RowBatchQueuePutWaitTime: 55m - RowsRead: 46.16M (46158097) - RowsReturned: 46.16M (46158097) - RowsReturnedRate: 8.96 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2285) - ScannerThreadsTotalWallClockTime: 55m31s - MaterializeTupleTime(*): 3s630ms - ScannerThreadsSysTime: 331.948ms - ScannerThreadsUserTime: 6s979ms - ScannerThreadsVoluntaryContextSwitches: 57.96K (57964) - TotalRawHdfsReadTime(*): 365.339ms - TotalReadThroughput: 462.00 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 85 (85) - Files total: 99 (99) - RowGroups processed: 45.08K (45083) - RowGroups rejected: 0 (0) - RowGroups total: 45.08K (45083) - Rows processed: 229.38K (229376) - Rows rejected: 0 (0) - Rows total: 46.16M (46158097) - Splits processed: 14 (14) - Splits rejected: 0 (0) - Splits total: 14 (14) Filter 2 (2.00 MB): - Rows processed: 210.94K (210944) - Rows rejected: 0 (0) - Rows total: 46.16M (46158097) Filter 3 (2.00 MB): - Rows processed: 179.20K (179200) - Rows rejected: 0 (0) - Rows total: 46.16M (46158097) Instance 5f429df048b5534b:41bcce1800000078 (host=foo.187.55:22000):(Total: 11m9s, non-child: 10m59s, % non-child: 98.55%) Hdfs split stats (:<# splits>/): 1:11/2.71 GB 7:10/2.34 GB 6:13/2.95 GB 4:11/2.38 GB 2:8/1.97 GB 3:11/2.71 GB 0:14/3.24 GB 5:18/4.25 GB Filter 1 arrival: 2s020ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.81 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.36 MB, 134.74 MB, 124.50 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.08 MB (146884993) - PerHostPeakMemUsage: 1.31 GB (1401305784) - RowsProduced: 42.77M (42770938) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m52s - TotalStorageWaitTime: 258.296ms - TotalThreadsInvoluntaryContextSwitches: 3.81K (3815) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 891.864ms - TotalThreadsUserTime: 20s059ms - TotalThreadsVoluntaryContextSwitches: 71.66K (71658) Fragment Instance Lifecycle Timings: - ExecTime: 11m9s - ExecTreeExecTime: 5s188ms - OpenTime: 73.015ms - ExecTreeOpenTime: 394.938us - PrepareTime: 28.303ms - ExecTreePrepareTime: 705.657us DataStreamSender (dst_id=22):(Total: 4s474ms, non-child: 4s474ms, % non-child: 100.00%) - BytesSent: 771.11 MB (808563262) - OverallThroughput: 172.34 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 42.77M (42770938) - SerializeBatchTime: 4s465ms - UncompressedRowBatchSize: 771.11 MB (808563262) CodeGen:(Total: 95.063ms, non-child: 95.063ms, % non-child: 100.00%) - CodegenTime: 1.462ms - CompileTime: 11.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.078ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 22.877ms HDFS_SCAN_NODE (id=2):(Total: 5s162ms, non-child: 5s162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.71 GB 7:10/2.34 GB 6:13/2.95 GB 4:11/2.38 GB 2:8/1.97 GB 3:11/2.71 GB 0:14/3.24 GB 5:18/4.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s920ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:36 BytesRead(16s000ms): 82.20 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB - FooterProcessingTime: (Avg: 1.683ms ; Min: 495.272us ; Max: 3.387ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 279.66 MB (293249767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 279.66 MB (293249767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 279.66 MB (293249767) - CachedFileHandlesHitCount: 71 (71) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s208ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828746) - PerReadThreadRawHdfsThroughput: 769.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.535ms - RowBatchQueuePutWaitTime: 54m59s - RowsRead: 42.77M (42770938) - RowsReturned: 42.77M (42770938) - RowsReturnedRate: 8.28 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.40K (2396) - ScannerThreadsTotalWallClockTime: 55m8s - MaterializeTupleTime(*): 3s367ms - ScannerThreadsSysTime: 327.949ms - ScannerThreadsUserTime: 8s935ms - ScannerThreadsVoluntaryContextSwitches: 56.17K (56168) - TotalRawHdfsReadTime(*): 363.673ms - TotalReadThroughput: 428.39 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 84 (84) - Files total: 96 (96) - RowGroups processed: 41.77K (41775) - RowGroups rejected: 0 (0) - RowGroups total: 41.77K (41775) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 42.77M (42770938) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 42.77M (42770938) Filter 3 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 42.77M (42770938) Instance 5f429df048b5534b:41bcce180000007b (host=foo.187.41:22000):(Total: 11m8s, non-child: 10m59s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 3:9/2.15 GB 0:14/3.45 GB 7:12/2.96 GB 2:10/2.40 GB 5:11/2.55 GB 1:20/4.68 GB 4:11/2.45 GB 6:10/2.12 GB Filter 1 arrival: 2s195ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.30 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.13 MB, 131.37 MB, 115.84 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 136.15 MB (142764777) - PerHostPeakMemUsage: 1.30 GB (1397928494) - RowsProduced: 38.19M (38191852) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m53s - TotalStorageWaitTime: 206.176ms - TotalThreadsInvoluntaryContextSwitches: 3.40K (3395) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 2s627ms - TotalThreadsUserTime: 17s306ms - TotalThreadsVoluntaryContextSwitches: 298.69K (298689) Fragment Instance Lifecycle Timings: - ExecTime: 11m8s - ExecTreeExecTime: 5s161ms - OpenTime: 61.633ms - ExecTreeOpenTime: 182.085us - PrepareTime: 28.751ms - ExecTreePrepareTime: 854.471us DataStreamSender (dst_id=22):(Total: 3s898ms, non-child: 3s898ms, % non-child: 100.00%) - BytesSent: 686.54 MB (719884765) - OverallThroughput: 176.09 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.19M (38191852) - SerializeBatchTime: 3s889ms - UncompressedRowBatchSize: 686.54 MB (719884765) CodeGen:(Total: 85.056ms, non-child: 85.056ms, % non-child: 100.00%) - CodegenTime: 1.392ms - CompileTime: 9.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.805ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.980ms HDFS_SCAN_NODE (id=2):(Total: 5s139ms, non-child: 5s139ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/2.15 GB 0:14/3.45 GB 7:12/2.96 GB 2:10/2.40 GB 5:11/2.55 GB 1:20/4.68 GB 4:11/2.45 GB 6:10/2.12 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.53 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB, 112.78 MB - FooterProcessingTime: (Avg: 2.143ms ; Min: 684.277us ; Max: 6.349ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 250.06 MB (262210470) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.06 MB (262210470) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.06 MB (262210470) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s082ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.40 MB (134634752) - PerReadThreadRawHdfsThroughput: 849.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.393ms - RowBatchQueuePutWaitTime: 54m48s - RowsRead: 38.19M (38191852) - RowsReturned: 38.19M (38191852) - RowsReturnedRate: 7.43 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.16K (2162) - ScannerThreadsTotalWallClockTime: 55m - MaterializeTupleTime(*): 3s002ms - ScannerThreadsSysTime: 2s129ms - ScannerThreadsUserTime: 7s727ms - ScannerThreadsVoluntaryContextSwitches: 283.92K (283920) - TotalRawHdfsReadTime(*): 294.442ms - TotalReadThroughput: 383.91 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 37.30K (37303) - RowGroups rejected: 0 (0) - RowGroups total: 37.30K (37303) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 38.19M (38191852) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 168.96K (168960) - Rows rejected: 0 (0) - Rows total: 38.19M (38191852) Filter 3 (2.00 MB): - Rows processed: 130.05K (130048) - Rows rejected: 0 (0) - Rows total: 38.19M (38191852) Instance 5f429df048b5534b:41bcce1800000014 (host=foo.187.54:22000):(Total: 11m8s, non-child: 10m58s, % non-child: 98.58%) Hdfs split stats (:<# splits>/): 3:9/2.15 GB 7:7/1.46 GB 0:8/1.78 GB 1:14/3.17 GB 4:19/4.48 GB 5:15/3.56 GB 2:15/3.33 GB 6:11/2.47 GB Filter 1 arrival: 1s938ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 74.98 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 108.80 MB, 109.06 MB, 101.90 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 114.08 MB (119626418) - PerHostPeakMemUsage: 1.23 GB (1321242967) - RowsProduced: 41.47M (41472148) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m52s - TotalStorageWaitTime: 284.459ms - TotalThreadsInvoluntaryContextSwitches: 3.97K (3968) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s144ms - TotalThreadsUserTime: 17s722ms - TotalThreadsVoluntaryContextSwitches: 115.35K (115354) Fragment Instance Lifecycle Timings: - ExecTime: 11m8s - ExecTreeExecTime: 5s184ms - OpenTime: 68.819ms - ExecTreeOpenTime: 236.598us - PrepareTime: 31.558ms - ExecTreePrepareTime: 999.912us DataStreamSender (dst_id=22):(Total: 4s213ms, non-child: 4s213ms, % non-child: 100.00%) - BytesSent: 746.94 MB (783224747) - OverallThroughput: 177.28 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.47M (41472148) - SerializeBatchTime: 4s204ms - UncompressedRowBatchSize: 746.94 MB (783224747) CodeGen:(Total: 94.571ms, non-child: 94.571ms, % non-child: 100.00%) - CodegenTime: 1.454ms - CompileTime: 11.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.011ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.311ms HDFS_SCAN_NODE (id=2):(Total: 5s159ms, non-child: 5s159ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/2.15 GB 7:7/1.46 GB 0:8/1.78 GB 1:14/3.17 GB 4:19/4.48 GB 5:15/3.56 GB 2:15/3.33 GB 6:11/2.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s935ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:39 BytesRead(16s000ms): 64.08 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 93.21 MB, 104.41 MB - FooterProcessingTime: (Avg: 1.332ms ; Min: 199.169us ; Max: 5.580ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 271.47 MB (284657352) - BytesReadDataNodeCache: 0 - BytesReadLocal: 271.47 MB (284657352) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 271.47 MB (284657352) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s147ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 107.07 MB (112276120) - PerReadThreadRawHdfsThroughput: 707.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.832ms - RowBatchQueuePutWaitTime: 54m47s - RowsRead: 41.47M (41472148) - RowsReturned: 41.47M (41472148) - RowsReturnedRate: 8.04 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.66K (2656) - ScannerThreadsTotalWallClockTime: 54m57s - MaterializeTupleTime(*): 3s242ms - ScannerThreadsSysTime: 664.896ms - ScannerThreadsUserTime: 7s140ms - ScannerThreadsVoluntaryContextSwitches: 100.00K (100002) - TotalRawHdfsReadTime(*): 383.532ms - TotalReadThroughput: 416.46 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 85 (85) - Files total: 98 (98) - RowGroups processed: 40.51K (40507) - RowGroups rejected: 0 (0) - RowGroups total: 40.51K (40507) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 41.47M (41472148) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 176.13K (176128) - Rows rejected: 0 (0) - Rows total: 41.47M (41472148) Filter 3 (2.00 MB): - Rows processed: 173.06K (173056) - Rows rejected: 0 (0) - Rows total: 41.47M (41472148) Instance 5f429df048b5534b:41bcce1800000045 (host=foo.246.48:22000):(Total: 11m8s, non-child: 10m57s, % non-child: 98.47%) Hdfs split stats (:<# splits>/): 6:6/1.34 GB 4:16/3.82 GB 0:10/2.42 GB 5:13/2.96 GB 7:16/3.87 GB 2:13/3.12 GB 3:13/3.07 GB 1:9/2.15 GB Filter 1 arrival: 127ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.66 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.60 MB, 122.53 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.25 MB (147059005) - PerHostPeakMemUsage: 1.20 GB (1291562661) - RowsProduced: 45.49M (45491670) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m50s - TotalStorageWaitTime: 230.525ms - TotalThreadsInvoluntaryContextSwitches: 3.63K (3632) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 791.877ms - TotalThreadsUserTime: 21s070ms - TotalThreadsVoluntaryContextSwitches: 60.86K (60861) Fragment Instance Lifecycle Timings: - ExecTime: 11m7s - ExecTreeExecTime: 5s245ms - OpenTime: 65.128ms - ExecTreeOpenTime: 171.042us - PrepareTime: 33.683ms - ExecTreePrepareTime: 741.588us DataStreamSender (dst_id=22):(Total: 4s929ms, non-child: 4s929ms, % non-child: 100.00%) - BytesSent: 815.35 MB (854954114) - OverallThroughput: 165.39 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 45.49M (45491670) - SerializeBatchTime: 4s918ms - UncompressedRowBatchSize: 815.35 MB (854954114) CodeGen:(Total: 92.466ms, non-child: 92.466ms, % non-child: 100.00%) - CodegenTime: 1.405ms - CompileTime: 10.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.058ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.918ms HDFS_SCAN_NODE (id=2):(Total: 5s218ms, non-child: 5s218ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:6/1.34 GB 4:16/3.82 GB 0:10/2.42 GB 5:13/2.96 GB 7:16/3.87 GB 2:13/3.12 GB 3:13/3.07 GB 1:9/2.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:39 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB - FooterProcessingTime: (Avg: 1.063ms ; Min: 714.649us ; Max: 2.358ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 297.62 MB (312078134) - BytesReadDataNodeCache: 0 - BytesReadLocal: 297.62 MB (312078134) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 297.62 MB (312078134) - CachedFileHandlesHitCount: 76 (76) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s293ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828482) - PerReadThreadRawHdfsThroughput: 644.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 58.450ms - RowBatchQueuePutWaitTime: 54m42s - RowsRead: 45.49M (45491670) - RowsReturned: 45.49M (45491670) - RowsReturnedRate: 8.72 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.12K (2118) - ScannerThreadsTotalWallClockTime: 54m58s - MaterializeTupleTime(*): 3s576ms - ScannerThreadsSysTime: 185.969ms - ScannerThreadsUserTime: 9s002ms - ScannerThreadsVoluntaryContextSwitches: 45.52K (45525) - TotalRawHdfsReadTime(*): 461.618ms - TotalReadThroughput: 456.57 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 83 (83) - Files total: 96 (96) - RowGroups processed: 44.43K (44432) - RowGroups rejected: 0 (0) - RowGroups total: 44.43K (44432) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 45.49M (45491670) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 187.39K (187392) - Rows rejected: 0 (0) - Rows total: 45.49M (45491670) Filter 3 (2.00 MB): - Rows processed: 171.01K (171008) - Rows rejected: 0 (0) - Rows total: 45.49M (45491670) Instance 5f429df048b5534b:41bcce180000006d (host=foo.187.48:22000):(Total: 11m7s, non-child: 10m58s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 3:6/1.44 GB 2:8/1.92 GB 6:15/3.57 GB 1:13/2.79 GB 0:13/3.13 GB 4:17/3.98 GB 5:12/2.84 GB 7:13/3.13 GB Filter 1 arrival: 2s160ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.45 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.51 MB, 135.73 MB, 115.82 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.78 MB (147614380) - PerHostPeakMemUsage: 1.30 GB (1400009380) - RowsProduced: 39.56M (39564105) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m52s - TotalStorageWaitTime: 213.243ms - TotalThreadsInvoluntaryContextSwitches: 3.62K (3624) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s284ms - TotalThreadsUserTime: 18s205ms - TotalThreadsVoluntaryContextSwitches: 118.55K (118548) Fragment Instance Lifecycle Timings: - ExecTime: 11m7s - ExecTreeExecTime: 5s171ms - OpenTime: 59.476ms - ExecTreeOpenTime: 162.862us - PrepareTime: 24.490ms - ExecTreePrepareTime: 522.114us DataStreamSender (dst_id=22):(Total: 3s971ms, non-child: 3s971ms, % non-child: 100.00%) - BytesSent: 711.57 MB (746132008) - OverallThroughput: 179.18 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.56M (39564105) - SerializeBatchTime: 3s961ms - UncompressedRowBatchSize: 711.57 MB (746132008) CodeGen:(Total: 78.344ms, non-child: 78.344ms, % non-child: 100.00%) - CodegenTime: 1.372ms - CompileTime: 9.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.544ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 19.236ms HDFS_SCAN_NODE (id=2):(Total: 5s148ms, non-child: 5s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:6/1.44 GB 2:8/1.92 GB 6:15/3.57 GB 1:13/2.79 GB 0:13/3.13 GB 4:17/3.98 GB 5:12/2.84 GB 7:13/3.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:36 BytesRead(16s000ms): 82.21 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB - FooterProcessingTime: (Avg: 1.815ms ; Min: 655.417us ; Max: 3.242ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 259.59 MB (272201046) - BytesReadDataNodeCache: 0 - BytesReadLocal: 259.59 MB (272201046) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 259.59 MB (272201046) - CachedFileHandlesHitCount: 68 (68) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s134ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877715) - PerReadThreadRawHdfsThroughput: 861.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.650ms - RowBatchQueuePutWaitTime: 54m50s - RowsRead: 39.56M (39564105) - RowsReturned: 39.56M (39564105) - RowsReturnedRate: 7.68 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.33K (2325) - ScannerThreadsTotalWallClockTime: 55m21s - MaterializeTupleTime(*): 3s147ms - ScannerThreadsSysTime: 801.876ms - ScannerThreadsUserTime: 8s451ms - ScannerThreadsVoluntaryContextSwitches: 103.51K (103509) - TotalRawHdfsReadTime(*): 301.203ms - TotalReadThroughput: 398.83 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 85 (85) - Files total: 97 (97) - RowGroups processed: 38.64K (38643) - RowGroups rejected: 0 (0) - RowGroups total: 38.64K (38643) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 39.56M (39564105) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 151.55K (151552) - Rows rejected: 0 (0) - Rows total: 39.56M (39564105) Filter 3 (2.00 MB): - Rows processed: 173.06K (173056) - Rows rejected: 0 (0) - Rows total: 39.56M (39564105) Instance 5f429df048b5534b:41bcce1800000033 (host=foo.187.53:22000):(Total: 11m7s, non-child: 10m58s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 6:8/1.83 GB 7:13/3.20 GB 2:8/1.97 GB 4:13/3.06 GB 0:14/3.13 GB 1:11/2.64 GB 5:12/2.82 GB 3:16/3.72 GB Filter 1 arrival: 1s876ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 90.66 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 131.81 MB, 132.02 MB, 121.51 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.82 MB (142420810) - PerHostPeakMemUsage: 1.23 GB (1320013673) - RowsProduced: 38.11M (38111689) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m52s - TotalStorageWaitTime: 223.023ms - TotalThreadsInvoluntaryContextSwitches: 3.29K (3290) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s138ms - TotalThreadsUserTime: 18s761ms - TotalThreadsVoluntaryContextSwitches: 120.81K (120807) Fragment Instance Lifecycle Timings: - ExecTime: 11m7s - ExecTreeExecTime: 5s172ms - OpenTime: 61.589ms - ExecTreeOpenTime: 173.951us - PrepareTime: 38.896ms - ExecTreePrepareTime: 775.961us DataStreamSender (dst_id=22):(Total: 3s896ms, non-child: 3s896ms, % non-child: 100.00%) - BytesSent: 681.87 MB (714997402) - OverallThroughput: 174.98 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.11M (38111689) - SerializeBatchTime: 3s888ms - UncompressedRowBatchSize: 681.87 MB (714997402) CodeGen:(Total: 90.695ms, non-child: 90.695ms, % non-child: 100.00%) - CodegenTime: 1.314ms - CompileTime: 8.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.816ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.478ms HDFS_SCAN_NODE (id=2):(Total: 5s148ms, non-child: 5s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:8/1.83 GB 7:13/3.20 GB 2:8/1.97 GB 4:13/3.06 GB 0:14/3.13 GB 1:11/2.64 GB 5:12/2.82 GB 3:16/3.72 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.11 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB, 112.16 MB - FooterProcessingTime: (Avg: 3.116ms ; Min: 431.204us ; Max: 18.421ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 249.12 MB (261223351) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.12 MB (261223351) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.12 MB (261223351) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s064ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.40 MB (134634846) - PerReadThreadRawHdfsThroughput: 853.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.903ms - RowBatchQueuePutWaitTime: 54m50s - RowsRead: 38.11M (38111696) - RowsReturned: 38.11M (38111689) - RowsReturnedRate: 7.40 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.03K (2030) - ScannerThreadsTotalWallClockTime: 55m3s - MaterializeTupleTime(*): 3s018ms - ScannerThreadsSysTime: 697.891ms - ScannerThreadsUserTime: 9s037ms - ScannerThreadsVoluntaryContextSwitches: 105.18K (105179) - TotalRawHdfsReadTime(*): 291.969ms - TotalReadThroughput: 382.46 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 84 (84) - Files total: 95 (95) - RowGroups processed: 37.22K (37222) - RowGroups rejected: 0 (0) - RowGroups total: 37.22K (37222) - Rows processed: 180.23K (180231) - Rows rejected: 0 (0) - Rows total: 38.11M (38111696) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 135.18K (135175) - Rows rejected: 5 (5) - Rows total: 38.11M (38111696) Filter 3 (2.00 MB): - Rows processed: 146.43K (146434) - Rows rejected: 2 (2) - Rows total: 38.11M (38111691) Instance 5f429df048b5534b:41bcce180000000e (host=foo.187.51:22000):(Total: 11m7s, non-child: 10m58s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 2:7/1.59 GB 6:14/3.10 GB 5:14/3.38 GB 0:8/1.94 GB 4:13/3.13 GB 7:7/1.73 GB 1:15/3.52 GB 3:18/4.33 GB Filter 1 arrival: 1s980ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.69 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.47 MB, 134.77 MB, 118.02 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.11 MB (146916059) - PerHostPeakMemUsage: 1.23 GB (1324771929) - RowsProduced: 39.24M (39236131) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 223.203ms - TotalThreadsInvoluntaryContextSwitches: 3.45K (3450) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s272ms - TotalThreadsUserTime: 17s605ms - TotalThreadsVoluntaryContextSwitches: 94.96K (94960) Fragment Instance Lifecycle Timings: - ExecTime: 11m7s - ExecTreeExecTime: 5s166ms - OpenTime: 59.926ms - ExecTreeOpenTime: 169.615us - PrepareTime: 39.253ms - ExecTreePrepareTime: 1.065ms DataStreamSender (dst_id=22):(Total: 3s974ms, non-child: 3s974ms, % non-child: 100.00%) - BytesSent: 705.26 MB (739515709) - OverallThroughput: 177.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.24M (39236131) - SerializeBatchTime: 3s966ms - UncompressedRowBatchSize: 705.26 MB (739515709) CodeGen:(Total: 87.463ms, non-child: 87.463ms, % non-child: 100.00%) - CodegenTime: 1.271ms - CompileTime: 9.103ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.898ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.896ms HDFS_SCAN_NODE (id=2):(Total: 5s141ms, non-child: 5s141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:7/1.59 GB 6:14/3.10 GB 5:14/3.38 GB 0:8/1.94 GB 4:13/3.13 GB 7:7/1.73 GB 1:15/3.52 GB 3:18/4.33 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 82.20 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB, 119.57 MB - FooterProcessingTime: (Avg: 1.627ms ; Min: 822.532us ; Max: 3.150ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 256.49 MB (268952873) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.49 MB (268952873) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.49 MB (268952873) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s085ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828513) - PerReadThreadRawHdfsThroughput: 787.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.198ms - RowBatchQueuePutWaitTime: 54m52s - RowsRead: 39.24M (39236131) - RowsReturned: 39.24M (39236131) - RowsReturnedRate: 7.63 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.23K (2226) - ScannerThreadsTotalWallClockTime: 55m8s - MaterializeTupleTime(*): 2s997ms - ScannerThreadsSysTime: 806.874ms - ScannerThreadsUserTime: 7s683ms - ScannerThreadsVoluntaryContextSwitches: 79.71K (79714) - TotalRawHdfsReadTime(*): 325.515ms - TotalReadThroughput: 393.78 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 38.32K (38322) - RowGroups rejected: 0 (0) - RowGroups total: 38.32K (38322) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.24M (39236131) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 39.24M (39236131) Filter 3 (2.00 MB): - Rows processed: 165.89K (165888) - Rows rejected: 0 (0) - Rows total: 39.24M (39236131) Instance 5f429df048b5534b:41bcce1800000073 (host=foo.234.39:22000):(Total: 11m6s, non-child: 10m56s, % non-child: 98.46%) Hdfs split stats (:<# splits>/): 2:10/2.47 GB 0:7/1.53 GB 3:8/1.97 GB 4:14/3.12 GB 6:12/2.96 GB 5:19/4.43 GB 1:13/3.05 GB 7:13/3.08 GB Filter 1 arrival: 533ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 86.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.10 MB, 125.50 MB, 104.74 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.93 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 129.07 MB (135336595) - PerHostPeakMemUsage: 1.30 GB (1392426219) - RowsProduced: 47.29M (47286968) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 294.907ms - TotalThreadsInvoluntaryContextSwitches: 3.95K (3951) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 790.876ms - TotalThreadsUserTime: 18s994ms - TotalThreadsVoluntaryContextSwitches: 63.29K (63291) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s216ms - OpenTime: 69.564ms - ExecTreeOpenTime: 172.761us - PrepareTime: 33.806ms - ExecTreePrepareTime: 1.022ms DataStreamSender (dst_id=22):(Total: 5s008ms, non-child: 5s008ms, % non-child: 100.00%) - BytesSent: 849.95 MB (891238898) - OverallThroughput: 169.70 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 47.29M (47286968) - SerializeBatchTime: 4s996ms - UncompressedRowBatchSize: 849.95 MB (891238898) CodeGen:(Total: 96.973ms, non-child: 96.973ms, % non-child: 100.00%) - CodegenTime: 1.480ms - CompileTime: 10.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 58.275ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.957ms HDFS_SCAN_NODE (id=2):(Total: 5s188ms, non-child: 5s188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.47 GB 0:7/1.53 GB 3:8/1.97 GB 4:14/3.12 GB 6:12/2.96 GB 5:19/4.43 GB 1:13/3.05 GB 7:13/3.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07502% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:42 BytesRead(16s000ms): 69.92 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 101.70 MB, 107.14 MB - FooterProcessingTime: (Avg: 1.142ms ; Min: 570.181us ; Max: 2.514ms ; Number of samples: 14) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 310.14 MB (325206369) - BytesReadDataNodeCache: 0 - BytesReadLocal: 310.14 MB (325206369) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 310.14 MB (325206369) - CachedFileHandlesHitCount: 81 (81) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s317ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 14 (14) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 121.40 MB (127294521) - PerReadThreadRawHdfsThroughput: 830.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.557ms - RowBatchQueuePutWaitTime: 54m31s - RowsRead: 47.29M (47286968) - RowsReturned: 47.29M (47286968) - RowsReturnedRate: 9.11 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.33K (2334) - ScannerThreadsTotalWallClockTime: 54m47s - MaterializeTupleTime(*): 3s618ms - ScannerThreadsSysTime: 206.965ms - ScannerThreadsUserTime: 6s706ms - ScannerThreadsVoluntaryContextSwitches: 47.55K (47552) - TotalRawHdfsReadTime(*): 373.636ms - TotalReadThroughput: 476.50 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 82 (82) - Files total: 96 (96) - RowGroups processed: 46.19K (46186) - RowGroups rejected: 0 (0) - RowGroups total: 46.19K (46186) - Rows processed: 229.38K (229376) - Rows rejected: 0 (0) - Rows total: 47.29M (47286968) - Splits processed: 14 (14) - Splits rejected: 0 (0) - Splits total: 14 (14) Filter 2 (2.00 MB): - Rows processed: 193.54K (193536) - Rows rejected: 0 (0) - Rows total: 47.29M (47286968) Filter 3 (2.00 MB): - Rows processed: 193.54K (193536) - Rows rejected: 0 (0) - Rows total: 47.29M (47286968) Instance 5f429df048b5534b:41bcce180000004a (host=foo.187.46:22000):(Total: 11m6s, non-child: 10m57s, % non-child: 98.66%) Hdfs split stats (:<# splits>/): 2:13/2.90 GB 5:14/3.45 GB 0:16/3.67 GB 4:15/3.28 GB 3:12/2.69 GB 1:8/1.97 GB 6:13/2.97 GB 7:6/1.48 GB Filter 1 arrival: 2s205ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.81 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.45 MB, 134.74 MB, 118.04 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.96 MB (146759170) - PerHostPeakMemUsage: 1.36 GB (1457509964) - RowsProduced: 35.95M (35948342) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 195.805ms - TotalThreadsInvoluntaryContextSwitches: 3.17K (3169) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s743ms - TotalThreadsUserTime: 15s700ms - TotalThreadsVoluntaryContextSwitches: 169.85K (169851) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s162ms - OpenTime: 61.382ms - ExecTreeOpenTime: 255.043us - PrepareTime: 31.959ms - ExecTreePrepareTime: 903.616us DataStreamSender (dst_id=22):(Total: 3s736ms, non-child: 3s736ms, % non-child: 100.00%) - BytesSent: 645.77 MB (677143795) - OverallThroughput: 172.84 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.95M (35948342) - SerializeBatchTime: 3s727ms - UncompressedRowBatchSize: 645.77 MB (677143795) CodeGen:(Total: 87.056ms, non-child: 87.056ms, % non-child: 100.00%) - CodegenTime: 1.362ms - CompileTime: 10.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.328ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.445ms HDFS_SCAN_NODE (id=2):(Total: 5s140ms, non-child: 5s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:13/2.90 GB 5:14/3.45 GB 0:16/3.67 GB 4:15/3.28 GB 3:12/2.69 GB 1:8/1.97 GB 6:13/2.97 GB 7:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s941ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 82.16 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB - FooterProcessingTime: (Avg: 1.319ms ; Min: 429.990us ; Max: 3.566ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 235.85 MB (247304883) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.85 MB (247304883) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.85 MB (247304883) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s016ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138829013) - PerReadThreadRawHdfsThroughput: 858.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.817ms - RowBatchQueuePutWaitTime: 54m50s - RowsRead: 35.95M (35948342) - RowsReturned: 35.95M (35948342) - RowsReturnedRate: 6.99 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.96K (1955) - ScannerThreadsTotalWallClockTime: 54m59s - MaterializeTupleTime(*): 2s855ms - ScannerThreadsSysTime: 1s279ms - ScannerThreadsUserTime: 6s334ms - ScannerThreadsVoluntaryContextSwitches: 154.59K (154591) - TotalRawHdfsReadTime(*): 274.808ms - TotalReadThroughput: 362.62 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 35.11K (35112) - RowGroups rejected: 0 (0) - RowGroups total: 35.11K (35112) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 35.95M (35948342) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 149.50K (149504) - Rows rejected: 0 (0) - Rows total: 35.95M (35948342) Filter 3 (2.00 MB): - Rows processed: 138.24K (138240) - Rows rejected: 0 (0) - Rows total: 35.95M (35948342) Instance 5f429df048b5534b:41bcce180000002b (host=foo.234.38:22000):(Total: 11m6s, non-child: 10m56s, % non-child: 98.50%) Hdfs split stats (:<# splits>/): 5:11/2.59 GB 4:14/3.27 GB 2:12/2.89 GB 6:11/2.37 GB 3:12/2.59 GB 0:16/3.66 GB 7:8/1.72 GB 1:15/3.38 GB Filter 1 arrival: 544ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 84.79 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.16 MB, 123.61 MB, 104.96 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 127.38 MB (133564319) - PerHostPeakMemUsage: 1.22 GB (1311282730) - RowsProduced: 45.08M (45081519) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m49s - TotalStorageWaitTime: 265.499ms - TotalThreadsInvoluntaryContextSwitches: 3.59K (3591) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 792.877ms - TotalThreadsUserTime: 18s885ms - TotalThreadsVoluntaryContextSwitches: 62.86K (62860) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s178ms - OpenTime: 62.982ms - ExecTreeOpenTime: 195.642us - PrepareTime: 28.966ms - ExecTreePrepareTime: 922.835us DataStreamSender (dst_id=22):(Total: 4s744ms, non-child: 4s744ms, % non-child: 100.00%) - BytesSent: 808.58 MB (847855474) - OverallThroughput: 170.42 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 45.08M (45081519) - SerializeBatchTime: 4s733ms - UncompressedRowBatchSize: 808.58 MB (847855474) CodeGen:(Total: 86.398ms, non-child: 86.398ms, % non-child: 100.00%) - CodegenTime: 1.315ms - CompileTime: 9.801ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.210ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.937ms HDFS_SCAN_NODE (id=2):(Total: 5s153ms, non-child: 5s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:11/2.59 GB 4:14/3.27 GB 2:12/2.89 GB 6:11/2.37 GB 3:12/2.59 GB 0:16/3.66 GB 7:8/1.72 GB 1:15/3.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:42 BytesRead(16s000ms): 72.86 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 105.98 MB, 108.01 MB - FooterProcessingTime: (Avg: 2.806ms ; Min: 662.829us ; Max: 12.401ms ; Number of samples: 14) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 295.27 MB (309613795) - BytesReadDataNodeCache: 0 - BytesReadLocal: 295.27 MB (309613795) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 295.27 MB (309613795) - CachedFileHandlesHitCount: 78 (78) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s269ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 14 (14) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.39 MB (125191894) - PerReadThreadRawHdfsThroughput: 813.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.715ms - RowBatchQueuePutWaitTime: 54m29s - RowsRead: 45.08M (45081519) - RowsReturned: 45.08M (45081519) - RowsReturnedRate: 8.75 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 2.13K (2127) - ScannerThreadsTotalWallClockTime: 54m48s - MaterializeTupleTime(*): 3s478ms - ScannerThreadsSysTime: 243.960ms - ScannerThreadsUserTime: 7s405ms - ScannerThreadsVoluntaryContextSwitches: 47.22K (47215) - TotalRawHdfsReadTime(*): 362.924ms - TotalReadThroughput: 454.33 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 85 (85) - Files total: 99 (99) - RowGroups processed: 44.03K (44031) - RowGroups rejected: 0 (0) - RowGroups total: 44.03K (44031) - Rows processed: 229.38K (229376) - Rows rejected: 0 (0) - Rows total: 45.08M (45081519) - Splits processed: 14 (14) - Splits rejected: 0 (0) - Splits total: 14 (14) Filter 2 (2.00 MB): - Rows processed: 205.82K (205824) - Rows rejected: 0 (0) - Rows total: 45.08M (45081519) Filter 3 (2.00 MB): - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 45.08M (45081519) Instance 5f429df048b5534b:41bcce1800000034 (host=foo.246.35:22000):(Total: 11m6s, non-child: 10m56s, % non-child: 98.50%) Hdfs split stats (:<# splits>/): 5:11/2.58 GB 6:9/2.08 GB 2:12/2.89 GB 0:12/2.79 GB 3:19/4.63 GB 1:12/2.83 GB 7:11/2.59 GB 4:10/2.39 GB Filter 1 arrival: 299ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.67 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.05 MB, 136.48 MB, 126.54 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.14 MB (146947088) - PerHostPeakMemUsage: 1.32 GB (1421035445) - RowsProduced: 43.94M (43939583) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m49s - TotalStorageWaitTime: 284.526ms - TotalThreadsInvoluntaryContextSwitches: 3.48K (3484) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 921.858ms - TotalThreadsUserTime: 18s904ms - TotalThreadsVoluntaryContextSwitches: 67.00K (67003) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s207ms - OpenTime: 57.880ms - ExecTreeOpenTime: 181.303us - PrepareTime: 33.015ms - ExecTreePrepareTime: 720.592us DataStreamSender (dst_id=22):(Total: 4s724ms, non-child: 4s724ms, % non-child: 100.00%) - BytesSent: 787.08 MB (825308723) - OverallThroughput: 166.61 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 43.94M (43939583) - SerializeBatchTime: 4s713ms - UncompressedRowBatchSize: 787.08 MB (825308723) CodeGen:(Total: 84.401ms, non-child: 84.401ms, % non-child: 100.00%) - CodegenTime: 2.059ms - CompileTime: 10.787ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 45.866ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.017ms HDFS_SCAN_NODE (id=2):(Total: 5s182ms, non-child: 5s182ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:11/2.58 GB 6:9/2.08 GB 2:12/2.89 GB 0:12/2.79 GB 3:19/4.63 GB 1:12/2.83 GB 7:11/2.59 GB 4:10/2.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07508% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:36 BytesRead(16s000ms): 82.29 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB, 119.69 MB - FooterProcessingTime: (Avg: 1.845ms ; Min: 821.070us ; Max: 2.905ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 287.13 MB (301078225) - BytesReadDataNodeCache: 0 - BytesReadLocal: 287.13 MB (301078225) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 287.13 MB (301078225) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s232ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828961) - PerReadThreadRawHdfsThroughput: 807.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.509ms - RowBatchQueuePutWaitTime: 54m38s - RowsRead: 43.94M (43939583) - RowsReturned: 43.94M (43939583) - RowsReturnedRate: 8.48 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.05K (2047) - ScannerThreadsTotalWallClockTime: 54m55s - MaterializeTupleTime(*): 3s399ms - ScannerThreadsSysTime: 395.938ms - ScannerThreadsUserTime: 7s367ms - ScannerThreadsVoluntaryContextSwitches: 51.09K (51091) - TotalRawHdfsReadTime(*): 355.769ms - TotalReadThroughput: 441.47 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 84 (84) - Files total: 96 (96) - RowGroups processed: 42.91K (42914) - RowGroups rejected: 0 (0) - RowGroups total: 42.91K (42914) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 43.94M (43939583) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 167.94K (167936) - Rows rejected: 0 (0) - Rows total: 43.94M (43939583) Filter 3 (2.00 MB): - Rows processed: 159.74K (159744) - Rows rejected: 0 (0) - Rows total: 43.94M (43939583) Instance 5f429df048b5534b:41bcce1800000044 (host=foo.187.44:22000):(Total: 11m6s, non-child: 10m56s, % non-child: 98.58%) Hdfs split stats (:<# splits>/): 2:11/2.64 GB 6:8/1.70 GB 7:8/1.85 GB 4:14/3.31 GB 0:10/2.40 GB 3:14/3.40 GB 5:14/3.45 GB 1:18/3.90 GB Filter 1 arrival: 2s202ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 95.54 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.70 MB, 138.85 MB, 117.65 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 142.89 MB (149834625) - PerHostPeakMemUsage: 1.24 GB (1327683132) - RowsProduced: 41.58M (41582922) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m50s - TotalStorageWaitTime: 282.061ms - TotalThreadsInvoluntaryContextSwitches: 3.33K (3328) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 987.849ms - TotalThreadsUserTime: 17s286ms - TotalThreadsVoluntaryContextSwitches: 80.03K (80031) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s212ms - OpenTime: 62.864ms - ExecTreeOpenTime: 185.965us - PrepareTime: 42.520ms - ExecTreePrepareTime: 822.805us DataStreamSender (dst_id=22):(Total: 4s154ms, non-child: 4s154ms, % non-child: 100.00%) - BytesSent: 745.82 MB (782049028) - OverallThroughput: 179.51 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.58M (41582922) - SerializeBatchTime: 4s145ms - UncompressedRowBatchSize: 745.82 MB (782049028) CodeGen:(Total: 96.245ms, non-child: 96.245ms, % non-child: 100.00%) - CodegenTime: 1.430ms - CompileTime: 9.890ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.847ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 34.036ms HDFS_SCAN_NODE (id=2):(Total: 5s189ms, non-child: 5s189ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:11/2.64 GB 6:8/1.70 GB 7:8/1.85 GB 4:14/3.31 GB 0:10/2.40 GB 3:14/3.40 GB 5:14/3.45 GB 1:18/3.90 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:39 BytesRead(16s000ms): 77.76 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 113.11 MB, 115.70 MB - FooterProcessingTime: (Avg: 1.297ms ; Min: 412.063us ; Max: 2.861ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 272.87 MB (286119878) - BytesReadDataNodeCache: 0 - BytesReadLocal: 272.87 MB (286119878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 272.87 MB (286119878) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s186ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 135.40 MB (141974481) - PerReadThreadRawHdfsThroughput: 744.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.880ms - RowBatchQueuePutWaitTime: 54m46s - RowsRead: 41.58M (41582922) - RowsReturned: 41.58M (41582922) - RowsReturnedRate: 8.01 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.06K (2057) - ScannerThreadsTotalWallClockTime: 54m53s - MaterializeTupleTime(*): 3s283ms - ScannerThreadsSysTime: 448.931ms - ScannerThreadsUserTime: 7s017ms - ScannerThreadsVoluntaryContextSwitches: 64.47K (64472) - TotalRawHdfsReadTime(*): 366.434ms - TotalReadThroughput: 419.86 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 84 (84) - Files total: 97 (97) - RowGroups processed: 40.61K (40614) - RowGroups rejected: 0 (0) - RowGroups total: 40.61K (40614) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 41.58M (41582922) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 169.98K (169984) - Rows rejected: 0 (0) - Rows total: 41.58M (41582922) Filter 3 (2.00 MB): - Rows processed: 171.01K (171008) - Rows rejected: 0 (0) - Rows total: 41.58M (41582922) Instance 5f429df048b5534b:41bcce1800000039 (host=foo.187.56:22000):(Total: 11m6s, non-child: 10m57s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 6:13/3.08 GB 1:7/1.47 GB 5:15/3.44 GB 4:17/4.01 GB 2:8/1.92 GB 0:6/1.43 GB 7:15/3.64 GB 3:14/3.33 GB Filter 1 arrival: 1s869ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.05 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.32 MB, 133.63 MB, 119.43 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.04 MB (145795427) - PerHostPeakMemUsage: 1.25 GB (1340240933) - RowsProduced: 38.26M (38255749) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 271.709ms - TotalThreadsInvoluntaryContextSwitches: 3.33K (3327) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s225ms - TotalThreadsUserTime: 19s171ms - TotalThreadsVoluntaryContextSwitches: 107.19K (107191) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s156ms - OpenTime: 85.438ms - ExecTreeOpenTime: 172.272us - PrepareTime: 36.301ms - ExecTreePrepareTime: 993.891us DataStreamSender (dst_id=22):(Total: 3s897ms, non-child: 3s897ms, % non-child: 100.00%) - BytesSent: 684.07 MB (717297992) - OverallThroughput: 175.51 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 38.26M (38255749) - SerializeBatchTime: 3s888ms - UncompressedRowBatchSize: 684.07 MB (717297992) CodeGen:(Total: 111.089ms, non-child: 111.089ms, % non-child: 100.00%) - CodegenTime: 1.573ms - CompileTime: 10.484ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 73.881ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.180ms HDFS_SCAN_NODE (id=2):(Total: 5s136ms, non-child: 5s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:13/3.08 GB 1:7/1.47 GB 5:15/3.44 GB 4:17/4.01 GB 2:8/1.92 GB 0:6/1.43 GB 7:15/3.64 GB 3:14/3.33 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:33 BytesRead(16s000ms): 78.18 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB, 113.71 MB - FooterProcessingTime: (Avg: 2.931ms ; Min: 649.176us ; Max: 18.568ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 250.27 MB (262423473) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.27 MB (262423473) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.27 MB (262423473) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s086ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780507) - PerReadThreadRawHdfsThroughput: 717.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.362ms - RowBatchQueuePutWaitTime: 54m44s - RowsRead: 38.26M (38255749) - RowsReturned: 38.26M (38255749) - RowsReturnedRate: 7.45 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 2.16K (2156) - ScannerThreadsTotalWallClockTime: 54m56s - MaterializeTupleTime(*): 3s022ms - ScannerThreadsSysTime: 733.886ms - ScannerThreadsUserTime: 9s621ms - ScannerThreadsVoluntaryContextSwitches: 91.25K (91248) - TotalRawHdfsReadTime(*): 348.920ms - TotalReadThroughput: 384.79 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 84 (84) - Files total: 95 (95) - RowGroups processed: 37.37K (37365) - RowGroups rejected: 0 (0) - RowGroups total: 37.37K (37365) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 38.26M (38255749) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 38.26M (38255749) Filter 3 (2.00 MB): - Rows processed: 137.22K (137216) - Rows rejected: 0 (0) - Rows total: 38.26M (38255749) Instance 5f429df048b5534b:41bcce1800000028 (host=foo.187.45:22000):(Total: 11m6s, non-child: 10m57s, % non-child: 98.66%) Hdfs split stats (:<# splits>/): 0:13/3.14 GB 6:11/2.57 GB 3:15/3.42 GB 1:18/4.37 GB 5:10/2.25 GB 4:13/3.14 GB 7:10/2.39 GB 2:6/1.26 GB Filter 1 arrival: 2s194ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.06 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.82 MB, 134.98 MB, 110.40 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.98 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.94 MB (146732983) - PerHostPeakMemUsage: 1.31 GB (1401449535) - RowsProduced: 37.17M (37168585) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 207.420ms - TotalThreadsInvoluntaryContextSwitches: 3.32K (3323) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s315ms - TotalThreadsUserTime: 18s566ms - TotalThreadsVoluntaryContextSwitches: 130.33K (130333) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s142ms - OpenTime: 61.616ms - ExecTreeOpenTime: 239.783us - PrepareTime: 30.879ms - ExecTreePrepareTime: 852.473us DataStreamSender (dst_id=22):(Total: 3s698ms, non-child: 3s698ms, % non-child: 100.00%) - BytesSent: 667.25 MB (699660372) - OverallThroughput: 180.40 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.17M (37168585) - SerializeBatchTime: 3s691ms - UncompressedRowBatchSize: 667.25 MB (699660372) CodeGen:(Total: 87.278ms, non-child: 87.278ms, % non-child: 100.00%) - CodegenTime: 1.382ms - CompileTime: 9.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.396ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.123ms HDFS_SCAN_NODE (id=2):(Total: 5s121ms, non-child: 5s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/3.14 GB 6:11/2.57 GB 3:15/3.42 GB 1:18/4.37 GB 5:10/2.25 GB 4:13/3.14 GB 7:10/2.39 GB 2:6/1.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.68 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB, 112.98 MB - FooterProcessingTime: (Avg: 1.622ms ; Min: 789.193us ; Max: 3.032ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 243.29 MB (255107096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.29 MB (255107096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.29 MB (255107096) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s037ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828946) - PerReadThreadRawHdfsThroughput: 794.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.038ms - RowBatchQueuePutWaitTime: 54m41s - RowsRead: 37.17M (37168585) - RowsReturned: 37.17M (37168585) - RowsReturnedRate: 7.26 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.14K (2143) - ScannerThreadsTotalWallClockTime: 55m14s - MaterializeTupleTime(*): 2s850ms - ScannerThreadsSysTime: 872.864ms - ScannerThreadsUserTime: 9s129ms - ScannerThreadsVoluntaryContextSwitches: 115.29K (115290) - TotalRawHdfsReadTime(*): 306.352ms - TotalReadThroughput: 374.07 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 36.30K (36304) - RowGroups rejected: 0 (0) - RowGroups total: 36.30K (36304) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.17M (37168585) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 153.60K (153600) - Rows rejected: 0 (0) - Rows total: 37.17M (37168585) Filter 3 (2.00 MB): - Rows processed: 130.05K (130048) - Rows rejected: 0 (0) - Rows total: 37.17M (37168585) Instance 5f429df048b5534b:41bcce1800000015 (host=foo.187.39:22000):(Total: 11m6s, non-child: 10m57s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 0:14/3.02 GB 5:9/2.22 GB 4:15/3.49 GB 2:13/3.14 GB 3:17/4.07 GB 1:10/2.40 GB 6:6/1.41 GB 7:13/3.06 GB Filter 1 arrival: 2s176ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.50 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.18 MB, 134.45 MB, 118.75 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.02 MB (145774132) - PerHostPeakMemUsage: 1.31 GB (1408008825) - RowsProduced: 34.52M (34520791) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 180.536ms - TotalThreadsInvoluntaryContextSwitches: 2.90K (2896) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s990ms - TotalThreadsUserTime: 15s417ms - TotalThreadsVoluntaryContextSwitches: 183.78K (183782) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s156ms - OpenTime: 65.597ms - ExecTreeOpenTime: 178.889us - PrepareTime: 35.044ms - ExecTreePrepareTime: 936.647us DataStreamSender (dst_id=22):(Total: 3s748ms, non-child: 3s748ms, % non-child: 100.00%) - BytesSent: 619.58 MB (649672587) - OverallThroughput: 165.27 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.52M (34520791) - SerializeBatchTime: 3s741ms - UncompressedRowBatchSize: 619.58 MB (649672587) CodeGen:(Total: 91.286ms, non-child: 91.286ms, % non-child: 100.00%) - CodegenTime: 1.404ms - CompileTime: 10.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.289ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.232ms HDFS_SCAN_NODE (id=2):(Total: 5s134ms, non-child: 5s134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:14/3.02 GB 5:9/2.22 GB 4:15/3.49 GB 2:13/3.14 GB 3:17/4.07 GB 1:10/2.40 GB 6:6/1.41 GB 7:13/3.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.25 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 106.55 MB, 108.79 MB - FooterProcessingTime: (Avg: 1.534ms ; Min: 600.807us ; Max: 3.040ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 226.12 MB (237108651) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.12 MB (237108651) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.12 MB (237108651) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s010ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780118) - PerReadThreadRawHdfsThroughput: 889.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.349ms - RowBatchQueuePutWaitTime: 54m45s - RowsRead: 34.52M (34520791) - RowsReturned: 34.52M (34520791) - RowsReturnedRate: 6.72 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.72K (1717) - ScannerThreadsTotalWallClockTime: 54m59s - MaterializeTupleTime(*): 2s831ms - ScannerThreadsSysTime: 1s522ms - ScannerThreadsUserTime: 6s115ms - ScannerThreadsVoluntaryContextSwitches: 168.61K (168612) - TotalRawHdfsReadTime(*): 254.204ms - TotalReadThroughput: 347.94 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 33.72K (33715) - RowGroups rejected: 0 (0) - RowGroups total: 33.72K (33715) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.52M (34520791) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 125.95K (125952) - Rows rejected: 0 (0) - Rows total: 34.52M (34520791) Filter 3 (2.00 MB): - Rows processed: 123.90K (123904) - Rows rejected: 0 (0) - Rows total: 34.52M (34520791) Instance 5f429df048b5534b:41bcce180000007c (host=foo.187.49:22000):(Total: 11m6s, non-child: 10m57s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 6:11/2.56 GB 5:7/1.55 GB 2:13/3.14 GB 4:17/3.97 GB 0:7/1.59 GB 7:14/3.17 GB 1:13/3.00 GB 3:15/3.56 GB Filter 1 arrival: 2s222ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.67 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.41 MB, 134.58 MB, 116.74 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.86 MB (145607408) - PerHostPeakMemUsage: 1.31 GB (1403865257) - RowsProduced: 37.03M (37032120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m51s - TotalStorageWaitTime: 205.462ms - TotalThreadsInvoluntaryContextSwitches: 3.18K (3181) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 962.850ms - TotalThreadsUserTime: 17s739ms - TotalThreadsVoluntaryContextSwitches: 70.53K (70532) Fragment Instance Lifecycle Timings: - ExecTime: 11m6s - ExecTreeExecTime: 5s150ms - OpenTime: 64.153ms - ExecTreeOpenTime: 201.259us - PrepareTime: 37.179ms - ExecTreePrepareTime: 1.202ms DataStreamSender (dst_id=22):(Total: 3s795ms, non-child: 3s795ms, % non-child: 100.00%) - BytesSent: 667.31 MB (699729769) - OverallThroughput: 175.80 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.03M (37032120) - SerializeBatchTime: 3s788ms - UncompressedRowBatchSize: 667.31 MB (699729769) CodeGen:(Total: 95.020ms, non-child: 95.020ms, % non-child: 100.00%) - CodegenTime: 1.664ms - CompileTime: 9.699ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.838ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 31.778ms HDFS_SCAN_NODE (id=2):(Total: 5s128ms, non-child: 5s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:11/2.56 GB 5:7/1.55 GB 2:13/3.14 GB 4:17/3.97 GB 0:7/1.59 GB 7:14/3.17 GB 1:13/3.00 GB 3:15/3.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07513% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.53 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB, 112.77 MB - FooterProcessingTime: (Avg: 1.710ms ; Min: 668.775us ; Max: 3.661ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 242.62 MB (254405383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.62 MB (254405383) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.62 MB (254405383) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s027ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780080) - PerReadThreadRawHdfsThroughput: 835.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.414ms - RowBatchQueuePutWaitTime: 54m45s - RowsRead: 37.03M (37032120) - RowsReturned: 37.03M (37032120) - RowsReturnedRate: 7.22 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.98K (1977) - ScannerThreadsTotalWallClockTime: 54m56s - MaterializeTupleTime(*): 2s833ms - ScannerThreadsSysTime: 517.918ms - ScannerThreadsUserTime: 8s314ms - ScannerThreadsVoluntaryContextSwitches: 55.47K (55469) - TotalRawHdfsReadTime(*): 290.553ms - TotalReadThroughput: 373.32 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 36.17K (36169) - RowGroups rejected: 0 (0) - RowGroups total: 36.17K (36169) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.03M (37032120) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 149.50K (149504) - Rows rejected: 0 (0) - Rows total: 37.03M (37032120) Filter 3 (2.00 MB): - Rows processed: 138.24K (138240) - Rows rejected: 0 (0) - Rows total: 37.03M (37032120) Instance 5f429df048b5534b:41bcce1800000016 (host=foo.246.37:22000):(Total: 11m6s, non-child: 10m56s, % non-child: 98.54%) Hdfs split stats (:<# splits>/): 2:10/2.33 GB 7:10/2.31 GB 0:10/2.33 GB 1:12/2.84 GB 6:16/3.80 GB 3:15/3.53 GB 4:14/3.03 GB 5:11/2.56 GB Filter 1 arrival: 291ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.36 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 135.44 MB, 136.28 MB, 114.88 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.35 MB (148218472) - PerHostPeakMemUsage: 1.30 GB (1395155466) - RowsProduced: 41.76M (41764115) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m49s - TotalStorageWaitTime: 224.171ms - TotalThreadsInvoluntaryContextSwitches: 3.50K (3501) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s494ms - TotalThreadsUserTime: 18s262ms - TotalThreadsVoluntaryContextSwitches: 153.78K (153776) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s134ms - OpenTime: 94.022ms - ExecTreeOpenTime: 212.862us - PrepareTime: 43.246ms - ExecTreePrepareTime: 915.508us DataStreamSender (dst_id=22):(Total: 4s508ms, non-child: 4s508ms, % non-child: 100.00%) - BytesSent: 748.60 MB (784960991) - OverallThroughput: 166.03 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.76M (41764115) - SerializeBatchTime: 4s499ms - UncompressedRowBatchSize: 748.60 MB (784960991) CodeGen:(Total: 126.951ms, non-child: 126.951ms, % non-child: 100.00%) - CodegenTime: 3.425ms - CompileTime: 11.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 80.277ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 34.367ms HDFS_SCAN_NODE (id=2):(Total: 5s109ms, non-child: 5s109ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.33 GB 7:10/2.31 GB 0:10/2.33 GB 1:12/2.84 GB 6:16/3.80 GB 3:15/3.53 GB 4:14/3.03 GB 5:11/2.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s896ms Hdfs Read Thread Concurrency Bucket: 0:99.85% 1:0.1504% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:36 BytesRead(16s000ms): 82.22 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 123.11 MB - FooterProcessingTime: (Avg: 1.993ms ; Min: 649.386us ; Max: 7.902ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 273.41 MB (286690588) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.41 MB (286690588) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.41 MB (286690588) - CachedFileHandlesHitCount: 70 (70) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s183ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877057) - PerReadThreadRawHdfsThroughput: 910.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.078ms - RowBatchQueuePutWaitTime: 54m33s - RowsRead: 41.76M (41764115) - RowsReturned: 41.76M (41764115) - RowsReturnedRate: 8.17 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.08K (2080) - ScannerThreadsTotalWallClockTime: 55m3s - MaterializeTupleTime(*): 3s294ms - ScannerThreadsSysTime: 940.855ms - ScannerThreadsUserTime: 7s090ms - ScannerThreadsVoluntaryContextSwitches: 137.91K (137912) - TotalRawHdfsReadTime(*): 300.311ms - TotalReadThroughput: 421.01 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 86 (86) - Files total: 98 (98) - RowGroups processed: 40.79K (40791) - RowGroups rejected: 0 (0) - RowGroups total: 40.79K (40791) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 41.76M (41764115) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 172.03K (172032) - Rows rejected: 0 (0) - Rows total: 41.76M (41764115) Filter 3 (2.00 MB): - Rows processed: 142.34K (142336) - Rows rejected: 0 (0) - Rows total: 41.76M (41764115) Instance 5f429df048b5534b:41bcce180000002d (host=foo.246.51:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.46%) Hdfs split stats (:<# splits>/): 6:10/2.46 GB 4:6/1.48 GB 5:18/4.25 GB 1:15/3.44 GB 2:10/2.40 GB 0:13/3.14 GB 7:11/2.58 GB 3:13/2.87 GB Filter 1 arrival: 137ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 84.39 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 122.50 MB, 123.03 MB, 99.31 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 127.45 MB (133635816) - PerHostPeakMemUsage: 1.23 GB (1319248021) - RowsProduced: 46.30M (46300747) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 263.878ms - TotalThreadsInvoluntaryContextSwitches: 3.89K (3890) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 764.882ms - TotalThreadsUserTime: 20s434ms - TotalThreadsVoluntaryContextSwitches: 61.88K (61875) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s180ms - OpenTime: 79.990ms - ExecTreeOpenTime: 253.003us - PrepareTime: 33.149ms - ExecTreePrepareTime: 868.503us DataStreamSender (dst_id=22):(Total: 4s969ms, non-child: 4s969ms, % non-child: 100.00%) - BytesSent: 831.41 MB (871801562) - OverallThroughput: 167.31 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 46.30M (46300747) - SerializeBatchTime: 4s958ms - UncompressedRowBatchSize: 831.41 MB (871801562) CodeGen:(Total: 106.802ms, non-child: 106.802ms, % non-child: 100.00%) - CodegenTime: 1.599ms - CompileTime: 16.911ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 61.899ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.373ms HDFS_SCAN_NODE (id=2):(Total: 5s154ms, non-child: 5s154ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:10/2.46 GB 4:6/1.48 GB 5:18/4.25 GB 1:15/3.44 GB 2:10/2.40 GB 0:13/3.14 GB 7:11/2.58 GB 3:13/2.87 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:82 PARQUET/SNAPPY:42 BytesRead(16s000ms): 73.76 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 107.29 MB, 116.27 MB - FooterProcessingTime: (Avg: 1.500ms ; Min: 528.219us ; Max: 3.134ms ; Number of samples: 14) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 303.43 MB (318169619) - BytesReadDataNodeCache: 0 - BytesReadLocal: 303.43 MB (318169619) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 303.43 MB (318169619) - CachedFileHandlesHitCount: 80 (80) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s301ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 14 (14) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.52 MB (125328293) - PerReadThreadRawHdfsThroughput: 768.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.887ms - RowBatchQueuePutWaitTime: 54m25s - RowsRead: 46.30M (46300747) - RowsReturned: 46.30M (46300747) - RowsReturnedRate: 8.98 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.38K (2378) - ScannerThreadsTotalWallClockTime: 54m53s - MaterializeTupleTime(*): 3s605ms - ScannerThreadsSysTime: 182.970ms - ScannerThreadsUserTime: 8s310ms - ScannerThreadsVoluntaryContextSwitches: 46.21K (46206) - TotalRawHdfsReadTime(*): 395.077ms - TotalReadThroughput: 466.89 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 82 (82) - Files total: 96 (96) - RowGroups processed: 45.22K (45222) - RowGroups rejected: 0 (0) - RowGroups total: 45.22K (45222) - Rows processed: 229.38K (229376) - Rows rejected: 0 (0) - Rows total: 46.30M (46300747) - Splits processed: 14 (14) - Splits rejected: 0 (0) - Splits total: 14 (14) Filter 2 (2.00 MB): - Rows processed: 181.25K (181248) - Rows rejected: 0 (0) - Rows total: 46.30M (46300747) Filter 3 (2.00 MB): - Rows processed: 181.25K (181248) - Rows rejected: 0 (0) - Rows total: 46.30M (46300747) Instance 5f429df048b5534b:41bcce1800000072 (host=foo.246.45:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.51%) Hdfs split stats (:<# splits>/): 5:6/1.22 GB 3:7/1.59 GB 4:13/3.06 GB 0:12/2.83 GB 7:15/3.49 GB 2:15/3.66 GB 6:16/3.80 GB 1:12/2.79 GB Filter 1 arrival: 123ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 94.52 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.21 MB, 137.55 MB, 109.44 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.40 MB (148269280) - PerHostPeakMemUsage: 1.21 GB (1300939375) - RowsProduced: 43.08M (43076467) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 230.386ms - TotalThreadsInvoluntaryContextSwitches: 3.97K (3966) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 2s211ms - TotalThreadsUserTime: 19s620ms - TotalThreadsVoluntaryContextSwitches: 243.86K (243863) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s177ms - OpenTime: 78.587ms - ExecTreeOpenTime: 189.096us - PrepareTime: 33.897ms - ExecTreePrepareTime: 808.544us DataStreamSender (dst_id=22):(Total: 4s678ms, non-child: 4s678ms, % non-child: 100.00%) - BytesSent: 770.70 MB (808132291) - OverallThroughput: 164.75 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 43.08M (43076467) - SerializeBatchTime: 4s667ms - UncompressedRowBatchSize: 770.70 MB (808132291) CodeGen:(Total: 105.786ms, non-child: 105.786ms, % non-child: 100.00%) - CodegenTime: 1.651ms - CompileTime: 12.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 65.012ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.839ms HDFS_SCAN_NODE (id=2):(Total: 5s149ms, non-child: 5s149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:6/1.22 GB 3:7/1.59 GB 4:13/3.06 GB 0:12/2.83 GB 7:15/3.49 GB 2:15/3.66 GB 6:16/3.80 GB 1:12/2.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:36 BytesRead(16s000ms): 78.15 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 113.67 MB, 122.63 MB - FooterProcessingTime: (Avg: 2.355ms ; Min: 317.934us ; Max: 13.206ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 280.98 MB (294627177) - BytesReadDataNodeCache: 0 - BytesReadLocal: 280.98 MB (294627177) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 280.98 MB (294627177) - CachedFileHandlesHitCount: 71 (71) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s209ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877368) - PerReadThreadRawHdfsThroughput: 907.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.656ms - RowBatchQueuePutWaitTime: 54m27s - RowsRead: 43.08M (43076467) - RowsReturned: 43.08M (43076467) - RowsReturnedRate: 8.36 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.45K (2454) - ScannerThreadsTotalWallClockTime: 54m50s - MaterializeTupleTime(*): 3s377ms - ScannerThreadsSysTime: 1s723ms - ScannerThreadsUserTime: 7s974ms - ScannerThreadsVoluntaryContextSwitches: 228.24K (228239) - TotalRawHdfsReadTime(*): 309.467ms - TotalReadThroughput: 432.99 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 84 (84) - Files total: 96 (96) - RowGroups processed: 42.07K (42073) - RowGroups rejected: 0 (0) - RowGroups total: 42.07K (42073) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 43.08M (43076467) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 176.13K (176128) - Rows rejected: 0 (0) - Rows total: 43.08M (43076467) Filter 3 (2.00 MB): - Rows processed: 162.82K (162816) - Rows rejected: 0 (0) - Rows total: 43.08M (43076467) Instance 5f429df048b5534b:41bcce180000002e (host=foo.234.41:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.53%) Hdfs split stats (:<# splits>/): 2:14/3.12 GB 7:9/2.10 GB 4:16/3.60 GB 3:14/3.09 GB 6:14/3.19 GB 5:11/2.71 GB 0:12/2.82 GB 1:8/1.97 GB Filter 1 arrival: 533ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.26 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 135.29 MB, 136.17 MB, 124.46 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.03 MB (147880747) - PerHostPeakMemUsage: 1.23 GB (1315807494) - RowsProduced: 43.28M (43275538) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 283.381ms - TotalThreadsInvoluntaryContextSwitches: 3.83K (3827) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s199ms - TotalThreadsUserTime: 19s303ms - TotalThreadsVoluntaryContextSwitches: 82.38K (82384) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s174ms - OpenTime: 62.972ms - ExecTreeOpenTime: 243.935us - PrepareTime: 29.084ms - ExecTreePrepareTime: 851.698us DataStreamSender (dst_id=22):(Total: 4s560ms, non-child: 4s560ms, % non-child: 100.00%) - BytesSent: 774.27 MB (811879337) - OverallThroughput: 169.76 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 43.28M (43275538) - SerializeBatchTime: 4s551ms - UncompressedRowBatchSize: 774.27 MB (811879337) CodeGen:(Total: 86.417ms, non-child: 86.417ms, % non-child: 100.00%) - CodegenTime: 1.378ms - CompileTime: 10.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.276ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.979ms HDFS_SCAN_NODE (id=2):(Total: 5s149ms, non-child: 5s149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/3.12 GB 7:9/2.10 GB 4:16/3.60 GB 3:14/3.09 GB 6:14/3.19 GB 5:11/2.71 GB 0:12/2.82 GB 1:8/1.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:39 BytesRead(16s000ms): 77.78 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB, 113.14 MB - FooterProcessingTime: (Avg: 1.402ms ; Min: 571.552us ; Max: 2.821ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 283.12 MB (296868826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 283.12 MB (296868826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 283.12 MB (296868826) - CachedFileHandlesHitCount: 74 (74) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s199ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877605) - PerReadThreadRawHdfsThroughput: 802.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.181ms - RowBatchQueuePutWaitTime: 54m33s - RowsRead: 43.28M (43275538) - RowsReturned: 43.28M (43275538) - RowsReturnedRate: 8.40 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.41K (2413) - ScannerThreadsTotalWallClockTime: 55m4s - MaterializeTupleTime(*): 3s296ms - ScannerThreadsSysTime: 678.894ms - ScannerThreadsUserTime: 7s994ms - ScannerThreadsVoluntaryContextSwitches: 66.89K (66888) - TotalRawHdfsReadTime(*): 352.913ms - TotalReadThroughput: 435.96 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 85 (85) - Files total: 98 (98) - RowGroups processed: 42.27K (42266) - RowGroups rejected: 0 (0) - RowGroups total: 42.27K (42266) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 43.28M (43275538) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 162.82K (162816) - Rows rejected: 0 (0) - Rows total: 43.28M (43275538) Filter 3 (2.00 MB): - Rows processed: 189.44K (189440) - Rows rejected: 0 (0) - Rows total: 43.28M (43275538) Instance 5f429df048b5534b:41bcce1800000030 (host=foo.234.45:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.54%) Hdfs split stats (:<# splits>/): 7:6/1.48 GB 3:14/3.35 GB 5:10/2.26 GB 0:11/2.58 GB 6:12/2.90 GB 4:12/2.82 GB 2:18/4.22 GB 1:13/3.07 GB Filter 1 arrival: 433ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 90.17 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 130.97 MB, 131.37 MB, 111.27 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.17 MB (141732337) - PerHostPeakMemUsage: 1.19 GB (1277946058) - RowsProduced: 41.33M (41334438) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 244.846ms - TotalThreadsInvoluntaryContextSwitches: 3.38K (3379) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 745.885ms - TotalThreadsUserTime: 17s521ms - TotalThreadsVoluntaryContextSwitches: 68.48K (68479) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s191ms - OpenTime: 64.878ms - ExecTreeOpenTime: 190.717us - PrepareTime: 33.080ms - ExecTreePrepareTime: 750.367us DataStreamSender (dst_id=22):(Total: 4s460ms, non-child: 4s460ms, % non-child: 100.00%) - BytesSent: 740.97 MB (776960036) - OverallThroughput: 166.13 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.33M (41334438) - SerializeBatchTime: 4s449ms - UncompressedRowBatchSize: 740.97 MB (776960036) CodeGen:(Total: 91.957ms, non-child: 91.957ms, % non-child: 100.00%) - CodegenTime: 1.392ms - CompileTime: 10.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.037ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.678ms HDFS_SCAN_NODE (id=2):(Total: 5s163ms, non-child: 5s163ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:6/1.48 GB 3:14/3.35 GB 5:10/2.26 GB 0:11/2.58 GB 6:12/2.90 GB 4:12/2.82 GB 2:18/4.22 GB 1:13/3.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:39 BytesRead(16s000ms): 73.06 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 106.27 MB, 111.75 MB - FooterProcessingTime: (Avg: 1.596ms ; Min: 548.840us ; Max: 4.213ms ; Number of samples: 13) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 270.96 MB (284117567) - BytesReadDataNodeCache: 0 - BytesReadLocal: 270.96 MB (284117567) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 270.96 MB (284117567) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s143ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 13 (13) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585955) - PerReadThreadRawHdfsThroughput: 814.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.023ms - RowBatchQueuePutWaitTime: 54m29s - RowsRead: 41.33M (41334438) - RowsReturned: 41.33M (41334438) - RowsReturnedRate: 8.00 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.99K (1988) - ScannerThreadsTotalWallClockTime: 54m46s - MaterializeTupleTime(*): 3s157ms - ScannerThreadsSysTime: 251.960ms - ScannerThreadsUserTime: 6s544ms - ScannerThreadsVoluntaryContextSwitches: 52.57K (52570) - TotalRawHdfsReadTime(*): 332.608ms - TotalReadThroughput: 417.86 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 83 (83) - Files total: 96 (96) - RowGroups processed: 40.37K (40372) - RowGroups rejected: 0 (0) - RowGroups total: 40.37K (40372) - Rows processed: 212.99K (212992) - Rows rejected: 0 (0) - Rows total: 41.33M (41334438) - Splits processed: 13 (13) - Splits rejected: 0 (0) - Splits total: 13 (13) Filter 2 (2.00 MB): - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 41.33M (41334438) Filter 3 (2.00 MB): - Rows processed: 175.10K (175104) - Rows rejected: 0 (0) - Rows total: 41.33M (41334438) Instance 5f429df048b5534b:41bcce1800000025 (host=foo.187.52:22000):(Total: 11m5s, non-child: 10m56s, % non-child: 98.68%) Hdfs split stats (:<# splits>/): 2:14/3.10 GB 1:9/2.22 GB 0:15/3.63 GB 3:9/2.15 GB 6:13/2.82 GB 7:10/2.14 GB 4:12/2.92 GB 5:15/3.44 GB Filter 1 arrival: 1s889ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 87.02 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.51 MB, 126.77 MB, 107.04 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 131.09 MB (137453719) - PerHostPeakMemUsage: 1.23 GB (1316359560) - RowsProduced: 34.43M (34428734) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m50s - TotalStorageWaitTime: 167.047ms - TotalThreadsInvoluntaryContextSwitches: 3.01K (3011) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 1s758ms - TotalThreadsUserTime: 16s069ms - TotalThreadsVoluntaryContextSwitches: 178.63K (178630) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s135ms - OpenTime: 61.817ms - ExecTreeOpenTime: 191.605us - PrepareTime: 30.619ms - ExecTreePrepareTime: 924.856us DataStreamSender (dst_id=22):(Total: 3s569ms, non-child: 3s569ms, % non-child: 100.00%) - BytesSent: 616.82 MB (646783095) - OverallThroughput: 172.80 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.43M (34428734) - SerializeBatchTime: 3s560ms - UncompressedRowBatchSize: 616.82 MB (646783095) CodeGen:(Total: 86.145ms, non-child: 86.145ms, % non-child: 100.00%) - CodegenTime: 1.411ms - CompileTime: 9.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.153ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 24.823ms HDFS_SCAN_NODE (id=2):(Total: 5s115ms, non-child: 5s115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/3.10 GB 1:9/2.22 GB 0:15/3.63 GB 3:9/2.15 GB 6:13/2.82 GB 7:10/2.14 GB 4:12/2.92 GB 5:15/3.44 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.26 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB, 106.56 MB - FooterProcessingTime: (Avg: 1.921ms ; Min: 725.105us ; Max: 3.814ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 226.25 MB (237242171) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.25 MB (237242171) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.25 MB (237242171) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 972.854ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 123.39 MB (129386181) - PerReadThreadRawHdfsThroughput: 911.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.510ms - RowBatchQueuePutWaitTime: 54m34s - RowsRead: 34.43M (34428734) - RowsReturned: 34.43M (34428734) - RowsReturnedRate: 6.73 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.87K (1868) - ScannerThreadsTotalWallClockTime: 54m46s - MaterializeTupleTime(*): 2s702ms - ScannerThreadsSysTime: 1s339ms - ScannerThreadsUserTime: 7s227ms - ScannerThreadsVoluntaryContextSwitches: 163.25K (163251) - TotalRawHdfsReadTime(*): 248.291ms - TotalReadThroughput: 348.66 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 87 (87) - Files total: 97 (97) - RowGroups processed: 33.63K (33626) - RowGroups rejected: 0 (0) - RowGroups total: 33.63K (33626) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.43M (34428734) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 125.95K (125952) - Rows rejected: 0 (0) - Rows total: 34.43M (34428734) Filter 3 (2.00 MB): - Rows processed: 122.88K (122880) - Rows rejected: 0 (0) - Rows total: 34.43M (34428734) Instance 5f429df048b5534b:41bcce1800000009 (host=foo.246.44:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.53%) Hdfs split stats (:<# splits>/): 2:13/3.05 GB 0:15/3.56 GB 7:12/2.84 GB 1:15/3.41 GB 6:13/3.06 GB 5:6/1.48 GB 4:11/2.59 GB 3:12/2.70 GB Filter 1 arrival: 174ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.20 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.23 MB, 135.80 MB, 123.41 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.37 MB (147193289) - PerHostPeakMemUsage: 1.31 GB (1403306148) - RowsProduced: 41.86M (41858000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 223.563ms - TotalThreadsInvoluntaryContextSwitches: 3.70K (3699) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s106ms - TotalThreadsUserTime: 17s956ms - TotalThreadsVoluntaryContextSwitches: 63.06K (63058) Fragment Instance Lifecycle Timings: - ExecTime: 11m5s - ExecTreeExecTime: 5s189ms - OpenTime: 64.436ms - ExecTreeOpenTime: 193.456us - PrepareTime: 38.647ms - ExecTreePrepareTime: 1.095ms DataStreamSender (dst_id=22):(Total: 4s552ms, non-child: 4s552ms, % non-child: 100.00%) - BytesSent: 747.33 MB (783630702) - OverallThroughput: 164.17 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.86M (41858000) - SerializeBatchTime: 4s542ms - UncompressedRowBatchSize: 747.33 MB (783630702) CodeGen:(Total: 95.221ms, non-child: 95.221ms, % non-child: 100.00%) - CodegenTime: 1.419ms - CompileTime: 11.716ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.518ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 31.480ms HDFS_SCAN_NODE (id=2):(Total: 5s162ms, non-child: 5s162ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:13/3.05 GB 0:15/3.56 GB 7:12/2.84 GB 1:15/3.41 GB 6:13/3.06 GB 5:6/1.48 GB 4:11/2.59 GB 3:12/2.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07519% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:36 BytesRead(16s000ms): 82.21 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 119.58 MB, 121.62 MB - FooterProcessingTime: (Avg: 1.519ms ; Min: 741.572us ; Max: 3.080ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 273.66 MB (286955704) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.66 MB (286955704) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.66 MB (286955704) - CachedFileHandlesHitCount: 70 (70) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s183ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828525) - PerReadThreadRawHdfsThroughput: 822.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.293ms - RowBatchQueuePutWaitTime: 54m35s - RowsRead: 41.86M (41858000) - RowsReturned: 41.86M (41858000) - RowsReturnedRate: 8.11 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2286) - ScannerThreadsTotalWallClockTime: 54m59s - MaterializeTupleTime(*): 3s305ms - ScannerThreadsSysTime: 546.913ms - ScannerThreadsUserTime: 6s632ms - ScannerThreadsVoluntaryContextSwitches: 47.35K (47347) - TotalRawHdfsReadTime(*): 332.633ms - TotalReadThroughput: 421.40 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 85 (85) - Files total: 97 (97) - RowGroups processed: 40.88K (40883) - RowGroups rejected: 0 (0) - RowGroups total: 40.88K (40883) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 41.86M (41858000) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 41.86M (41858000) Filter 3 (2.00 MB): - Rows processed: 166.91K (166912) - Rows rejected: 0 (0) - Rows total: 41.86M (41858000) Instance 5f429df048b5534b:41bcce1800000066 (host=foo.246.47:22000):(Total: 11m5s, non-child: 10m55s, % non-child: 98.55%) Hdfs split stats (:<# splits>/): 7:8/1.71 GB 1:16/3.39 GB 4:12/2.92 GB 3:10/2.33 GB 5:16/3.67 GB 6:10/2.03 GB 2:17/4.04 GB 0:11/2.49 GB Filter 1 arrival: 131ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 86.50 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 125.53 MB, 126.04 MB, 110.29 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 130.22 MB (136548729) - PerHostPeakMemUsage: 1.27 GB (1359123751) - RowsProduced: 41.73M (41725915) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 232.230ms - TotalThreadsInvoluntaryContextSwitches: 3.75K (3753) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 846.868ms - TotalThreadsUserTime: 18s586ms - TotalThreadsVoluntaryContextSwitches: 67.67K (67672) Fragment Instance Lifecycle Timings: - ExecTime: 11m4s - ExecTreeExecTime: 5s164ms - OpenTime: 68.893ms - ExecTreeOpenTime: 250.145us - PrepareTime: 41.336ms - ExecTreePrepareTime: 966.709us DataStreamSender (dst_id=22):(Total: 4s372ms, non-child: 4s372ms, % non-child: 100.00%) - BytesSent: 745.81 MB (782040057) - OverallThroughput: 170.55 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.73M (41725915) - SerializeBatchTime: 4s363ms - UncompressedRowBatchSize: 745.81 MB (782040057) CodeGen:(Total: 97.311ms, non-child: 97.311ms, % non-child: 100.00%) - CodegenTime: 1.464ms - CompileTime: 10.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 57.617ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.095ms HDFS_SCAN_NODE (id=2):(Total: 5s143ms, non-child: 5s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:8/1.71 GB 1:16/3.39 GB 4:12/2.92 GB 3:10/2.33 GB 5:16/3.67 GB 6:10/2.03 GB 2:17/4.04 GB 0:11/2.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:36 BytesRead(16s000ms): 72.57 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 105.56 MB, 110.04 MB - FooterProcessingTime: (Avg: 1.795ms ; Min: 733.501us ; Max: 3.072ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 273.01 MB (286270876) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.01 MB (286270876) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.01 MB (286270876) - CachedFileHandlesHitCount: 70 (70) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s172ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.40 MB (128343042) - PerReadThreadRawHdfsThroughput: 805.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.749ms - RowBatchQueuePutWaitTime: 54m28s - RowsRead: 41.73M (41725915) - RowsReturned: 41.73M (41725915) - RowsReturnedRate: 8.11 M/sec - ScanRangesComplete: 100 (100) - ScannerThreadsInvoluntaryContextSwitches: 2.30K (2297) - ScannerThreadsTotalWallClockTime: 54m47s - MaterializeTupleTime(*): 3s211ms - ScannerThreadsSysTime: 383.939ms - ScannerThreadsUserTime: 7s704ms - ScannerThreadsVoluntaryContextSwitches: 51.88K (51879) - TotalRawHdfsReadTime(*): 339.127ms - TotalReadThroughput: 420.71 KB/sec Filter 1 (8.00 KB): - Files processed: 100 (100) - Files rejected: 88 (88) - Files total: 100 (100) - RowGroups processed: 40.75K (40753) - RowGroups rejected: 0 (0) - RowGroups total: 40.75K (40753) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 41.73M (41725915) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 154.62K (154624) - Rows rejected: 0 (0) - Rows total: 41.73M (41725915) Filter 3 (2.00 MB): - Rows processed: 154.62K (154624) - Rows rejected: 0 (0) - Rows total: 41.73M (41725915) Instance 5f429df048b5534b:41bcce180000005a (host=foo.246.41:22000):(Total: 11m4s, non-child: 10m54s, % non-child: 98.56%) Hdfs split stats (:<# splits>/): 3:15/3.42 GB 4:10/2.26 GB 0:5/1.23 GB 2:14/3.33 GB 5:21/4.99 GB 6:7/1.73 GB 1:10/2.20 GB 7:14/3.39 GB Filter 1 arrival: 261ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 91.78 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 133.19 MB, 134.27 MB, 111.06 MB ThreadUsage(16s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.95 MB (145701903) - PerHostPeakMemUsage: 1.27 GB (1368878773) - RowsProduced: 39.23M (39225748) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 211.491ms - TotalThreadsInvoluntaryContextSwitches: 3.29K (3286) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 654.898ms - TotalThreadsUserTime: 15s725ms - TotalThreadsVoluntaryContextSwitches: 55.24K (55243) Fragment Instance Lifecycle Timings: - ExecTime: 11m4s - ExecTreeExecTime: 5s151ms - OpenTime: 71.539ms - ExecTreeOpenTime: 215.470us - PrepareTime: 32.768ms - ExecTreePrepareTime: 926.658us DataStreamSender (dst_id=22):(Total: 4s339ms, non-child: 4s339ms, % non-child: 100.00%) - BytesSent: 705.99 MB (740281601) - OverallThroughput: 162.70 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.23M (39225748) - SerializeBatchTime: 4s329ms - UncompressedRowBatchSize: 705.99 MB (740281601) CodeGen:(Total: 97.766ms, non-child: 97.766ms, % non-child: 100.00%) - CodegenTime: 1.432ms - CompileTime: 10.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.207ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.804ms HDFS_SCAN_NODE (id=2):(Total: 5s128ms, non-child: 5s128ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:15/3.42 GB 4:10/2.26 GB 0:5/1.23 GB 2:14/3.33 GB 5:21/4.99 GB 6:7/1.73 GB 1:10/2.20 GB 7:14/3.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s921ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.41 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 112.59 MB, 119.32 MB - FooterProcessingTime: (Avg: 1.470ms ; Min: 401.073us ; Max: 2.720ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 256.05 MB (268488188) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.05 MB (268488188) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.05 MB (268488188) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s098ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.42 MB (137805835) - PerReadThreadRawHdfsThroughput: 742.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.276ms - RowBatchQueuePutWaitTime: 54m30s - RowsRead: 39.23M (39225754) - RowsReturned: 39.23M (39225748) - RowsReturnedRate: 7.65 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.87K (1868) - ScannerThreadsTotalWallClockTime: 54m59s - MaterializeTupleTime(*): 3s106ms - ScannerThreadsSysTime: 184.969ms - ScannerThreadsUserTime: 4s967ms - ScannerThreadsVoluntaryContextSwitches: 39.82K (39819) - TotalRawHdfsReadTime(*): 344.780ms - TotalReadThroughput: 395.17 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 38.31K (38309) - RowGroups rejected: 0 (0) - RowGroups total: 38.31K (38309) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.23M (39225754) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 149.51K (149510) - Rows rejected: 6 (6) - Rows total: 39.23M (39225754) Filter 3 (2.00 MB): - Rows processed: 149.50K (149504) - Rows rejected: 0 (0) - Rows total: 39.23M (39225748) Instance 5f429df048b5534b:41bcce180000002a (host=foo.234.46:22000):(Total: 11m4s, non-child: 10m54s, % non-child: 98.57%) Hdfs split stats (:<# splits>/): 1:13/3.06 GB 7:13/3.14 GB 0:12/2.89 GB 4:11/2.71 GB 2:12/2.84 GB 3:11/2.46 GB 6:9/2.01 GB 5:15/3.63 GB Filter 1 arrival: 59ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.90 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 139.12 MB, 118.85 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 143.32 MB (150280316) - PerHostPeakMemUsage: 1.30 GB (1394424713) - RowsProduced: 39.17M (39167770) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 205.877ms - TotalThreadsInvoluntaryContextSwitches: 3.31K (3307) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 683.893ms - TotalThreadsUserTime: 15s635ms - TotalThreadsVoluntaryContextSwitches: 54.86K (54858) Fragment Instance Lifecycle Timings: - ExecTime: 11m4s - ExecTreeExecTime: 5s182ms - OpenTime: 67.476ms - ExecTreeOpenTime: 216.273us - PrepareTime: 36.584ms - ExecTreePrepareTime: 1.024ms DataStreamSender (dst_id=22):(Total: 4s261ms, non-child: 4s261ms, % non-child: 100.00%) - BytesSent: 702.60 MB (736725924) - OverallThroughput: 164.87 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.17M (39167770) - SerializeBatchTime: 4s250ms - UncompressedRowBatchSize: 702.60 MB (736725924) CodeGen:(Total: 97.216ms, non-child: 97.216ms, % non-child: 100.00%) - CodegenTime: 1.384ms - CompileTime: 12.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.700ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 31.204ms HDFS_SCAN_NODE (id=2):(Total: 5s157ms, non-child: 5s157ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/3.06 GB 7:13/3.14 GB 0:12/2.89 GB 4:11/2.71 GB 2:12/2.84 GB 3:11/2.46 GB 6:9/2.01 GB 5:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0% 2:0% 3:0% 4:0.07541% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 75.66 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 113.27 MB, 115.51 MB - FooterProcessingTime: (Avg: 1.597ms ; Min: 683.621us ; Max: 2.698ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 256.79 MB (269267606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.79 MB (269267606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.79 MB (269267606) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s105ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 135.40 MB (141974331) - PerReadThreadRawHdfsThroughput: 875.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.394ms - RowBatchQueuePutWaitTime: 54m30s - RowsRead: 39.17M (39167770) - RowsReturned: 39.17M (39167770) - RowsReturnedRate: 7.59 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.91K (1912) - ScannerThreadsTotalWallClockTime: 54m48s - MaterializeTupleTime(*): 3s054ms - ScannerThreadsSysTime: 184.969ms - ScannerThreadsUserTime: 4s885ms - ScannerThreadsVoluntaryContextSwitches: 39.20K (39205) - TotalRawHdfsReadTime(*): 293.256ms - TotalReadThroughput: 396.32 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 38.26K (38256) - RowGroups rejected: 0 (0) - RowGroups total: 38.26K (38256) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.17M (39167770) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 39.17M (39167770) Filter 3 (2.00 MB): - Rows processed: 129.02K (129024) - Rows rejected: 0 (0) - Rows total: 39.17M (39167770) Instance 5f429df048b5534b:41bcce1800000026 (host=foo.246.49:22000):(Total: 11m3s, non-child: 10m54s, % non-child: 98.56%) Hdfs split stats (:<# splits>/): 4:10/2.46 GB 2:9/1.97 GB 3:19/4.35 GB 5:11/2.64 GB 0:14/3.25 GB 6:12/2.67 GB 1:11/2.71 GB 7:11/2.45 GB Filter 1 arrival: 106ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.04 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.00 MB, 135.53 MB, 117.01 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.26 MB (146021925) - PerHostPeakMemUsage: 1.23 GB (1315483351) - RowsProduced: 39.19M (39189995) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 228.332ms - TotalThreadsInvoluntaryContextSwitches: 3.20K (3197) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 692.892ms - TotalThreadsUserTime: 15s834ms - TotalThreadsVoluntaryContextSwitches: 55.45K (55448) Fragment Instance Lifecycle Timings: - ExecTime: 11m3s - ExecTreeExecTime: 5s163ms - OpenTime: 79.726ms - ExecTreeOpenTime: 197.043us - PrepareTime: 31.193ms - ExecTreePrepareTime: 863.004us DataStreamSender (dst_id=22):(Total: 4s327ms, non-child: 4s327ms, % non-child: 100.00%) - BytesSent: 705.72 MB (740002502) - OverallThroughput: 163.08 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 39.19M (39189995) - SerializeBatchTime: 4s316ms - UncompressedRowBatchSize: 705.72 MB (740002502) CodeGen:(Total: 103.953ms, non-child: 103.953ms, % non-child: 100.00%) - CodegenTime: 2.292ms - CompileTime: 17.299ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 60.532ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.333ms HDFS_SCAN_NODE (id=2):(Total: 5s136ms, non-child: 5s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:10/2.46 GB 2:9/1.97 GB 3:19/4.35 GB 5:11/2.64 GB 0:14/3.25 GB 6:12/2.67 GB 1:11/2.71 GB 7:11/2.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07536% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 77.55 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 112.79 MB, 117.00 MB - FooterProcessingTime: (Avg: 2.343ms ; Min: 774.580us ; Max: 11.827ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 256.24 MB (268688375) - BytesReadDataNodeCache: 0 - BytesReadLocal: 256.24 MB (268688375) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 256.24 MB (268688375) - CachedFileHandlesHitCount: 65 (65) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s110ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780626) - PerReadThreadRawHdfsThroughput: 874.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.350ms - RowBatchQueuePutWaitTime: 54m28s - RowsRead: 39.19M (39189995) - RowsReturned: 39.19M (39189995) - RowsReturnedRate: 7.63 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1821) - ScannerThreadsTotalWallClockTime: 54m45s - MaterializeTupleTime(*): 3s120ms - ScannerThreadsSysTime: 198.968ms - ScannerThreadsUserTime: 5s180ms - ScannerThreadsVoluntaryContextSwitches: 40.01K (40009) - TotalRawHdfsReadTime(*): 293.045ms - TotalReadThroughput: 395.46 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 38.28K (38277) - RowGroups rejected: 0 (0) - RowGroups total: 38.28K (38277) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 39.19M (39189995) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 123.90K (123904) - Rows rejected: 0 (0) - Rows total: 39.19M (39189995) Filter 3 (2.00 MB): - Rows processed: 123.90K (123904) - Rows rejected: 0 (0) - Rows total: 39.19M (39189995) Instance 5f429df048b5534b:41bcce180000003a (host=foo.187.40:22000):(Total: 11m3s, non-child: 10m55s, % non-child: 98.70%) Hdfs split stats (:<# splits>/): 7:9/2.09 GB 6:9/2.08 GB 0:13/3.13 GB 5:15/3.37 GB 4:7/1.65 GB 1:10/2.47 GB 2:15/3.36 GB 3:18/4.44 GB Filter 1 arrival: 2s167ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 92.08 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.81 MB, 133.92 MB, 113.61 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.98 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.03 MB (144738786) - PerHostPeakMemUsage: 1.23 GB (1316349865) - RowsProduced: 33.39M (33390987) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m49s - TotalStorageWaitTime: 194.786ms - TotalThreadsInvoluntaryContextSwitches: 3.12K (3125) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 1s568ms - TotalThreadsUserTime: 16s361ms - TotalThreadsVoluntaryContextSwitches: 150.38K (150378) Fragment Instance Lifecycle Timings: - ExecTime: 11m3s - ExecTreeExecTime: 5s133ms - OpenTime: 62.098ms - ExecTreeOpenTime: 195.704us - PrepareTime: 39.934ms - ExecTreePrepareTime: 986.875us DataStreamSender (dst_id=22):(Total: 3s408ms, non-child: 3s408ms, % non-child: 100.00%) - BytesSent: 599.19 MB (628297565) - OverallThroughput: 175.81 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.39M (33390987) - SerializeBatchTime: 3s401ms - UncompressedRowBatchSize: 599.19 MB (628297565) CodeGen:(Total: 89.409ms, non-child: 89.409ms, % non-child: 100.00%) - CodegenTime: 1.366ms - CompileTime: 9.582ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.444ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.861ms HDFS_SCAN_NODE (id=2):(Total: 5s115ms, non-child: 5s115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:9/2.09 GB 6:9/2.08 GB 0:13/3.13 GB 5:15/3.37 GB 4:7/1.65 GB 1:10/2.47 GB 2:15/3.36 GB 3:18/4.44 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0% 2:0% 3:0.07536% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.08 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 106.30 MB, 110.78 MB - FooterProcessingTime: (Avg: 1.717ms ; Min: 699.758us ; Max: 3.384ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 218.79 MB (229418349) - BytesReadDataNodeCache: 0 - BytesReadLocal: 218.79 MB (229418349) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 218.79 MB (229418349) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 964.481ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.40 MB (136731990) - PerReadThreadRawHdfsThroughput: 862.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.616ms - RowBatchQueuePutWaitTime: 54m33s - RowsRead: 33.39M (33390987) - RowsReturned: 33.39M (33390987) - RowsReturnedRate: 6.53 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.05K (2049) - ScannerThreadsTotalWallClockTime: 55m6s - MaterializeTupleTime(*): 2s674ms - ScannerThreadsSysTime: 1s097ms - ScannerThreadsUserTime: 7s715ms - ScannerThreadsVoluntaryContextSwitches: 135.54K (135537) - TotalRawHdfsReadTime(*): 253.664ms - TotalReadThroughput: 337.67 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 32.61K (32613) - RowGroups rejected: 0 (0) - RowGroups total: 32.61K (32613) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 33.39M (33390987) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 120.83K (120832) - Rows rejected: 0 (0) - Rows total: 33.39M (33390987) Filter 3 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 33.39M (33390987) Instance 5f429df048b5534b:41bcce1800000023 (host=foo.234.37:22000):(Total: 11m3s, non-child: 10m53s, % non-child: 98.53%) Hdfs split stats (:<# splits>/): 7:13/3.07 GB 3:10/2.39 GB 0:14/3.21 GB 5:14/3.04 GB 6:13/3.01 GB 4:11/2.59 GB 2:8/1.93 GB 1:15/3.50 GB Filter 1 arrival: 562ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.90 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 130.48 MB, 131.04 MB, 107.07 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 135.29 MB (141863828) - PerHostPeakMemUsage: 1.30 GB (1398836132) - RowsProduced: 41.77M (41773833) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 216.379ms - TotalThreadsInvoluntaryContextSwitches: 3.77K (3768) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 1s263ms - TotalThreadsUserTime: 17s270ms - TotalThreadsVoluntaryContextSwitches: 116.05K (116045) Fragment Instance Lifecycle Timings: - ExecTime: 11m3s - ExecTreeExecTime: 5s165ms - OpenTime: 68.454ms - ExecTreeOpenTime: 215.761us - PrepareTime: 40.232ms - ExecTreePrepareTime: 1.437ms DataStreamSender (dst_id=22):(Total: 4s510ms, non-child: 4s510ms, % non-child: 100.00%) - BytesSent: 748.67 MB (785033729) - OverallThroughput: 165.98 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 41.77M (41773833) - SerializeBatchTime: 4s500ms - UncompressedRowBatchSize: 748.67 MB (785033729) CodeGen:(Total: 96.877ms, non-child: 96.877ms, % non-child: 100.00%) - CodegenTime: 1.622ms - CompileTime: 9.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 57.449ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.058ms HDFS_SCAN_NODE (id=2):(Total: 5s140ms, non-child: 5s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.07 GB 3:10/2.39 GB 0:14/3.21 GB 5:14/3.04 GB 6:13/3.01 GB 4:11/2.59 GB 2:8/1.93 GB 1:15/3.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.48 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 119.42 MB - FooterProcessingTime: (Avg: 1.075ms ; Min: 538.916us ; Max: 3.119ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 273.47 MB (286757176) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.47 MB (286757176) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.47 MB (286757176) - CachedFileHandlesHitCount: 70 (70) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s189ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.40 MB (133585988) - PerReadThreadRawHdfsThroughput: 940.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.816ms - RowBatchQueuePutWaitTime: 54m25s - RowsRead: 41.77M (41773833) - RowsReturned: 41.77M (41773833) - RowsReturnedRate: 8.13 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.36K (2361) - ScannerThreadsTotalWallClockTime: 54m39s - MaterializeTupleTime(*): 3s285ms - ScannerThreadsSysTime: 739.885ms - ScannerThreadsUserTime: 6s107ms - ScannerThreadsVoluntaryContextSwitches: 100.48K (100476) - TotalRawHdfsReadTime(*): 290.700ms - TotalReadThroughput: 422.38 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 86 (86) - Files total: 98 (98) - RowGroups processed: 40.80K (40801) - RowGroups rejected: 0 (0) - RowGroups total: 40.80K (40801) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 41.77M (41773833) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 41.77M (41773833) Filter 3 (2.00 MB): - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 41.77M (41773833) Instance 5f429df048b5534b:41bcce1800000003 (host=foo.187.43:22000):(Total: 11m3s, non-child: 10m55s, % non-child: 98.77%) Hdfs split stats (:<# splits>/): 6:13/3.07 GB 7:12/2.75 GB 4:13/3.05 GB 0:12/2.75 GB 3:9/2.14 GB 2:8/1.90 GB 5:13/2.92 GB 1:17/4.02 GB Filter 1 arrival: 2s223ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 93.65 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.19 MB, 136.13 MB, 119.78 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.15 MB (146960527) - PerHostPeakMemUsage: 1.31 GB (1402734431) - RowsProduced: 28.11M (28106114) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m50s - TotalStorageWaitTime: 169.619ms - TotalThreadsInvoluntaryContextSwitches: 2.75K (2753) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 676.894ms - TotalThreadsUserTime: 16s435ms - TotalThreadsVoluntaryContextSwitches: 58.07K (58067) Fragment Instance Lifecycle Timings: - ExecTime: 11m3s - ExecTreeExecTime: 5s107ms - OpenTime: 69.689ms - ExecTreeOpenTime: 187.080us - PrepareTime: 43.986ms - ExecTreePrepareTime: 822.675us DataStreamSender (dst_id=22):(Total: 2s946ms, non-child: 2s946ms, % non-child: 100.00%) - BytesSent: 506.46 MB (531062642) - OverallThroughput: 171.89 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.11M (28106114) - SerializeBatchTime: 2s940ms - UncompressedRowBatchSize: 506.46 MB (531062642) CodeGen:(Total: 98.056ms, non-child: 98.056ms, % non-child: 100.00%) - CodegenTime: 2.192ms - CompileTime: 10.027ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 57.367ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.860ms HDFS_SCAN_NODE (id=2):(Total: 5s089ms, non-child: 5s089ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:13/3.07 GB 7:12/2.75 GB 4:13/3.05 GB 0:12/2.75 GB 3:9/2.14 GB 2:8/1.90 GB 5:13/2.92 GB 1:17/4.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.16 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB, 119.50 MB - FooterProcessingTime: (Avg: 1.509ms ; Min: 525.941us ; Max: 2.931ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 184.43 MB (193391265) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.43 MB (193391265) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.43 MB (193391265) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 794.010ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138829005) - PerReadThreadRawHdfsThroughput: 888.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.955ms - RowBatchQueuePutWaitTime: 54m36s - RowsRead: 28.11M (28106114) - RowsReturned: 28.11M (28106114) - RowsReturnedRate: 5.52 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.78K (1784) - ScannerThreadsTotalWallClockTime: 54m54s - MaterializeTupleTime(*): 2s226ms - ScannerThreadsSysTime: 271.956ms - ScannerThreadsUserTime: 8s959ms - ScannerThreadsVoluntaryContextSwitches: 42.98K (42976) - TotalRawHdfsReadTime(*): 207.649ms - TotalReadThroughput: 284.85 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 89 (89) - Files total: 97 (97) - RowGroups processed: 27.45K (27451) - RowGroups rejected: 0 (0) - RowGroups total: 27.45K (27451) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.11M (28106114) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 83.97K (83968) - Rows rejected: 0 (0) - Rows total: 28.11M (28106114) Filter 3 (2.00 MB): - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 28.11M (28106114) Instance 5f429df048b5534b:41bcce1800000075 (host=foo.234.42:22000):(Total: 11m3s, non-child: 10m53s, % non-child: 98.57%) Hdfs split stats (:<# splits>/): 7:8/1.84 GB 6:13/3.00 GB 1:14/3.23 GB 5:7/1.59 GB 3:11/2.64 GB 2:12/2.69 GB 4:17/4.00 GB 0:16/3.80 GB Filter 1 arrival: 546ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.71 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 134.42 MB, 135.17 MB, 108.88 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.30 MB (147117898) - PerHostPeakMemUsage: 1.31 GB (1403897182) - RowsProduced: 40.71M (40706060) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 236.338ms - TotalThreadsInvoluntaryContextSwitches: 3.54K (3544) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 816.874ms - TotalThreadsUserTime: 18s253ms - TotalThreadsVoluntaryContextSwitches: 66.39K (66388) Fragment Instance Lifecycle Timings: - ExecTime: 11m3s - ExecTreeExecTime: 5s184ms - OpenTime: 62.507ms - ExecTreeOpenTime: 340.377us - PrepareTime: 35.082ms - ExecTreePrepareTime: 1.104ms DataStreamSender (dst_id=22):(Total: 4s259ms, non-child: 4s259ms, % non-child: 100.00%) - BytesSent: 729.37 MB (764801104) - OverallThroughput: 171.22 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 40.71M (40706060) - SerializeBatchTime: 4s249ms - UncompressedRowBatchSize: 729.37 MB (764801104) CodeGen:(Total: 88.159ms, non-child: 88.159ms, % non-child: 100.00%) - CodegenTime: 1.763ms - CompileTime: 10.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 50.353ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.245ms HDFS_SCAN_NODE (id=2):(Total: 5s160ms, non-child: 5s160ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:8/1.84 GB 6:13/3.00 GB 1:14/3.23 GB 5:7/1.59 GB 3:11/2.64 GB 2:12/2.69 GB 4:17/4.00 GB 0:16/3.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 12 out of 12 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s944ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:36 BytesRead(16s000ms): 77.57 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 112.82 MB, 120.95 MB - FooterProcessingTime: (Avg: 2.308ms ; Min: 679.802us ; Max: 8.864ms ; Number of samples: 12) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 266.84 MB (279802520) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.84 MB (279802520) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.84 MB (279802520) - CachedFileHandlesHitCount: 69 (69) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s155ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 12 (12) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828635) - PerReadThreadRawHdfsThroughput: 709.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.434ms - RowBatchQueuePutWaitTime: 54m22s - RowsRead: 40.71M (40706060) - RowsReturned: 40.71M (40706060) - RowsReturnedRate: 7.89 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 2.07K (2071) - ScannerThreadsTotalWallClockTime: 54m50s - MaterializeTupleTime(*): 3s196ms - ScannerThreadsSysTime: 309.951ms - ScannerThreadsUserTime: 7s271ms - ScannerThreadsVoluntaryContextSwitches: 51.12K (51122) - TotalRawHdfsReadTime(*): 376.239ms - TotalReadThroughput: 412.44 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 86 (86) - Files total: 98 (98) - RowGroups processed: 39.76K (39758) - RowGroups rejected: 0 (0) - RowGroups total: 39.76K (39758) - Rows processed: 196.61K (196608) - Rows rejected: 0 (0) - Rows total: 40.71M (40706060) - Splits processed: 12 (12) - Splits rejected: 0 (0) - Splits total: 12 (12) Filter 2 (2.00 MB): - Rows processed: 145.41K (145408) - Rows rejected: 0 (0) - Rows total: 40.71M (40706060) Filter 3 (2.00 MB): - Rows processed: 149.50K (149504) - Rows rejected: 0 (0) - Rows total: 40.71M (40706060) Instance 5f429df048b5534b:41bcce1800000017 (host=foo.234.49:22000):(Total: 11m3s, non-child: 10m53s, % non-child: 98.60%) Hdfs split stats (:<# splits>/): 0:10/2.34 GB 3:10/2.14 GB 2:12/2.82 GB 1:7/1.60 GB 5:11/2.58 GB 7:17/3.94 GB 4:14/3.17 GB 6:16/3.80 GB Filter 1 arrival: 436ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 86.81 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.11 MB, 126.48 MB, 109.64 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 130.11 MB (136433578) - PerHostPeakMemUsage: 1.28 GB (1376628520) - RowsProduced: 36.94M (36940981) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 184.697ms - TotalThreadsInvoluntaryContextSwitches: 3.05K (3047) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 652.899ms - TotalThreadsUserTime: 15s337ms - TotalThreadsVoluntaryContextSwitches: 52.20K (52196) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s159ms - OpenTime: 59.482ms - ExecTreeOpenTime: 207.116us - PrepareTime: 28.747ms - ExecTreePrepareTime: 921.869us DataStreamSender (dst_id=22):(Total: 4s074ms, non-child: 4s074ms, % non-child: 100.00%) - BytesSent: 664.63 MB (696909930) - OverallThroughput: 163.11 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.94M (36940981) - SerializeBatchTime: 4s065ms - UncompressedRowBatchSize: 664.63 MB (696909930) CodeGen:(Total: 81.970ms, non-child: 81.970ms, % non-child: 100.00%) - CodegenTime: 1.430ms - CompileTime: 9.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.429ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 22.951ms HDFS_SCAN_NODE (id=2):(Total: 5s138ms, non-child: 5s138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.34 GB 3:10/2.14 GB 2:12/2.82 GB 1:7/1.60 GB 5:11/2.58 GB 7:17/3.94 GB 4:14/3.17 GB 6:16/3.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:33 BytesRead(16s000ms): 72.61 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 105.62 MB, 107.65 MB - FooterProcessingTime: (Avg: 1.403ms ; Min: 557.276us ; Max: 3.121ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 242.15 MB (253914409) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.15 MB (253914409) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.15 MB (253914409) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s028ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.40 MB (128343183) - PerReadThreadRawHdfsThroughput: 891.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.019ms - RowBatchQueuePutWaitTime: 54m26s - RowsRead: 36.94M (36940981) - RowsReturned: 36.94M (36940981) - RowsReturnedRate: 7.19 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1756) - ScannerThreadsTotalWallClockTime: 54m42s - MaterializeTupleTime(*): 2s886ms - ScannerThreadsSysTime: 166.973ms - ScannerThreadsUserTime: 5s238ms - ScannerThreadsVoluntaryContextSwitches: 36.76K (36757) - TotalRawHdfsReadTime(*): 271.550ms - TotalReadThroughput: 374.00 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 86 (86) - Files total: 97 (97) - RowGroups processed: 36.08K (36080) - RowGroups rejected: 0 (0) - RowGroups total: 36.08K (36080) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 36.94M (36940981) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 36.94M (36940981) Filter 3 (2.00 MB): - Rows processed: 144.38K (144384) - Rows rejected: 0 (0) - Rows total: 36.94M (36940981) Instance 5f429df048b5534b:41bcce180000007d (host=foo.234.36:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.61%) Hdfs split stats (:<# splits>/): 5:12/2.76 GB 4:11/2.58 GB 3:17/3.85 GB 2:9/2.15 GB 6:11/2.71 GB 0:14/3.38 GB 7:10/2.27 GB 1:12/2.84 GB Filter 1 arrival: 554ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 90.10 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.11 MB, 137.46 MB, 114.84 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.25 MB (148109625) - PerHostPeakMemUsage: 1.21 GB (1300992377) - RowsProduced: 36.34M (36339689) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 208.545ms - TotalThreadsInvoluntaryContextSwitches: 2.98K (2975) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 733.885ms - TotalThreadsUserTime: 16s262ms - TotalThreadsVoluntaryContextSwitches: 55.61K (55609) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s186ms - OpenTime: 61.862ms - ExecTreeOpenTime: 300.335us - PrepareTime: 23.251ms - ExecTreePrepareTime: 498.601us DataStreamSender (dst_id=22):(Total: 3s947ms, non-child: 3s947ms, % non-child: 100.00%) - BytesSent: 652.48 MB (684178235) - OverallThroughput: 165.30 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 36.34M (36339689) - SerializeBatchTime: 3s938ms - UncompressedRowBatchSize: 652.48 MB (684178235) CodeGen:(Total: 80.546ms, non-child: 80.546ms, % non-child: 100.00%) - CodegenTime: 1.282ms - CompileTime: 10.796ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 49.972ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 19.305ms HDFS_SCAN_NODE (id=2):(Total: 5s164ms, non-child: 5s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:12/2.76 GB 4:11/2.58 GB 3:17/3.85 GB 2:9/2.15 GB 6:11/2.71 GB 0:14/3.38 GB 7:10/2.27 GB 1:12/2.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 82.26 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 119.65 MB, 123.31 MB - FooterProcessingTime: (Avg: 1.251ms ; Min: 437.498us ; Max: 2.616ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 237.71 MB (249254738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 237.71 MB (249254738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 237.71 MB (249254738) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s028ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877796) - PerReadThreadRawHdfsThroughput: 845.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.913ms - RowBatchQueuePutWaitTime: 54m26s - RowsRead: 36.34M (36339689) - RowsReturned: 36.34M (36339689) - RowsReturnedRate: 7.04 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1699) - ScannerThreadsTotalWallClockTime: 54m40s - MaterializeTupleTime(*): 2s859ms - ScannerThreadsSysTime: 273.955ms - ScannerThreadsUserTime: 6s516ms - ScannerThreadsVoluntaryContextSwitches: 40.59K (40589) - TotalRawHdfsReadTime(*): 281.096ms - TotalReadThroughput: 367.69 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 35.49K (35493) - RowGroups rejected: 0 (0) - RowGroups total: 35.49K (35493) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 36.34M (36339689) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 133.12K (133120) - Rows rejected: 0 (0) - Rows total: 36.34M (36339689) Filter 3 (2.00 MB): - Rows processed: 139.26K (139264) - Rows rejected: 0 (0) - Rows total: 36.34M (36339689) Instance 5f429df048b5534b:41bcce1800000051 (host=foo.187.42:22000):(Total: 11m2s, non-child: 10m54s, % non-child: 98.71%) Hdfs split stats (:<# splits>/): 2:10/2.34 GB 4:11/2.57 GB 5:15/3.63 GB 0:14/3.32 GB 7:11/2.71 GB 3:13/3.13 GB 1:9/2.18 GB 6:12/2.86 GB Filter 1 arrival: 2s158ms Filter 2 arrival: 10m39s Filter 3 arrival: 10m39s MemoryUsage(16s000ms): 84.55 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.77 MB, 122.89 MB, 102.57 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 127.36 MB (133546229) - PerHostPeakMemUsage: 1.21 GB (1294039108) - RowsProduced: 32.68M (32675331) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 231.117ms - TotalThreadsInvoluntaryContextSwitches: 2.78K (2784) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 1s272ms - TotalThreadsUserTime: 13s495ms - TotalThreadsVoluntaryContextSwitches: 99.59K (99593) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s122ms - OpenTime: 71.675ms - ExecTreeOpenTime: 571.526us - PrepareTime: 34.736ms - ExecTreePrepareTime: 837.618us DataStreamSender (dst_id=22):(Total: 3s370ms, non-child: 3s370ms, % non-child: 100.00%) - BytesSent: 587.32 MB (615846507) - OverallThroughput: 174.25 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.68M (32675331) - SerializeBatchTime: 3s362ms - UncompressedRowBatchSize: 587.32 MB (615846507) CodeGen:(Total: 100.155ms, non-child: 100.155ms, % non-child: 100.00%) - CodegenTime: 1.412ms - CompileTime: 13.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.497ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.544ms HDFS_SCAN_NODE (id=2):(Total: 5s102ms, non-child: 5s102ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.34 GB 4:11/2.57 GB 5:15/3.63 GB 0:14/3.32 GB 7:11/2.71 GB 3:13/3.13 GB 1:9/2.18 GB 6:12/2.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.58 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 107.02 MB, 110.01 MB - FooterProcessingTime: (Avg: 3.337ms ; Min: 572.792us ; Max: 16.128ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.94 - BytesRead: 213.90 MB (224287355) - BytesReadDataNodeCache: 0 - BytesReadLocal: 213.90 MB (224287355) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 213.90 MB (224287355) - CachedFileHandlesHitCount: 56 (56) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 925.891ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.39 MB (125192058) - PerReadThreadRawHdfsThroughput: 714.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.708ms - RowBatchQueuePutWaitTime: 54m26s - RowsRead: 32.68M (32675331) - RowsReturned: 32.68M (32675331) - RowsReturnedRate: 6.40 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 54m33s - MaterializeTupleTime(*): 2s610ms - ScannerThreadsSysTime: 838.869ms - ScannerThreadsUserTime: 5s080ms - ScannerThreadsVoluntaryContextSwitches: 84.46K (84460) - TotalRawHdfsReadTime(*): 299.321ms - TotalReadThroughput: 330.86 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 85 (85) - Files total: 95 (95) - RowGroups processed: 31.91K (31913) - RowGroups rejected: 0 (0) - RowGroups total: 31.91K (31913) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 32.68M (32675331) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 128.00K (128000) - Rows rejected: 0 (0) - Rows total: 32.68M (32675331) Filter 3 (2.00 MB): - Rows processed: 148.48K (148480) - Rows rejected: 0 (0) - Rows total: 32.68M (32675331) Instance 5f429df048b5534b:41bcce180000001d (host=foo.234.43:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 1:11/2.64 GB 2:13/3.14 GB 5:15/3.70 GB 0:16/3.74 GB 6:7/1.73 GB 4:5/1.23 GB 7:14/3.38 GB 3:13/3.03 GB Filter 1 arrival: 569ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 88.23 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.24 MB, 134.55 MB, 114.77 MB ThreadUsage(16s000ms): 4, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.94 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.50 MB (145231228) - PerHostPeakMemUsage: 1.31 GB (1402606304) - RowsProduced: 33.47M (33466692) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 182.487ms - TotalThreadsInvoluntaryContextSwitches: 2.98K (2982) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 825.873ms - TotalThreadsUserTime: 15s728ms - TotalThreadsVoluntaryContextSwitches: 77.94K (77942) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s169ms - OpenTime: 68.390ms - ExecTreeOpenTime: 176.552us - PrepareTime: 41.158ms - ExecTreePrepareTime: 839.661us DataStreamSender (dst_id=22):(Total: 3s588ms, non-child: 3s588ms, % non-child: 100.00%) - BytesSent: 599.17 MB (628278255) - OverallThroughput: 166.95 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.47M (33466692) - SerializeBatchTime: 3s581ms - UncompressedRowBatchSize: 599.17 MB (628278255) CodeGen:(Total: 103.224ms, non-child: 103.224ms, % non-child: 100.00%) - CodegenTime: 2.546ms - CompileTime: 9.689ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 56.791ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 35.989ms HDFS_SCAN_NODE (id=2):(Total: 5s148ms, non-child: 5s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.64 GB 2:13/3.14 GB 5:15/3.70 GB 0:16/3.74 GB 6:7/1.73 GB 4:5/1.23 GB 7:14/3.38 GB 3:13/3.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s918ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:84 PARQUET/SNAPPY:30 BytesRead(16s000ms): 69.80 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 106.36 MB, 110.44 MB - FooterProcessingTime: (Avg: 1.271ms ; Min: 686.328us ; Max: 2.613ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 219.46 MB (230124782) - BytesReadDataNodeCache: 0 - BytesReadLocal: 219.46 MB (230124782) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 219.46 MB (230124782) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 948.495ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.40 MB (136731325) - PerReadThreadRawHdfsThroughput: 752.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.962ms - RowBatchQueuePutWaitTime: 54m21s - RowsRead: 33.47M (33466692) - RowsReturned: 33.47M (33466692) - RowsReturnedRate: 6.50 M/sec - ScanRangesComplete: 94 (94) - ScannerThreadsInvoluntaryContextSwitches: 1.81K (1811) - ScannerThreadsTotalWallClockTime: 54m36s - MaterializeTupleTime(*): 2s619ms - ScannerThreadsSysTime: 394.938ms - ScannerThreadsUserTime: 6s687ms - ScannerThreadsVoluntaryContextSwitches: 62.54K (62541) - TotalRawHdfsReadTime(*): 291.571ms - TotalReadThroughput: 339.47 KB/sec Filter 1 (8.00 KB): - Files processed: 94 (94) - Files rejected: 84 (84) - Files total: 94 (94) - RowGroups processed: 32.69K (32687) - RowGroups rejected: 0 (0) - RowGroups total: 32.69K (32687) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 33.47M (33466692) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 115.71K (115712) - Rows rejected: 0 (0) - Rows total: 33.47M (33466692) Filter 3 (2.00 MB): - Rows processed: 116.74K (116736) - Rows rejected: 0 (0) - Rows total: 33.47M (33466692) Instance 5f429df048b5534b:41bcce1800000062 (host=foo.246.40:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.60%) Hdfs split stats (:<# splits>/): 2:9/2.04 GB 6:8/1.76 GB 3:13/3.01 GB 5:17/4.00 GB 0:14/3.24 GB 4:9/2.15 GB 1:13/3.20 GB 7:13/3.20 GB Filter 1 arrival: 242ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 88.35 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 134.29 MB, 135.06 MB, 115.86 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.08 MB (146883430) - PerHostPeakMemUsage: 1.28 GB (1376696014) - RowsProduced: 37.95M (37951838) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 203.029ms - TotalThreadsInvoluntaryContextSwitches: 3.29K (3291) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 616.903ms - TotalThreadsUserTime: 16s257ms - TotalThreadsVoluntaryContextSwitches: 53.27K (53270) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s132ms - OpenTime: 75.886ms - ExecTreeOpenTime: 198.710us - PrepareTime: 34.517ms - ExecTreePrepareTime: 923.958us DataStreamSender (dst_id=22):(Total: 4s082ms, non-child: 4s082ms, % non-child: 100.00%) - BytesSent: 679.71 MB (712722631) - OverallThroughput: 166.49 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.95M (37951838) - SerializeBatchTime: 4s073ms - UncompressedRowBatchSize: 679.71 MB (712722631) CodeGen:(Total: 102.345ms, non-child: 102.345ms, % non-child: 100.00%) - CodegenTime: 1.479ms - CompileTime: 10.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 64.520ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.103ms HDFS_SCAN_NODE (id=2):(Total: 5s107ms, non-child: 5s107ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:9/2.04 GB 6:8/1.76 GB 3:13/3.01 GB 5:17/4.00 GB 0:14/3.24 GB 4:9/2.15 GB 1:13/3.20 GB 7:13/3.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07559% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 78.46 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 119.56 MB, 123.14 MB - FooterProcessingTime: (Avg: 1.443ms ; Min: 561.024us ; Max: 3.140ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 248.59 MB (260664360) - BytesReadDataNodeCache: 0 - BytesReadLocal: 248.59 MB (260664360) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 248.59 MB (260664360) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s069ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828862) - PerReadThreadRawHdfsThroughput: 668.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.048ms - RowBatchQueuePutWaitTime: 54m24s - RowsRead: 37.95M (37951838) - RowsReturned: 37.95M (37951838) - RowsReturnedRate: 7.43 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2013) - ScannerThreadsTotalWallClockTime: 54m41s - MaterializeTupleTime(*): 2s911ms - ScannerThreadsSysTime: 146.975ms - ScannerThreadsUserTime: 6s153ms - ScannerThreadsVoluntaryContextSwitches: 37.95K (37954) - TotalRawHdfsReadTime(*): 371.768ms - TotalReadThroughput: 384.52 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 37.07K (37067) - RowGroups rejected: 0 (0) - RowGroups total: 37.07K (37067) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.95M (37951838) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 146.43K (146432) - Rows rejected: 0 (0) - Rows total: 37.95M (37951838) Filter 3 (2.00 MB): - Rows processed: 139.26K (139264) - Rows rejected: 0 (0) - Rows total: 37.95M (37951838) Instance 5f429df048b5534b:41bcce180000001a (host=foo.246.42:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.65%) Hdfs split stats (:<# splits>/): 5:17/3.84 GB 3:11/2.64 GB 6:10/2.43 GB 2:12/2.70 GB 7:7/1.53 GB 1:12/2.89 GB 4:14/3.19 GB 0:15/3.39 GB Filter 1 arrival: 213ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 88.31 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.03 MB, 128.97 MB, 113.31 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 134.22 MB (140736494) - PerHostPeakMemUsage: 1.22 GB (1308016236) - RowsProduced: 33.49M (33485502) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 244.139ms - TotalThreadsInvoluntaryContextSwitches: 3.04K (3039) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 668.897ms - TotalThreadsUserTime: 16s707ms - TotalThreadsVoluntaryContextSwitches: 55.82K (55822) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s159ms - OpenTime: 63.472ms - ExecTreeOpenTime: 191.243us - PrepareTime: 37.446ms - ExecTreePrepareTime: 935.819us DataStreamSender (dst_id=22):(Total: 3s709ms, non-child: 3s709ms, % non-child: 100.00%) - BytesSent: 596.78 MB (625766618) - OverallThroughput: 160.88 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.49M (33485502) - SerializeBatchTime: 3s700ms - UncompressedRowBatchSize: 596.78 MB (625766618) CodeGen:(Total: 93.058ms, non-child: 93.058ms, % non-child: 100.00%) - CodegenTime: 1.461ms - CompileTime: 9.493ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.874ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 30.075ms HDFS_SCAN_NODE (id=2):(Total: 5s137ms, non-child: 5s137ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/3.84 GB 3:11/2.64 GB 6:10/2.43 GB 2:12/2.70 GB 7:7/1.53 GB 1:12/2.89 GB 4:14/3.19 GB 0:15/3.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s939ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07553% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:30 BytesRead(16s000ms): 72.92 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 106.06 MB, 112.18 MB - FooterProcessingTime: (Avg: 1.430ms ; Min: 522.626us ; Max: 2.872ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 219.08 MB (229717883) - BytesReadDataNodeCache: 0 - BytesReadLocal: 219.08 MB (229717883) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 219.08 MB (229717883) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 931.853ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.40 MB (132537403) - PerReadThreadRawHdfsThroughput: 676.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.479ms - RowBatchQueuePutWaitTime: 54m21s - RowsRead: 33.49M (33485502) - RowsReturned: 33.49M (33485502) - RowsReturnedRate: 6.52 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.82K (1816) - ScannerThreadsTotalWallClockTime: 54m47s - MaterializeTupleTime(*): 2s598ms - ScannerThreadsSysTime: 223.964ms - ScannerThreadsUserTime: 7s363ms - ScannerThreadsVoluntaryContextSwitches: 40.35K (40353) - TotalRawHdfsReadTime(*): 323.768ms - TotalReadThroughput: 338.87 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 88 (88) - Files total: 98 (98) - RowGroups processed: 32.71K (32706) - RowGroups rejected: 0 (0) - RowGroups total: 32.71K (32706) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 33.49M (33485502) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 33.49M (33485502) Filter 3 (2.00 MB): - Rows processed: 110.59K (110592) - Rows rejected: 0 (0) - Rows total: 33.49M (33485502) Instance 5f429df048b5534b:41bcce1800000081 (host=foo.246.50:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.62%) Hdfs split stats (:<# splits>/): 0:8/1.97 GB 3:6/1.26 GB 6:9/1.92 GB 4:10/2.46 GB 1:23/5.46 GB 2:13/2.99 GB 7:13/3.01 GB 5:14/3.45 GB Filter 1 arrival: 110ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 88.97 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.11 MB, 129.56 MB, 107.63 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 134.44 MB (140968077) - PerHostPeakMemUsage: 1.25 GB (1346091482) - RowsProduced: 37.13M (37126203) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 263.104ms - TotalThreadsInvoluntaryContextSwitches: 3.18K (3182) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 704.891ms - TotalThreadsUserTime: 15s121ms - TotalThreadsVoluntaryContextSwitches: 55.44K (55435) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s149ms - OpenTime: 66.071ms - ExecTreeOpenTime: 197.936us - PrepareTime: 36.232ms - ExecTreePrepareTime: 1.102ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 289 (289) - BlocksRecycled: 67 (67) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.39 GB (173287063552) - PeakMemoryUsage: 1.02 GB (1099514880) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=22):(Total: 3s938ms, non-child: 3s938ms, % non-child: 100.00%) - BytesSent: 667.28 MB (699698519) - OverallThroughput: 169.40 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 37.13M (37126203) - SerializeBatchTime: 3s929ms - UncompressedRowBatchSize: 667.28 MB (699698519) CodeGen:(Total: 94.444ms, non-child: 94.444ms, % non-child: 100.00%) - CodegenTime: 1.461ms - CompileTime: 10.039ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.870ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.991ms HDFS_SCAN_NODE (id=2):(Total: 5s125ms, non-child: 5s125ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:8/1.97 GB 3:6/1.26 GB 6:9/1.92 GB 4:10/2.46 GB 1:23/5.46 GB 2:13/2.99 GB 7:13/3.01 GB 5:14/3.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s921ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:85 PARQUET/SNAPPY:33 BytesRead(16s000ms): 73.02 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 106.21 MB, 112.27 MB - FooterProcessingTime: (Avg: 2.719ms ; Min: 454.069us ; Max: 13.759ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 242.66 MB (254452048) - BytesReadDataNodeCache: 0 - BytesReadLocal: 242.66 MB (254452048) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 242.66 MB (254452048) - CachedFileHandlesHitCount: 63 (63) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s049ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.40 MB (132537530) - PerReadThreadRawHdfsThroughput: 747.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.000ms - RowBatchQueuePutWaitTime: 54m22s - RowsRead: 37.13M (37126203) - RowsReturned: 37.13M (37126203) - RowsReturnedRate: 7.24 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.84K (1837) - ScannerThreadsTotalWallClockTime: 54m37s - MaterializeTupleTime(*): 2s925ms - ScannerThreadsSysTime: 201.968ms - ScannerThreadsUserTime: 5s271ms - ScannerThreadsVoluntaryContextSwitches: 39.96K (39960) - TotalRawHdfsReadTime(*): 324.473ms - TotalReadThroughput: 375.36 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 85 (85) - Files total: 96 (96) - RowGroups processed: 36.26K (36262) - RowGroups rejected: 0 (0) - RowGroups total: 36.26K (36262) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 37.13M (37126203) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 143.36K (143360) - Rows rejected: 0 (0) - Rows total: 37.13M (37126203) Filter 3 (2.00 MB): - Rows processed: 137.22K (137216) - Rows rejected: 0 (0) - Rows total: 37.13M (37126203) Instance 5f429df048b5534b:41bcce1800000007 (host=foo.234.48:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.63%) Hdfs split stats (:<# splits>/): 7:10/2.46 GB 2:14/3.45 GB 1:10/2.33 GB 4:13/3.20 GB 3:11/2.71 GB 5:8/1.64 GB 6:17/3.94 GB 0:10/2.28 GB Filter 1 arrival: 424ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 93.92 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.40 MB, 136.79 MB, 119.74 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.43 MB (147255448) - PerHostPeakMemUsage: 1.28 GB (1370121389) - RowsProduced: 35.48M (35476970) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 190.935ms - TotalThreadsInvoluntaryContextSwitches: 2.94K (2944) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 674.895ms - TotalThreadsUserTime: 15s774ms - TotalThreadsVoluntaryContextSwitches: 58.33K (58326) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s161ms - OpenTime: 64.218ms - ExecTreeOpenTime: 182.432us - PrepareTime: 35.435ms - ExecTreePrepareTime: 1.036ms DataStreamSender (dst_id=22):(Total: 3s847ms, non-child: 3s847ms, % non-child: 100.00%) - BytesSent: 636.73 MB (667655996) - OverallThroughput: 165.49 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 35.48M (35476970) - SerializeBatchTime: 3s839ms - UncompressedRowBatchSize: 636.73 MB (667655996) CodeGen:(Total: 93.533ms, non-child: 93.533ms, % non-child: 100.00%) - CodegenTime: 1.532ms - CompileTime: 10.396ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.764ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 29.782ms HDFS_SCAN_NODE (id=2):(Total: 5s138ms, non-child: 5s138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:10/2.46 GB 2:14/3.45 GB 1:10/2.33 GB 4:13/3.20 GB 3:11/2.71 GB 5:8/1.64 GB 6:17/3.94 GB 0:10/2.28 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:83 PARQUET/SNAPPY:30 BytesRead(16s000ms): 82.18 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB, 119.53 MB - FooterProcessingTime: (Avg: 1.457ms ; Min: 808.047us ; Max: 2.620ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 232.18 MB (243460410) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.18 MB (243460410) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.18 MB (243460410) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s005ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138829004) - PerReadThreadRawHdfsThroughput: 827.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.090ms - RowBatchQueuePutWaitTime: 54m25s - RowsRead: 35.48M (35476970) - RowsReturned: 35.48M (35476970) - RowsReturnedRate: 6.90 M/sec - ScanRangesComplete: 93 (93) - ScannerThreadsInvoluntaryContextSwitches: 1.77K (1768) - ScannerThreadsTotalWallClockTime: 54m50s - MaterializeTupleTime(*): 2s806ms - ScannerThreadsSysTime: 237.961ms - ScannerThreadsUserTime: 6s375ms - ScannerThreadsVoluntaryContextSwitches: 43.34K (43338) - TotalRawHdfsReadTime(*): 280.419ms - TotalReadThroughput: 359.69 KB/sec Filter 1 (8.00 KB): - Files processed: 93 (93) - Files rejected: 83 (83) - Files total: 93 (93) - RowGroups processed: 34.65K (34650) - RowGroups rejected: 0 (0) - RowGroups total: 34.65K (34650) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 35.48M (35476970) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 35.48M (35476970) Filter 3 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 35.48M (35476970) Instance 5f429df048b5534b:41bcce1800000080 (host=foo.246.36:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.72%) Hdfs split stats (:<# splits>/): 4:13/3.14 GB 2:11/2.64 GB 3:7/1.66 GB 1:10/2.39 GB 7:9/2.00 GB 0:12/2.96 GB 5:25/5.69 GB 6:11/2.45 GB Filter 1 arrival: 311ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 95.18 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.25 MB, 138.76 MB, 121.27 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 142.43 MB (149350533) - PerHostPeakMemUsage: 1.28 GB (1373964388) - RowsProduced: 30.86M (30863949) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m48s - TotalStorageWaitTime: 203.419ms - TotalThreadsInvoluntaryContextSwitches: 2.71K (2715) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 1s228ms - TotalThreadsUserTime: 14s482ms - TotalThreadsVoluntaryContextSwitches: 130.11K (130107) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s135ms - OpenTime: 67.143ms - ExecTreeOpenTime: 222.427us - PrepareTime: 26.729ms - ExecTreePrepareTime: 727.112us DataStreamSender (dst_id=22):(Total: 3s299ms, non-child: 3s299ms, % non-child: 100.00%) - BytesSent: 549.79 MB (576497824) - OverallThroughput: 166.61 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 30.86M (30863949) - SerializeBatchTime: 3s292ms - UncompressedRowBatchSize: 549.79 MB (576497824) CodeGen:(Total: 87.969ms, non-child: 87.969ms, % non-child: 100.00%) - CodegenTime: 1.295ms - CompileTime: 11.652ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.448ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 21.383ms HDFS_SCAN_NODE (id=2):(Total: 5s116ms, non-child: 5s116ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:13/3.14 GB 2:11/2.64 GB 3:7/1.66 GB 1:10/2.39 GB 7:9/2.00 GB 0:12/2.96 GB 5:25/5.69 GB 6:11/2.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s940ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:89 PARQUET/SNAPPY:27 BytesRead(16s000ms): 82.16 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB, 119.51 MB - FooterProcessingTime: (Avg: 1.533ms ; Min: 866.922us ; Max: 2.872ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 201.94 MB (211751599) - BytesReadDataNodeCache: 0 - BytesReadLocal: 201.94 MB (211751599) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 201.94 MB (211751599) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 861.395ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 134.40 MB (140925742) - PerReadThreadRawHdfsThroughput: 791.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.315ms - RowBatchQueuePutWaitTime: 54m25s - RowsRead: 30.86M (30863949) - RowsReturned: 30.86M (30863949) - RowsReturnedRate: 6.03 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1540) - ScannerThreadsTotalWallClockTime: 54m51s - MaterializeTupleTime(*): 2s436ms - ScannerThreadsSysTime: 780.879ms - ScannerThreadsUserTime: 6s175ms - ScannerThreadsVoluntaryContextSwitches: 114.91K (114907) - TotalRawHdfsReadTime(*): 255.123ms - TotalReadThroughput: 312.61 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 89 (89) - Files total: 98 (98) - RowGroups processed: 30.14K (30145) - RowGroups rejected: 0 (0) - RowGroups total: 30.14K (30145) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 30.86M (30863949) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 30.86M (30863949) Filter 3 (2.00 MB): - Rows processed: 119.81K (119808) - Rows rejected: 0 (0) - Rows total: 30.86M (30863949) Instance 5f429df048b5534b:41bcce1800000054 (host=foo.234.52:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.67%) Hdfs split stats (:<# splits>/): 7:10/2.31 GB 1:12/2.66 GB 2:13/2.88 GB 5:12/2.82 GB 6:20/4.80 GB 0:10/2.39 GB 3:11/2.22 GB 4:12/2.69 GB Filter 1 arrival: 405ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 91.07 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.13 MB, 132.99 MB, 111.06 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 138.27 MB (144990751) - PerHostPeakMemUsage: 1.22 GB (1314367736) - RowsProduced: 33.61M (33613538) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 203.943ms - TotalThreadsInvoluntaryContextSwitches: 3.20K (3203) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 652.898ms - TotalThreadsUserTime: 15s990ms - TotalThreadsVoluntaryContextSwitches: 51.82K (51821) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s129ms - OpenTime: 69.787ms - ExecTreeOpenTime: 195.957us - PrepareTime: 33.597ms - ExecTreePrepareTime: 970.530us DataStreamSender (dst_id=22):(Total: 3s598ms, non-child: 3s598ms, % non-child: 100.00%) - BytesSent: 602.69 MB (631961171) - OverallThroughput: 167.47 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 33.61M (33613538) - SerializeBatchTime: 3s591ms - UncompressedRowBatchSize: 602.69 MB (631961171) CodeGen:(Total: 96.795ms, non-child: 96.795ms, % non-child: 100.00%) - CodegenTime: 1.359ms - CompileTime: 10.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 58.529ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.529ms HDFS_SCAN_NODE (id=2):(Total: 5s109ms, non-child: 5s109ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:10/2.31 GB 1:12/2.66 GB 2:13/2.88 GB 5:12/2.82 GB 6:20/4.80 GB 0:10/2.39 GB 3:11/2.22 GB 4:12/2.69 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.30 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 106.62 MB, 112.75 MB - FooterProcessingTime: (Avg: 1.573ms ; Min: 553.512us ; Max: 2.846ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 219.91 MB (230589119) - BytesReadDataNodeCache: 0 - BytesReadLocal: 219.91 MB (230589119) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 219.91 MB (230589119) - CachedFileHandlesHitCount: 57 (57) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 964.955ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.40 MB (136732075) - PerReadThreadRawHdfsThroughput: 756.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.321ms - RowBatchQueuePutWaitTime: 54m20s - RowsRead: 33.61M (33613538) - RowsReturned: 33.61M (33613538) - RowsReturnedRate: 6.58 M/sec - ScanRangesComplete: 100 (100) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1973) - ScannerThreadsTotalWallClockTime: 54m43s - MaterializeTupleTime(*): 2s673ms - ScannerThreadsSysTime: 194.968ms - ScannerThreadsUserTime: 6s968ms - ScannerThreadsVoluntaryContextSwitches: 36.47K (36474) - TotalRawHdfsReadTime(*): 290.754ms - TotalReadThroughput: 340.67 KB/sec Filter 1 (8.00 KB): - Files processed: 100 (100) - Files rejected: 90 (90) - Files total: 100 (100) - RowGroups processed: 32.83K (32832) - RowGroups rejected: 0 (0) - RowGroups total: 32.83K (32832) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 33.61M (33613538) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 125.95K (125952) - Rows rejected: 0 (0) - Rows total: 33.61M (33613538) Filter 3 (2.00 MB): - Rows processed: 141.31K (141312) - Rows rejected: 0 (0) - Rows total: 33.61M (33613538) Instance 5f429df048b5534b:41bcce180000002c (host=foo.246.39:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.66%) Hdfs split stats (:<# splits>/): 5:8/1.78 GB 1:14/3.41 GB 3:14/3.38 GB 4:13/3.14 GB 6:7/1.66 GB 7:11/2.65 GB 2:16/3.54 GB 0:13/3.20 GB Filter 1 arrival: 300ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 94.58 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.34 MB, 137.70 MB, 115.45 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 141.13 MB (147987589) - PerHostPeakMemUsage: 1.27 GB (1362652558) - RowsProduced: 34.64M (34636086) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 207.591ms - TotalThreadsInvoluntaryContextSwitches: 3.10K (3098) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 651.898ms - TotalThreadsUserTime: 16s268ms - TotalThreadsVoluntaryContextSwitches: 54.57K (54570) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s128ms - OpenTime: 83.952ms - ExecTreeOpenTime: 188.035us - PrepareTime: 29.304ms - ExecTreePrepareTime: 736.914us DataStreamSender (dst_id=22):(Total: 3s656ms, non-child: 3s656ms, % non-child: 100.00%) - BytesSent: 621.19 MB (651363838) - OverallThroughput: 169.88 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.64M (34636086) - SerializeBatchTime: 3s648ms - UncompressedRowBatchSize: 621.19 MB (651363838) CodeGen:(Total: 106.809ms, non-child: 106.809ms, % non-child: 100.00%) - CodegenTime: 1.518ms - CompileTime: 11.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 71.227ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.443ms HDFS_SCAN_NODE (id=2):(Total: 5s107ms, non-child: 5s107ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:8/1.78 GB 1:14/3.41 GB 3:14/3.38 GB 4:13/3.14 GB 6:7/1.66 GB 7:11/2.65 GB 2:16/3.54 GB 0:13/3.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s916ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07559% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.85 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 113.23 MB, 119.96 MB - FooterProcessingTime: (Avg: 1.305ms ; Min: 621.042us ; Max: 2.890ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 226.36 MB (237359831) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.36 MB (237359831) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.36 MB (237359831) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 972.742ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.40 MB (139877709) - PerReadThreadRawHdfsThroughput: 750.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.644ms - RowBatchQueuePutWaitTime: 54m20s - RowsRead: 34.64M (34636086) - RowsReturned: 34.64M (34636086) - RowsReturnedRate: 6.78 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.90K (1903) - ScannerThreadsTotalWallClockTime: 54m45s - MaterializeTupleTime(*): 2s714ms - ScannerThreadsSysTime: 203.966ms - ScannerThreadsUserTime: 7s042ms - ScannerThreadsVoluntaryContextSwitches: 39.54K (39539) - TotalRawHdfsReadTime(*): 301.684ms - TotalReadThroughput: 350.41 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 33.83K (33830) - RowGroups rejected: 0 (0) - RowGroups total: 33.83K (33830) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.64M (34636086) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 129.02K (129024) - Rows rejected: 0 (0) - Rows total: 34.64M (34636086) Filter 3 (2.00 MB): - Rows processed: 108.54K (108544) - Rows rejected: 0 (0) - Rows total: 34.64M (34636086) Instance 5f429df048b5534b:41bcce1800000022 (host=foo.246.52:22000):(Total: 11m2s, non-child: 10m53s, % non-child: 98.64%) Hdfs split stats (:<# splits>/): 6:11/2.58 GB 0:8/1.86 GB 1:9/2.22 GB 4:13/2.93 GB 2:14/3.18 GB 3:11/2.57 GB 5:15/3.54 GB 7:15/3.51 GB Filter 1 arrival: 97ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 92.60 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 134.33 MB, 135.03 MB, 117.83 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.25 MB (147064895) - PerHostPeakMemUsage: 1.23 GB (1318272346) - RowsProduced: 34.59M (34591720) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 186.513ms - TotalThreadsInvoluntaryContextSwitches: 3.15K (3149) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 854.868ms - TotalThreadsUserTime: 16s225ms - TotalThreadsVoluntaryContextSwitches: 75.54K (75543) Fragment Instance Lifecycle Timings: - ExecTime: 11m2s - ExecTreeExecTime: 5s150ms - OpenTime: 64.982ms - ExecTreeOpenTime: 371.639us - PrepareTime: 31.698ms - ExecTreePrepareTime: 856.259us DataStreamSender (dst_id=22):(Total: 3s788ms, non-child: 3s788ms, % non-child: 100.00%) - BytesSent: 620.50 MB (650637231) - OverallThroughput: 163.79 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 34.59M (34591720) - SerializeBatchTime: 3s779ms - UncompressedRowBatchSize: 620.50 MB (650637231) CodeGen:(Total: 90.396ms, non-child: 90.396ms, % non-child: 100.00%) - CodegenTime: 1.323ms - CompileTime: 11.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 52.255ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 26.239ms HDFS_SCAN_NODE (id=2):(Total: 5s129ms, non-child: 5s129ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:11/2.58 GB 0:8/1.86 GB 1:9/2.22 GB 4:13/2.93 GB 2:14/3.18 GB 3:11/2.57 GB 5:15/3.54 GB 7:15/3.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:86 PARQUET/SNAPPY:30 BytesRead(16s000ms): 77.87 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 113.26 MB, 119.37 MB - FooterProcessingTime: (Avg: 1.697ms ; Min: 772.063us ; Max: 2.849ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.96 - BytesRead: 226.25 MB (237243551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.25 MB (237243551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.25 MB (237243551) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 979.715ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.43 MB (138862762) - PerReadThreadRawHdfsThroughput: 889.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.633ms - RowBatchQueuePutWaitTime: 54m20s - RowsRead: 34.59M (34591720) - RowsReturned: 34.59M (34591720) - RowsReturnedRate: 6.74 M/sec - ScanRangesComplete: 96 (96) - ScannerThreadsInvoluntaryContextSwitches: 1.95K (1953) - ScannerThreadsTotalWallClockTime: 54m37s - MaterializeTupleTime(*): 2s765ms - ScannerThreadsSysTime: 382.940ms - ScannerThreadsUserTime: 6s737ms - ScannerThreadsVoluntaryContextSwitches: 60.04K (60040) - TotalRawHdfsReadTime(*): 254.458ms - TotalReadThroughput: 350.50 KB/sec Filter 1 (8.00 KB): - Files processed: 96 (96) - Files rejected: 86 (86) - Files total: 96 (96) - RowGroups processed: 33.78K (33785) - RowGroups rejected: 0 (0) - RowGroups total: 33.78K (33785) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 34.59M (34591720) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 113.66K (113664) - Rows rejected: 0 (0) - Rows total: 34.59M (34591720) Filter 3 (2.00 MB): - Rows processed: 130.05K (130048) - Rows rejected: 0 (0) - Rows total: 34.59M (34591720) Instance 5f429df048b5534b:41bcce1800000037 (host=foo.234.51:22000):(Total: 11m1s, non-child: 10m52s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 1:15/3.36 GB 3:12/2.70 GB 4:18/4.23 GB 6:13/3.03 GB 5:8/1.78 GB 7:10/2.39 GB 0:13/3.00 GB 2:9/2.08 GB Filter 1 arrival: 400ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 75.03 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 108.81 MB, 109.36 MB, 81.20 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 5.92 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 113.28 MB (118781122) - PerHostPeakMemUsage: 1.28 GB (1377587880) - RowsProduced: 32.20M (32201839) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m47s - TotalStorageWaitTime: 187.769ms - TotalThreadsInvoluntaryContextSwitches: 2.77K (2770) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 599.907ms - TotalThreadsUserTime: 14s116ms - TotalThreadsVoluntaryContextSwitches: 47.14K (47143) Fragment Instance Lifecycle Timings: - ExecTime: 11m1s - ExecTreeExecTime: 5s130ms - OpenTime: 71.145ms - ExecTreeOpenTime: 210.028us - PrepareTime: 31.442ms - ExecTreePrepareTime: 791.656us DataStreamSender (dst_id=22):(Total: 3s481ms, non-child: 3s481ms, % non-child: 100.00%) - BytesSent: 578.45 MB (606548193) - OverallThroughput: 166.17 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 32.20M (32201839) - SerializeBatchTime: 3s473ms - UncompressedRowBatchSize: 578.45 MB (606548193) CodeGen:(Total: 96.038ms, non-child: 96.038ms, % non-child: 100.00%) - CodegenTime: 1.354ms - CompileTime: 10.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 59.684ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 25.358ms HDFS_SCAN_NODE (id=2):(Total: 5s112ms, non-child: 5s112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/3.36 GB 3:12/2.70 GB 4:18/4.23 GB 6:13/3.03 GB 5:8/1.78 GB 7:10/2.39 GB 0:13/3.00 GB 2:9/2.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:33 BytesRead(16s000ms): 60.09 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 87.40 MB, 102.13 MB - FooterProcessingTime: (Avg: 1.501ms ; Min: 713.523us ; Max: 3.205ms ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.93 - BytesRead: 211.64 MB (221917754) - BytesReadDataNodeCache: 0 - BytesReadLocal: 211.64 MB (221917754) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 211.64 MB (221917754) - CachedFileHandlesHitCount: 58 (58) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 915.692ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 11 (11) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 105.39 MB (110511655) - PerReadThreadRawHdfsThroughput: 831.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.029ms - RowBatchQueuePutWaitTime: 54m3s - RowsRead: 32.20M (32201839) - RowsReturned: 32.20M (32201839) - RowsReturnedRate: 6.30 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1600) - ScannerThreadsTotalWallClockTime: 54m17s - MaterializeTupleTime(*): 2s546ms - ScannerThreadsSysTime: 159.974ms - ScannerThreadsUserTime: 5s380ms - ScannerThreadsVoluntaryContextSwitches: 32.15K (32151) - TotalRawHdfsReadTime(*): 254.373ms - TotalReadThroughput: 328.36 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 87 (87) - Files total: 98 (98) - RowGroups processed: 31.45K (31452) - RowGroups rejected: 0 (0) - RowGroups total: 31.45K (31452) - Rows processed: 180.22K (180224) - Rows rejected: 0 (0) - Rows total: 32.20M (32201839) - Splits processed: 11 (11) - Splits rejected: 0 (0) - Splits total: 11 (11) Filter 2 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 32.20M (32201839) Filter 3 (2.00 MB): - Rows processed: 140.29K (140288) - Rows rejected: 0 (0) - Rows total: 32.20M (32201839) Instance 5f429df048b5534b:41bcce1800000038 (host=foo.246.46:22000):(Total: 11m1s, non-child: 10m52s, % non-child: 98.70%) Hdfs split stats (:<# splits>/): 3:12/2.96 GB 2:16/3.79 GB 5:12/2.75 GB 4:12/2.88 GB 7:9/2.17 GB 1:15/3.58 GB 6:12/2.60 GB 0:10/2.09 GB Filter 1 arrival: 132ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 85.15 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 123.53 MB, 124.38 MB, 103.88 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.95 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 129.18 MB (135457077) - PerHostPeakMemUsage: 1.20 GB (1286662146) - RowsProduced: 31.65M (31645452) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 255.219ms - TotalThreadsInvoluntaryContextSwitches: 2.81K (2808) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 584.908ms - TotalThreadsUserTime: 14s293ms - TotalThreadsVoluntaryContextSwitches: 49.10K (49096) Fragment Instance Lifecycle Timings: - ExecTime: 11m1s - ExecTreeExecTime: 5s136ms - OpenTime: 65.351ms - ExecTreeOpenTime: 188.301us - PrepareTime: 28.516ms - ExecTreePrepareTime: 1.060ms DataStreamSender (dst_id=22):(Total: 3s419ms, non-child: 3s419ms, % non-child: 100.00%) - BytesSent: 567.86 MB (595443442) - OverallThroughput: 166.05 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.65M (31645452) - SerializeBatchTime: 3s411ms - UncompressedRowBatchSize: 567.86 MB (595443442) CodeGen:(Total: 88.013ms, non-child: 88.013ms, % non-child: 100.00%) - CodegenTime: 1.328ms - CompileTime: 10.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 54.141ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 23.160ms HDFS_SCAN_NODE (id=2):(Total: 5s119ms, non-child: 5s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:12/2.96 GB 2:16/3.79 GB 5:12/2.75 GB 4:12/2.88 GB 7:9/2.17 GB 1:15/3.58 GB 6:12/2.60 GB 0:10/2.09 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:30 BytesRead(16s000ms): 73.05 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 106.26 MB, 114.38 MB - FooterProcessingTime: (Avg: 1.530ms ; Min: 712.918us ; Max: 4.788ms ; Number of samples: 10) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.95 - BytesRead: 207.09 MB (217146921) - BytesReadDataNodeCache: 0 - BytesReadLocal: 207.09 MB (217146921) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 207.09 MB (217146921) - CachedFileHandlesHitCount: 56 (56) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 875.942ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 10 (10) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 121.39 MB (127289109) - PerReadThreadRawHdfsThroughput: 634.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.242ms - RowBatchQueuePutWaitTime: 54m11s - RowsRead: 31.65M (31645452) - RowsReturned: 31.65M (31645452) - RowsReturnedRate: 6.18 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.70K (1702) - ScannerThreadsTotalWallClockTime: 54m30s - MaterializeTupleTime(*): 2s462ms - ScannerThreadsSysTime: 148.975ms - ScannerThreadsUserTime: 5s786ms - ScannerThreadsVoluntaryContextSwitches: 34.01K (34008) - TotalRawHdfsReadTime(*): 326.598ms - TotalReadThroughput: 321.30 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 88 (88) - Files total: 98 (98) - RowGroups processed: 30.91K (30909) - RowGroups rejected: 0 (0) - RowGroups total: 30.91K (30909) - Rows processed: 163.84K (163840) - Rows rejected: 0 (0) - Rows total: 31.65M (31645452) - Splits processed: 10 (10) - Splits rejected: 0 (0) - Splits total: 10 (10) Filter 2 (2.00 MB): - Rows processed: 134.14K (134144) - Rows rejected: 0 (0) - Rows total: 31.65M (31645452) Filter 3 (2.00 MB): - Rows processed: 123.90K (123904) - Rows rejected: 0 (0) - Rows total: 31.65M (31645452) Instance 5f429df048b5534b:41bcce1800000056 (host=foo.234.40:22000):(Total: 11m, non-child: 10m51s, % non-child: 98.69%) Hdfs split stats (:<# splits>/): 0:12/2.68 GB 4:11/2.71 GB 5:15/3.44 GB 1:9/2.18 GB 2:16/3.70 GB 6:9/2.10 GB 3:13/2.91 GB 7:12/2.89 GB Filter 1 arrival: 552ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.96 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 134.99 MB, 135.50 MB, 115.14 MB ThreadUsage(16s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.98 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.28 MB (147089593) - PerHostPeakMemUsage: 1.30 GB (1393390360) - RowsProduced: 31.95M (31946284) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 143.567ms - TotalThreadsInvoluntaryContextSwitches: 2.74K (2741) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 1s187ms - TotalThreadsUserTime: 14s148ms - TotalThreadsVoluntaryContextSwitches: 103.96K (103963) Fragment Instance Lifecycle Timings: - ExecTime: 11m - ExecTreeExecTime: 5s129ms - OpenTime: 62.016ms - ExecTreeOpenTime: 187.494us - PrepareTime: 33.591ms - ExecTreePrepareTime: 1.195ms DataStreamSender (dst_id=22):(Total: 3s429ms, non-child: 3s429ms, % non-child: 100.00%) - BytesSent: 568.14 MB (595739944) - OverallThroughput: 165.66 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 31.95M (31946284) - SerializeBatchTime: 3s421ms - UncompressedRowBatchSize: 568.14 MB (595739944) CodeGen:(Total: 89.401ms, non-child: 89.401ms, % non-child: 100.00%) - CodegenTime: 1.443ms - CompileTime: 9.670ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.230ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 27.992ms HDFS_SCAN_NODE (id=2):(Total: 5s111ms, non-child: 5s111ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:12/2.68 GB 4:11/2.71 GB 5:15/3.44 GB 1:9/2.18 GB 2:16/3.70 GB 6:9/2.10 GB 3:13/2.91 GB 7:12/2.89 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:88 PARQUET/SNAPPY:27 BytesRead(16s000ms): 77.63 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 112.92 MB, 119.63 MB - FooterProcessingTime: (Avg: 1.092ms ; Min: 766.061us ; Max: 2.220ms ; Number of samples: 9) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 208.45 MB (218580456) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.45 MB (218580456) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.45 MB (218580456) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 893.312ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 9 (9) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828400) - PerReadThreadRawHdfsThroughput: 970.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.323ms - RowBatchQueuePutWaitTime: 54m16s - RowsRead: 31.95M (31946284) - RowsReturned: 31.95M (31946284) - RowsReturnedRate: 6.25 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.65K (1651) - ScannerThreadsTotalWallClockTime: 54m46s - MaterializeTupleTime(*): 2s470ms - ScannerThreadsSysTime: 761.882ms - ScannerThreadsUserTime: 5s586ms - ScannerThreadsVoluntaryContextSwitches: 88.88K (88875) - TotalRawHdfsReadTime(*): 214.773ms - TotalReadThroughput: 323.67 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 88 (88) - Files total: 97 (97) - RowGroups processed: 31.20K (31201) - RowGroups rejected: 0 (0) - RowGroups total: 31.20K (31201) - Rows processed: 147.46K (147456) - Rows rejected: 0 (0) - Rows total: 31.95M (31946284) - Splits processed: 9 (9) - Splits rejected: 0 (0) - Splits total: 9 (9) Filter 2 (2.00 MB): - Rows processed: 107.52K (107520) - Rows rejected: 0 (0) - Rows total: 31.95M (31946284) Filter 3 (2.00 MB): - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 31.95M (31946284) Instance 5f429df048b5534b:41bcce180000004d (host=foo.234.47:22000):(Total: 11m, non-child: 10m51s, % non-child: 98.74%) Hdfs split stats (:<# splits>/): 3:10/2.24 GB 6:6/1.48 GB 1:13/2.87 GB 5:13/2.93 GB 7:13/3.20 GB 0:15/3.30 GB 4:11/2.39 GB 2:17/3.80 GB Filter 1 arrival: 423ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 89.05 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.08 MB, 135.35 MB, 119.22 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 139.07 MB (145828469) - PerHostPeakMemUsage: 1.31 GB (1401445567) - RowsProduced: 28.27M (28272913) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 288.807ms - TotalThreadsInvoluntaryContextSwitches: 2.28K (2281) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 509.920ms - TotalThreadsUserTime: 11s419ms - TotalThreadsVoluntaryContextSwitches: 44.38K (44382) Fragment Instance Lifecycle Timings: - ExecTime: 10m59s - ExecTreeExecTime: 5s179ms - OpenTime: 81.195ms - ExecTreeOpenTime: 192.823us - PrepareTime: 28.374ms - ExecTreePrepareTime: 554.256us DataStreamSender (dst_id=22):(Total: 3s081ms, non-child: 3s081ms, % non-child: 100.00%) - BytesSent: 509.43 MB (534178295) - OverallThroughput: 165.34 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.27M (28272913) - SerializeBatchTime: 3s074ms - UncompressedRowBatchSize: 509.43 MB (534178295) CodeGen:(Total: 102.175ms, non-child: 102.175ms, % non-child: 100.00%) - CodegenTime: 1.344ms - CompileTime: 10.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 69.985ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 21.501ms HDFS_SCAN_NODE (id=2):(Total: 5s161ms, non-child: 5s161ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:10/2.24 GB 6:6/1.48 GB 1:13/2.87 GB 5:13/2.93 GB 7:13/3.20 GB 0:15/3.30 GB 4:11/2.39 GB 2:17/3.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s917ms Hdfs Read Thread Concurrency Bucket: 0:99.92% 1:0.07582% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:90 PARQUET/SNAPPY:24 BytesRead(16s000ms): 74.45 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB, 113.28 MB - FooterProcessingTime: (Avg: 1.201ms ; Min: 284.830us ; Max: 2.334ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 185.09 MB (194079381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.09 MB (194079381) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.09 MB (194079381) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 809.919ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 131.40 MB (137780352) - PerReadThreadRawHdfsThroughput: 748.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.919ms - RowBatchQueuePutWaitTime: 54m19s - RowsRead: 28.27M (28272913) - RowsReturned: 28.27M (28272913) - RowsReturnedRate: 5.48 M/sec - ScanRangesComplete: 98 (98) - ScannerThreadsInvoluntaryContextSwitches: 1.22K (1223) - ScannerThreadsTotalWallClockTime: 54m43s - MaterializeTupleTime(*): 2s243ms - ScannerThreadsSysTime: 138.976ms - ScannerThreadsUserTime: 3s624ms - ScannerThreadsVoluntaryContextSwitches: 29.19K (29193) - TotalRawHdfsReadTime(*): 247.441ms - TotalReadThroughput: 287.38 KB/sec Filter 1 (8.00 KB): - Files processed: 98 (98) - Files rejected: 90 (90) - Files total: 98 (98) - RowGroups processed: 27.62K (27616) - RowGroups rejected: 0 (0) - RowGroups total: 27.62K (27616) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.27M (28272913) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 80.90K (80896) - Rows rejected: 0 (0) - Rows total: 28.27M (28272913) Filter 3 (2.00 MB): - Rows processed: 80.90K (80896) - Rows rejected: 0 (0) - Rows total: 28.27M (28272913) Instance 5f429df048b5534b:41bcce1800000052 (host=foo.246.38:22000):(Total: 10m59s, non-child: 10m51s, % non-child: 98.75%) Hdfs split stats (:<# splits>/): 7:8/1.97 GB 0:9/2.09 GB 3:7/1.66 GB 1:12/2.83 GB 2:10/2.42 GB 6:18/4.32 GB 4:16/3.82 GB 5:15/3.63 GB Filter 1 arrival: 324ms Filter 2 arrival: 10m38s Filter 3 arrival: 10m38s MemoryUsage(16s000ms): 92.37 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 133.95 MB, 134.75 MB, 116.71 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.42 MB (147240164) - PerHostPeakMemUsage: 1.31 GB (1401697212) - RowsProduced: 28.10M (28097793) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 204.970ms - TotalThreadsInvoluntaryContextSwitches: 2.34K (2337) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 584.909ms - TotalThreadsUserTime: 11s996ms - TotalThreadsVoluntaryContextSwitches: 43.56K (43557) Fragment Instance Lifecycle Timings: - ExecTime: 10m59s - ExecTreeExecTime: 5s130ms - OpenTime: 63.727ms - ExecTreeOpenTime: 185.631us - PrepareTime: 35.022ms - ExecTreePrepareTime: 751.803us DataStreamSender (dst_id=22):(Total: 3s038ms, non-child: 3s038ms, % non-child: 100.00%) - BytesSent: 503.57 MB (528034176) - OverallThroughput: 165.73 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.10M (28097793) - SerializeBatchTime: 3s031ms - UncompressedRowBatchSize: 503.57 MB (528034176) CodeGen:(Total: 91.505ms, non-child: 91.505ms, % non-child: 100.00%) - CodegenTime: 1.393ms - CompileTime: 9.604ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 53.124ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 28.317ms HDFS_SCAN_NODE (id=2):(Total: 5s113ms, non-child: 5s113ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:8/1.97 GB 0:9/2.09 GB 3:7/1.66 GB 1:12/2.83 GB 2:10/2.42 GB 6:18/4.32 GB 4:16/3.82 GB 5:15/3.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s938ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:87 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.17 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 119.52 MB, 123.58 MB - FooterProcessingTime: (Avg: 1.379ms ; Min: 686.087us ; Max: 2.784ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.98 - BytesRead: 184.46 MB (193418773) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.46 MB (193418773) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.46 MB (193418773) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 816.104ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828819) - PerReadThreadRawHdfsThroughput: 645.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.314ms - RowBatchQueuePutWaitTime: 54m17s - RowsRead: 28.10M (28097793) - RowsReturned: 28.10M (28097793) - RowsReturnedRate: 5.49 M/sec - ScanRangesComplete: 95 (95) - ScannerThreadsInvoluntaryContextSwitches: 1.33K (1327) - ScannerThreadsTotalWallClockTime: 54m41s - MaterializeTupleTime(*): 2s282ms - ScannerThreadsSysTime: 148.975ms - ScannerThreadsUserTime: 4s365ms - ScannerThreadsVoluntaryContextSwitches: 28.56K (28562) - TotalRawHdfsReadTime(*): 285.592ms - TotalReadThroughput: 286.84 KB/sec Filter 1 (8.00 KB): - Files processed: 95 (95) - Files rejected: 87 (87) - Files total: 95 (95) - RowGroups processed: 27.44K (27443) - RowGroups rejected: 0 (0) - RowGroups total: 27.44K (27443) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.10M (28097793) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 28.10M (28097793) Filter 3 (2.00 MB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 28.10M (28097793) Instance 5f429df048b5534b:41bcce1800000042 (host=foo.234.50:22000):(Total: 10m59s, non-child: 10m50s, % non-child: 98.75%) Hdfs split stats (:<# splits>/): 1:7/1.66 GB 7:11/2.32 GB 4:12/2.89 GB 3:17/3.84 GB 6:14/3.03 GB 0:13/3.00 GB 5:17/3.96 GB 2:8/1.90 GB Filter 1 arrival: 432ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 93.28 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.37 MB, 135.96 MB, 113.34 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.96 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.28 MB (147091093) - PerHostPeakMemUsage: 1.28 GB (1371316406) - RowsProduced: 28.18M (28176918) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m45s - TotalStorageWaitTime: 180.729ms - TotalThreadsInvoluntaryContextSwitches: 2.41K (2407) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 540.914ms - TotalThreadsUserTime: 12s198ms - TotalThreadsVoluntaryContextSwitches: 42.95K (42947) Fragment Instance Lifecycle Timings: - ExecTime: 10m59s - ExecTreeExecTime: 5s136ms - OpenTime: 56.931ms - ExecTreeOpenTime: 172.118us - PrepareTime: 24.400ms - ExecTreePrepareTime: 517.773us DataStreamSender (dst_id=22):(Total: 3s025ms, non-child: 3s025ms, % non-child: 100.00%) - BytesSent: 507.66 MB (532323547) - OverallThroughput: 167.77 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 28.18M (28176918) - SerializeBatchTime: 3s018ms - UncompressedRowBatchSize: 507.66 MB (532323547) CodeGen:(Total: 76.035ms, non-child: 76.035ms, % non-child: 100.00%) - CodegenTime: 1.344ms - CompileTime: 8.979ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 46.950ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 19.622ms HDFS_SCAN_NODE (id=2):(Total: 5s116ms, non-child: 5s116ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:7/1.66 GB 7:11/2.32 GB 4:12/2.89 GB 3:17/3.84 GB 6:14/3.03 GB 0:13/3.00 GB 5:17/3.96 GB 2:8/1.90 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s957ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:91 PARQUET/SNAPPY:24 BytesRead(16s000ms): 82.22 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 125.72 MB - FooterProcessingTime: (Avg: 1.250ms ; Min: 315.112us ; Max: 2.883ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 185.02 MB (194011885) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.02 MB (194011885) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.02 MB (194011885) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 800.648ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828886) - PerReadThreadRawHdfsThroughput: 660.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.508ms - RowBatchQueuePutWaitTime: 54m16s - RowsRead: 28.18M (28176918) - RowsReturned: 28.18M (28176918) - RowsReturnedRate: 5.51 M/sec - ScanRangesComplete: 99 (99) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1379) - ScannerThreadsTotalWallClockTime: 54m29s - MaterializeTupleTime(*): 2s255ms - ScannerThreadsSysTime: 128.976ms - ScannerThreadsUserTime: 4s246ms - ScannerThreadsVoluntaryContextSwitches: 27.95K (27953) - TotalRawHdfsReadTime(*): 280.341ms - TotalReadThroughput: 287.72 KB/sec Filter 1 (8.00 KB): - Files processed: 99 (99) - Files rejected: 91 (91) - Files total: 99 (99) - RowGroups processed: 27.52K (27519) - RowGroups rejected: 0 (0) - RowGroups total: 27.52K (27519) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 28.18M (28176918) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Filter 2 (2.00 MB): - Rows processed: 94.21K (94208) - Rows rejected: 0 (0) - Rows total: 28.18M (28176918) Filter 3 (2.00 MB): - Rows processed: 94.21K (94208) - Rows rejected: 0 (0) - Rows total: 28.18M (28176918) Instance 5f429df048b5534b:41bcce1800000043 (host=foo.234.44:22000):(Total: 10m57s, non-child: 10m50s, % non-child: 98.87%) Hdfs split stats (:<# splits>/): 1:13/2.87 GB 2:13/3.10 GB 5:9/2.07 GB 7:13/2.99 GB 3:13/3.14 GB 6:15/3.39 GB 0:7/1.73 GB 4:14/3.18 GB Filter 1 arrival: 243ms Filter 2 arrival: 10m37s Filter 3 arrival: 10m37s MemoryUsage(16s000ms): 92.89 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 134.76 MB, 135.63 MB, 112.64 MB ThreadUsage(16s000ms): 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.97 - BloomFilterBytes: 4.01 MB (4202496) - PeakMemoryUsage: 140.37 MB (147192738) - PerHostPeakMemUsage: 1.21 GB (1304546732) - RowsProduced: 21.93M (21927269) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m46s - TotalStorageWaitTime: 104.826ms - TotalThreadsInvoluntaryContextSwitches: 1.95K (1953) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 771.880ms - TotalThreadsUserTime: 11s179ms - TotalThreadsVoluntaryContextSwitches: 52.03K (52035) Fragment Instance Lifecycle Timings: - ExecTime: 10m57s - ExecTreeExecTime: 5s070ms - OpenTime: 61.727ms - ExecTreeOpenTime: 214.830us - PrepareTime: 25.685ms - ExecTreePrepareTime: 750.783us DataStreamSender (dst_id=22):(Total: 2s304ms, non-child: 2s304ms, % non-child: 100.00%) - BytesSent: 391.23 MB (410237494) - OverallThroughput: 169.77 MB/sec - PeakMemoryUsage: 4.17 MB (4374648) - RowsReturned: 21.93M (21927269) - SerializeBatchTime: 2s299ms - UncompressedRowBatchSize: 391.23 MB (410237494) CodeGen:(Total: 81.527ms, non-child: 81.527ms, % non-child: 100.00%) - CodegenTime: 1.364ms - CompileTime: 9.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 35 (35) - NumInstructions: 608 (608) - OptimizationTime: 51.162ms - PeakMemoryUsage: 304.00 KB (311296) - PrepareTime: 20.056ms HDFS_SCAN_NODE (id=2):(Total: 5s059ms, non-child: 5s059ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/2.87 GB 2:13/3.10 GB 5:9/2.07 GB 7:13/2.99 GB 3:13/3.14 GB 6:15/3.39 GB 0:7/1.73 GB 4:14/3.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [1], missing [2, 3]), waited for 4s937ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:91 PARQUET/SNAPPY:18 BytesRead(16s000ms): 82.22 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 119.59 MB, 121.09 MB - FooterProcessingTime: (Avg: 1.087ms ; Min: 627.341us ; Max: 2.661ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.97 - BytesRead: 143.49 MB (150460310) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.49 MB (150460310) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.49 MB (150460310) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 632.923ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.40 MB (138828812) - PerReadThreadRawHdfsThroughput: 901.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.268ms - RowBatchQueuePutWaitTime: 54m10s - RowsRead: 21.93M (21927269) - RowsReturned: 21.93M (21927269) - RowsReturnedRate: 4.33 M/sec - ScanRangesComplete: 97 (97) - ScannerThreadsInvoluntaryContextSwitches: 1.17K (1165) - ScannerThreadsTotalWallClockTime: 54m26s - MaterializeTupleTime(*): 1s767ms - ScannerThreadsSysTime: 458.928ms - ScannerThreadsUserTime: 5s291ms - ScannerThreadsVoluntaryContextSwitches: 37.68K (37677) - TotalRawHdfsReadTime(*): 159.211ms - TotalReadThroughput: 223.81 KB/sec Filter 1 (8.00 KB): - Files processed: 97 (97) - Files rejected: 91 (91) - Files total: 97 (97) - RowGroups processed: 21.41K (21415) - RowGroups rejected: 0 (0) - RowGroups total: 21.41K (21415) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 21.93M (21927269) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Filter 2 (2.00 MB): - Rows processed: 59.39K (59392) - Rows rejected: 0 (0) - Rows total: 21.93M (21927269) Filter 3 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 21.93M (21927269) Averaged Fragment F05:(Total: 10m35s, non-child: 4s937ms, % non-child: 0.78%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:10m32s max:10m38s mean: 10m35s stddev:1s139ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 129 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291646) - PeakMemoryUsage: 546.40 MB (572938570) - PerHostPeakMemUsage: 1.32 GB (1415052875) - RowsProduced: 1.43M (1432883) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 566.381ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.94K (7938) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s319ms - TotalThreadsUserTime: 21s374ms - TotalThreadsVoluntaryContextSwitches: 122.47K (122470) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.349ms - ExecTreePrepareTime: 499.146us DataStreamSender (dst_id=23):(Total: 3s646ms, non-child: 3s646ms, % non-child: 100.00%) - BytesSent: 253.56 MB (265872011) - OverallThroughput: 69.54 MB/sec - PeakMemoryUsage: 6.29 MB (6591705) - RowsReturned: 1.43M (1432883) - SerializeBatchTime: 3s641ms - UncompressedRowBatchSize: 253.56 MB (265872011) CodeGen:(Total: 464.636ms, non-child: 464.636ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.280ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.022ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 295.773ms, % non-child: 0.05%) - BuildRows: 274 (274) - BuildTime: 683.102us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.31 MB (4522348) - ProbeRows: 1.43M (1432883) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.483ms - RowsReturned: 1.43M (1432883) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): - BuildRowsPartitionTime: 42.806us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 386.545us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 96.261us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 640.449ms, non-child: 640.449ms, % non-child: 100.00%) - ConvertRowBatchTime: 8.601us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 4.54 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 21.444ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 640.433ms - DataArrivalTimer: 640.430ms SenderSide: - DeserializeRowBatchTimer: 97.078us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s574ms, % non-child: 1.37%) - BuildRows: 9.50M (9501356) - BuildTime: 5s012ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660770) - ProbeRows: 19.57M (19573548) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s094ms - RowsReturned: 1.43M (1432883) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 4s342ms - BuildRowsPartitioned: 9.50M (9501356) - GetNewBlockTime: 1.901ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.06K (50063) - HashTablesBuildTime: 656.125ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 1m25s, % non-child: 100.00%) - ConvertRowBatchTime: 271.487ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501356) - RowsReturnedRate: 111.51 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 750.984ms - TotalBytesReceived: 224.23 MB (235124469) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s659ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 9m8s, % non-child: 100.00%) - ConvertRowBatchTime: 727.986ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573548) - RowsReturnedRate: 35.70 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 19s049ms - TotalBytesReceived: 2.66 GB (2854743198) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s553ms - NumBatchesAccepted: 113.86K (113863) - NumBatchesRejected: 97 (97) Fragment F05: Instance 5f429df048b5534b:41bcce1800000203 (host=foo.221.47:22000):(Total: 10m38s, non-child: 7s817ms, % non-child: 1.22%) MemoryUsage(16s000ms): 123.93 MB, 284.38 MB, 289.39 MB, 289.39 MB, 289.39 MB, 360.76 MB, 536.78 MB, 536.93 MB, 536.85 MB, 536.93 MB, 536.57 MB, 536.64 MB, 536.67 MB, 536.66 MB, 536.95 MB, 537.09 MB, 536.45 MB, 536.28 MB, 537.12 MB, 536.72 MB, 536.45 MB, 536.61 MB, 536.71 MB, 536.67 MB, 536.93 MB, 536.71 MB, 536.58 MB, 536.74 MB, 536.58 MB, 536.69 MB, 536.60 MB, 537.05 MB, 536.15 MB, 536.87 MB, 537.00 MB, 536.85 MB, 537.28 MB, 536.83 MB, 536.68 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.01 MB (6299648) - PeakMemoryUsage: 546.29 MB (572829171) - PerHostPeakMemUsage: 1.42 GB (1520540796) - RowsProduced: 1.43M (1432406) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 2s544ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.60K (7600) - TotalThreadsTotalWallClockTime: 12m10s - TotalThreadsSysTime: 2s297ms - TotalThreadsUserTime: 21s595ms - TotalThreadsVoluntaryContextSwitches: 122.57K (122567) Fragment Instance Lifecycle Timings: - ExecTime: 9m6s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 34.105ms - ExecTreePrepareTime: 199.927us DataStreamSender (dst_id=23):(Total: 3s663ms, non-child: 3s663ms, % non-child: 100.00%) - BytesSent: 253.50 MB (265809259) - OverallThroughput: 69.20 MB/sec - PeakMemoryUsage: 6.30 MB (6603136) - RowsReturned: 1.43M (1432406) - SerializeBatchTime: 3s658ms - UncompressedRowBatchSize: 253.50 MB (265809259) CodeGen:(Total: 475.669ms, non-child: 475.669ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 132.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 316.870ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.089ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 300.640ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 418.288us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490518) - ProbeRows: 1.43M (1432406) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.481ms - RowsReturned: 1.43M (1432406) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 58.437us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 171.240us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.513us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 902.868ms, non-child: 16.389us, % non-child: 0.00%) - ConvertRowBatchTime: 7.618us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 303.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 902.855ms - DataArrivalTimer: 902.853ms SenderSide: - DeserializeRowBatchTimer: 38.281us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s710ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502204) - BuildTime: 5s088ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660356) - ProbeRows: 19.58M (19576426) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s217ms - RowsReturned: 1.43M (1432406) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s423ms - BuildRowsPartitioned: 9.50M (9502204) - GetNewBlockTime: 2.388ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.03K (50033) - HashTablesBuildTime: 650.335ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 395.690ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.905ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502204) - RowsReturnedRate: 110.31 K/sec RecvrSide: BytesReceived(16s000ms): 58.12 MB, 166.06 MB, 208.63 MB, 219.42 MB, 223.06 MB, 224.14 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB - FirstBatchArrivalWaitTime: 1s035ms - TotalBytesReceived: 224.26 MB (235149103) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s773ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s392ms, % non-child: 0.25%) - ConvertRowBatchTime: 733.494ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576426) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.99 MB, 10.01 MB, 10.01 MB, 10.01 MB, 20.36 MB, 233.84 MB, 597.24 MB, 1017.56 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s374ms - TotalBytesReceived: 2.66 GB (2855260169) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s617ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce18000001d5 (host=foo.232.15:22000):(Total: 10m37s, non-child: 7s073ms, % non-child: 1.11%) MemoryUsage(16s000ms): 131.82 MB, 284.69 MB, 289.37 MB, 289.37 MB, 289.37 MB, 379.33 MB, 536.88 MB, 536.98 MB, 537.19 MB, 536.82 MB, 536.91 MB, 536.72 MB, 536.68 MB, 536.73 MB, 536.59 MB, 536.59 MB, 536.54 MB, 536.49 MB, 536.47 MB, 536.81 MB, 536.82 MB, 536.80 MB, 536.80 MB, 536.77 MB, 536.64 MB, 536.58 MB, 536.58 MB, 536.89 MB, 536.66 MB, 536.77 MB, 536.70 MB, 536.79 MB, 536.67 MB, 536.61 MB, 536.75 MB, 536.67 MB, 536.87 MB, 536.50 MB, 537.32 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.14 MB (572671759) - PerHostPeakMemUsage: 1.42 GB (1529109992) - RowsProduced: 1.43M (1434125) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 2s577ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.63K (7626) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s341ms - TotalThreadsUserTime: 21s565ms - TotalThreadsVoluntaryContextSwitches: 122.49K (122488) Fragment Instance Lifecycle Timings: - ExecTime: 9m6s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 35.697ms - ExecTreePrepareTime: 781.293us DataStreamSender (dst_id=23):(Total: 3s678ms, non-child: 3s678ms, % non-child: 100.00%) - BytesSent: 253.85 MB (266182844) - OverallThroughput: 69.01 MB/sec - PeakMemoryUsage: 6.05 MB (6340992) - RowsReturned: 1.43M (1434125) - SerializeBatchTime: 3s674ms - UncompressedRowBatchSize: 253.85 MB (266182844) CodeGen:(Total: 454.770ms, non-child: 454.770ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.828ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.258ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.989ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 309.130ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 521.159us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4484710) - ProbeRows: 1.43M (1434125) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.822ms - RowsReturned: 1.43M (1434125) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60.704us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 199.115us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.903us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 733.454ms, non-child: 14.912us, % non-child: 0.00%) - ConvertRowBatchTime: 7.331us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 373.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 733.442ms - DataArrivalTimer: 733.440ms SenderSide: - DeserializeRowBatchTimer: 279.367us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s631ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498045) - BuildTime: 5s152ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662957) - ProbeRows: 19.58M (19577485) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s199ms - RowsReturned: 1.43M (1434125) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s530ms - BuildRowsPartitioned: 9.50M (9498045) - GetNewBlockTime: 1.819ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.84K (49842) - HashTablesBuildTime: 605.770ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 392.482ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.154ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498045) - RowsReturnedRate: 111.79 K/sec RecvrSide: BytesReceived(16s000ms): 60.53 MB, 167.46 MB, 208.95 MB, 219.43 MB, 222.99 MB, 224.04 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 869.653ms - TotalBytesReceived: 224.15 MB (235035747) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s995ms - NumBatchesAccepted: 16.90K (16904) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s401ms, % non-child: 0.26%) - ConvertRowBatchTime: 728.949ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577485) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.18 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.31 MB, 240.63 MB, 605.22 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s209ms - TotalBytesReceived: 2.66 GB (2855177748) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 17s233ms - NumBatchesAccepted: 113.89K (113887) - NumBatchesRejected: 99 (99) Instance 5f429df048b5534b:41bcce1800000213 (host=foo.221.44:22000):(Total: 10m37s, non-child: 6s889ms, % non-child: 1.08%) MemoryUsage(16s000ms): 123.43 MB, 284.23 MB, 289.38 MB, 289.38 MB, 289.38 MB, 357.29 MB, 536.94 MB, 536.70 MB, 537.06 MB, 536.89 MB, 536.70 MB, 536.89 MB, 536.98 MB, 536.55 MB, 536.96 MB, 536.56 MB, 536.93 MB, 537.34 MB, 537.05 MB, 536.80 MB, 536.73 MB, 536.74 MB, 536.58 MB, 536.83 MB, 536.61 MB, 536.76 MB, 536.74 MB, 536.59 MB, 536.77 MB, 536.53 MB, 536.88 MB, 536.59 MB, 536.69 MB, 536.80 MB, 536.53 MB, 536.83 MB, 536.69 MB, 536.26 MB, 537.12 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.18 MB (572710514) - PerHostPeakMemUsage: 1.39 GB (1493934538) - RowsProduced: 1.43M (1432167) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 2s357ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.72K (7722) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s405ms - TotalThreadsUserTime: 21s385ms - TotalThreadsVoluntaryContextSwitches: 122.79K (122793) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 30.955ms - ExecTreePrepareTime: 286.000us DataStreamSender (dst_id=23):(Total: 3s700ms, non-child: 3s700ms, % non-child: 100.00%) - BytesSent: 253.44 MB (265751807) - OverallThroughput: 68.49 MB/sec - PeakMemoryUsage: 6.26 MB (6562176) - RowsReturned: 1.43M (1432167) - SerializeBatchTime: 3s695ms - UncompressedRowBatchSize: 253.44 MB (265751807) CodeGen:(Total: 431.935ms, non-child: 431.935ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 135.551ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 273.381ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.441ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 298.954ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 646.962us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4658665) - ProbeRows: 1.43M (1432167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.154ms - RowsReturned: 1.43M (1432167) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.388us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 341.473us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.648us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 977.378ms, non-child: 18.631us, % non-child: 0.00%) - ConvertRowBatchTime: 7.941us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 280.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 977.364ms - DataArrivalTimer: 977.361ms SenderSide: - DeserializeRowBatchTimer: 60.654us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s513ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498094) - BuildTime: 5s036ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662205) - ProbeRows: 19.57M (19571284) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s092ms - RowsReturned: 1.43M (1432167) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s363ms - BuildRowsPartitioned: 9.50M (9498094) - GetNewBlockTime: 1.581ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.85K (49853) - HashTablesBuildTime: 659.037ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 391.527ms, % non-child: 0.45%) - ConvertRowBatchTime: 276.383ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498094) - RowsReturnedRate: 110.07 K/sec RecvrSide: BytesReceived(16s000ms): 57.14 MB, 165.40 MB, 208.36 MB, 219.27 MB, 222.93 MB, 224.03 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 1s102ms - TotalBytesReceived: 224.15 MB (235033302) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s535ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s408ms, % non-child: 0.26%) - ConvertRowBatchTime: 737.788ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571284) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.90 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.74 MB, 231.18 MB, 594.09 MB, 1014.30 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s443ms - TotalBytesReceived: 2.66 GB (2854485584) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s681ms - NumBatchesAccepted: 113.85K (113852) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce18000001fd (host=foo.221.37:22000):(Total: 10m37s, non-child: 7s253ms, % non-child: 1.14%) MemoryUsage(16s000ms): 123.42 MB, 284.25 MB, 289.37 MB, 289.37 MB, 289.37 MB, 358.43 MB, 537.94 MB, 536.86 MB, 536.92 MB, 536.98 MB, 536.81 MB, 536.63 MB, 536.71 MB, 536.73 MB, 536.65 MB, 536.75 MB, 536.70 MB, 536.07 MB, 536.84 MB, 536.66 MB, 536.75 MB, 536.92 MB, 536.84 MB, 536.81 MB, 536.67 MB, 536.69 MB, 536.46 MB, 536.91 MB, 536.73 MB, 536.65 MB, 536.59 MB, 536.57 MB, 536.49 MB, 536.72 MB, 536.68 MB, 536.48 MB, 536.65 MB, 536.74 MB, 536.47 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 553.78 MB (580684307) - PerHostPeakMemUsage: 1.23 GB (1323240864) - RowsProduced: 1.43M (1433904) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 2s681ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.72K (7719) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s142ms - TotalThreadsUserTime: 20s831ms - TotalThreadsVoluntaryContextSwitches: 122.62K (122619) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m54s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.139ms - ExecTreePrepareTime: 360.119us DataStreamSender (dst_id=23):(Total: 3s603ms, non-child: 3s603ms, % non-child: 100.00%) - BytesSent: 253.63 MB (265949546) - OverallThroughput: 70.38 MB/sec - PeakMemoryUsage: 6.59 MB (6914432) - RowsReturned: 1.43M (1433904) - SerializeBatchTime: 3s599ms - UncompressedRowBatchSize: 253.63 MB (265949546) CodeGen:(Total: 473.179ms, non-child: 473.179ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 144.953ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 300.534ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.163ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 278.634ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 701.259us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491789) - ProbeRows: 1.43M (1433904) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.285ms - RowsReturned: 1.43M (1433904) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.002us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 359.560us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.043us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 926.315ms, non-child: 18.539us, % non-child: 0.00%) - ConvertRowBatchTime: 7.647us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 295.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 926.299ms - DataArrivalTimer: 926.297ms SenderSide: - DeserializeRowBatchTimer: 64.772us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s157ms, % non-child: 1.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504105) - BuildTime: 5s045ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660107) - ProbeRows: 19.58M (19576651) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s651ms - RowsReturned: 1.43M (1433904) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s375ms - BuildRowsPartitioned: 9.50M (9504105) - GetNewBlockTime: 1.182ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.34K (50341) - HashTablesBuildTime: 658.442ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 394.424ms, % non-child: 0.46%) - ConvertRowBatchTime: 279.399ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504105) - RowsReturnedRate: 110.18 K/sec RecvrSide: BytesReceived(16s000ms): 57.38 MB, 165.60 MB, 208.53 MB, 219.42 MB, 223.07 MB, 224.17 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 1s102ms - TotalBytesReceived: 224.29 MB (235181165) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s736ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s367ms, % non-child: 0.25%) - ConvertRowBatchTime: 700.769ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576651) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.92 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.90 MB, 231.94 MB, 595.06 MB, 1015.30 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s454ms - TotalBytesReceived: 2.66 GB (2855203394) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 15s603ms - NumBatchesAccepted: 113.88K (113883) - NumBatchesRejected: 217 (217) Instance 5f429df048b5534b:41bcce18000001aa (host=foo.221.52:22000):(Total: 10m37s, non-child: 7s146ms, % non-child: 1.12%) MemoryUsage(16s000ms): 131.35 MB, 284.49 MB, 289.39 MB, 289.39 MB, 289.39 MB, 378.87 MB, 536.65 MB, 536.97 MB, 537.19 MB, 536.77 MB, 536.59 MB, 536.79 MB, 536.68 MB, 536.57 MB, 536.83 MB, 536.97 MB, 536.50 MB, 536.40 MB, 536.58 MB, 536.62 MB, 536.62 MB, 536.59 MB, 536.86 MB, 536.62 MB, 536.73 MB, 536.82 MB, 536.67 MB, 536.58 MB, 536.75 MB, 536.93 MB, 536.62 MB, 536.65 MB, 536.81 MB, 536.45 MB, 536.48 MB, 536.66 MB, 536.43 MB, 536.68 MB, 536.83 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.44 MB (572986023) - PerHostPeakMemUsage: 1.40 GB (1498813388) - RowsProduced: 1.43M (1431403) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 1s947ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.11K (8111) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s326ms - TotalThreadsUserTime: 21s503ms - TotalThreadsVoluntaryContextSwitches: 122.49K (122487) Fragment Instance Lifecycle Timings: - ExecTime: 9m6s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 32.813ms - ExecTreePrepareTime: 458.352us DataStreamSender (dst_id=23):(Total: 3s638ms, non-child: 3s638ms, % non-child: 100.00%) - BytesSent: 253.33 MB (265640345) - OverallThroughput: 69.62 MB/sec - PeakMemoryUsage: 6.52 MB (6832512) - RowsReturned: 1.43M (1431403) - SerializeBatchTime: 3s635ms - UncompressedRowBatchSize: 253.33 MB (265640345) CodeGen:(Total: 436.368ms, non-child: 436.368ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 137.180ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 275.013ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.588ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 285.774ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 672.028us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490010) - ProbeRows: 1.43M (1431403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 273.745ms - RowsReturned: 1.43M (1431403) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.136us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 464.755us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.946us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 891.061ms, non-child: 19.128us, % non-child: 0.00%) - ConvertRowBatchTime: 8.038us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 307.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 891.046ms - DataArrivalTimer: 891.042ms SenderSide: - DeserializeRowBatchTimer: 55.986us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s576ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502087) - BuildTime: 5s059ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661517) - ProbeRows: 19.58M (19575167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s087ms - RowsReturned: 1.43M (1431403) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s368ms - BuildRowsPartitioned: 9.50M (9502087) - GetNewBlockTime: 1.898ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.84K (49836) - HashTablesBuildTime: 675.367ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 383.735ms, % non-child: 0.45%) - ConvertRowBatchTime: 272.007ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502087) - RowsReturnedRate: 111.73 K/sec RecvrSide: BytesReceived(16s000ms): 59.11 MB, 166.75 MB, 208.80 MB, 219.48 MB, 223.08 MB, 224.14 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 1s008ms - TotalBytesReceived: 224.25 MB (235147348) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s657ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s427ms, % non-child: 0.26%) - ConvertRowBatchTime: 734.819ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575167) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.06 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.22 MB, 236.37 MB, 600.01 MB, 1021.08 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s342ms - TotalBytesReceived: 2.66 GB (2854795116) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s385ms - NumBatchesAccepted: 113.87K (113871) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce180000020d (host=foo.221.17:22000):(Total: 10m37s, non-child: 6s221ms, % non-child: 0.98%) MemoryUsage(16s000ms): 123.38 MB, 284.33 MB, 289.36 MB, 289.37 MB, 289.37 MB, 359.18 MB, 536.87 MB, 536.97 MB, 536.88 MB, 536.75 MB, 536.89 MB, 536.88 MB, 536.71 MB, 536.66 MB, 536.64 MB, 536.87 MB, 536.45 MB, 536.45 MB, 536.87 MB, 536.64 MB, 536.37 MB, 536.45 MB, 536.74 MB, 536.81 MB, 536.75 MB, 536.63 MB, 536.85 MB, 536.62 MB, 536.63 MB, 536.68 MB, 536.78 MB, 536.32 MB, 536.71 MB, 536.62 MB, 536.54 MB, 536.49 MB, 536.62 MB, 537.32 MB, 536.14 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.30 MB (572835037) - PerHostPeakMemUsage: 1.43 GB (1532785948) - RowsProduced: 1.43M (1433662) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 1s940ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.74K (7735) - TotalThreadsTotalWallClockTime: 12m10s - TotalThreadsSysTime: 2s287ms - TotalThreadsUserTime: 21s161ms - TotalThreadsVoluntaryContextSwitches: 122.79K (122794) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 44.265ms - ExecTreePrepareTime: 322.597us DataStreamSender (dst_id=23):(Total: 3s616ms, non-child: 3s616ms, % non-child: 100.00%) - BytesSent: 253.71 MB (266034228) - OverallThroughput: 70.16 MB/sec - PeakMemoryUsage: 6.42 MB (6734208) - RowsReturned: 1.43M (1433662) - SerializeBatchTime: 3s612ms - UncompressedRowBatchSize: 253.71 MB (266034228) CodeGen:(Total: 454.752ms, non-child: 454.752ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 134.438ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 286.055ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.441ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 301.798ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 608.030us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4483554) - ProbeRows: 1.43M (1433662) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 289.456ms - RowsReturned: 1.43M (1433662) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.202us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 376.958us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.431us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s204ms, non-child: 17.924us, % non-child: 0.00%) - ConvertRowBatchTime: 8.162us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 227.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s204ms - DataArrivalTimer: 1s204ms SenderSide: - DeserializeRowBatchTimer: 175.423us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s646ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499913) - BuildTime: 5s093ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661189) - ProbeRows: 19.57M (19572803) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s053ms - RowsReturned: 1.43M (1433662) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s390ms - BuildRowsPartitioned: 9.50M (9499913) - GetNewBlockTime: 1.629ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.08K (50079) - HashTablesBuildTime: 687.424ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 383.870ms, % non-child: 0.44%) - ConvertRowBatchTime: 270.996ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499913) - RowsReturnedRate: 109.85 K/sec RecvrSide: BytesReceived(16s000ms): 57.74 MB, 165.84 MB, 208.53 MB, 219.36 MB, 222.99 MB, 224.08 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB - FirstBatchArrivalWaitTime: 1s320ms - TotalBytesReceived: 224.19 MB (235081553) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s552ms - NumBatchesAccepted: 16.90K (16902) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s348ms, % non-child: 0.25%) - ConvertRowBatchTime: 714.503ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572803) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.96 MB, 10.00 MB, 10.00 MB, 10.00 MB, 20.13 MB, 232.95 MB, 596.15 MB, 1016.69 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s671ms - TotalBytesReceived: 2.66 GB (2854741443) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s179ms - NumBatchesAccepted: 113.86K (113857) - NumBatchesRejected: 108 (108) Instance 5f429df048b5534b:41bcce18000001ed (host=foo.221.18:22000):(Total: 10m37s, non-child: 6s370ms, % non-child: 1.00%) MemoryUsage(16s000ms): 123.35 MB, 284.25 MB, 289.37 MB, 289.37 MB, 289.37 MB, 359.25 MB, 536.71 MB, 536.99 MB, 536.59 MB, 536.67 MB, 537.02 MB, 536.63 MB, 536.88 MB, 536.98 MB, 536.59 MB, 537.04 MB, 536.97 MB, 536.81 MB, 536.90 MB, 536.82 MB, 536.52 MB, 536.59 MB, 536.84 MB, 536.61 MB, 536.83 MB, 536.72 MB, 536.83 MB, 536.84 MB, 536.91 MB, 536.54 MB, 536.82 MB, 536.69 MB, 536.70 MB, 536.62 MB, 536.63 MB, 536.49 MB, 536.74 MB, 536.91 MB, 535.85 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.20 MB (572735446) - PerHostPeakMemUsage: 1.48 GB (1585855039) - RowsProduced: 1.43M (1431720) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 1s759ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.99K (7986) - TotalThreadsTotalWallClockTime: 12m10s - TotalThreadsSysTime: 2s308ms - TotalThreadsUserTime: 21s119ms - TotalThreadsVoluntaryContextSwitches: 123.01K (123012) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 45.225ms - ExecTreePrepareTime: 507.223us DataStreamSender (dst_id=23):(Total: 3s571ms, non-child: 3s571ms, % non-child: 100.00%) - BytesSent: 253.39 MB (265701616) - OverallThroughput: 70.96 MB/sec - PeakMemoryUsage: 6.32 MB (6627712) - RowsReturned: 1.43M (1431720) - SerializeBatchTime: 3s566ms - UncompressedRowBatchSize: 253.39 MB (265701616) CodeGen:(Total: 538.916ms, non-child: 538.916ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 180.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 323.607ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 34.390ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 290.462ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.662ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.48 MB (4700920) - ProbeRows: 1.43M (1431720) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.371ms - RowsReturned: 1.43M (1431720) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.584us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.366ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.180us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s135ms, non-child: 18.082us, % non-child: 0.00%) - ConvertRowBatchTime: 8.967us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 241.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s135ms - DataArrivalTimer: 1s135ms SenderSide: - DeserializeRowBatchTimer: 53.406us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s376ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498176) - BuildTime: 4s917ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664578) - ProbeRows: 19.57M (19571763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s977ms - RowsReturned: 1.43M (1431720) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s230ms - BuildRowsPartitioned: 9.50M (9498176) - GetNewBlockTime: 2.606ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.89K (49893) - HashTablesBuildTime: 672.828ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 388.249ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.050ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498176) - RowsReturnedRate: 109.77 K/sec RecvrSide: BytesReceived(16s000ms): 57.28 MB, 165.50 MB, 208.42 MB, 219.29 MB, 222.94 MB, 224.04 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 1s257ms - TotalBytesReceived: 224.16 MB (235046645) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s674ms - NumBatchesAccepted: 16.91K (16905) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s352ms, % non-child: 0.25%) - ConvertRowBatchTime: 708.090ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571763) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.91 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.88 MB, 231.65 MB, 594.54 MB, 1014.98 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s602ms - TotalBytesReceived: 2.66 GB (2854695279) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s212ms - NumBatchesAccepted: 113.85K (113854) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001ea (host=foo.221.12:22000):(Total: 10m37s, non-child: 5s983ms, % non-child: 0.94%) MemoryUsage(16s000ms): 122.88 MB, 283.96 MB, 289.39 MB, 289.39 MB, 289.40 MB, 354.81 MB, 536.85 MB, 537.08 MB, 536.93 MB, 537.08 MB, 536.96 MB, 536.75 MB, 536.89 MB, 536.79 MB, 536.65 MB, 536.82 MB, 536.93 MB, 537.12 MB, 536.86 MB, 536.82 MB, 536.90 MB, 536.74 MB, 536.57 MB, 536.63 MB, 536.58 MB, 536.59 MB, 536.79 MB, 536.60 MB, 536.93 MB, 536.59 MB, 536.77 MB, 536.56 MB, 536.53 MB, 536.51 MB, 536.85 MB, 536.51 MB, 536.33 MB, 536.55 MB, 537.37 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.39 MB (572933826) - PerHostPeakMemUsage: 1.39 GB (1490657978) - RowsProduced: 1.43M (1434049) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 1s491ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.79K (7794) - TotalThreadsTotalWallClockTime: 12m10s - TotalThreadsSysTime: 2s333ms - TotalThreadsUserTime: 21s243ms - TotalThreadsVoluntaryContextSwitches: 122.35K (122348) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 32.679ms - ExecTreePrepareTime: 380.541us DataStreamSender (dst_id=23):(Total: 3s664ms, non-child: 3s664ms, % non-child: 100.00%) - BytesSent: 253.80 MB (266124565) - OverallThroughput: 69.25 MB/sec - PeakMemoryUsage: 6.47 MB (6783360) - RowsReturned: 1.43M (1434049) - SerializeBatchTime: 3s660ms - UncompressedRowBatchSize: 253.80 MB (266124565) CodeGen:(Total: 423.758ms, non-child: 423.758ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.918ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 258.644ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.609ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 298.254ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 490.617us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489096) - ProbeRows: 1.43M (1434049) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 285.209ms - RowsReturned: 1.43M (1434049) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.529us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 145.624us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.439us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s502ms, non-child: 27.013us, % non-child: 0.00%) - ConvertRowBatchTime: 13.007us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 182.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 86.188ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s502ms - DataArrivalTimer: 1s502ms SenderSide: - DeserializeRowBatchTimer: 48.380us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s582ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503836) - BuildTime: 4s884ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546656660) - ProbeRows: 19.57M (19567231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s121ms - RowsReturned: 1.43M (1434049) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s173ms - BuildRowsPartitioned: 9.50M (9503836) - GetNewBlockTime: 1.199ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.23K (50229) - HashTablesBuildTime: 698.151ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 384.887ms, % non-child: 0.44%) - ConvertRowBatchTime: 271.668ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503836) - RowsReturnedRate: 109.31 K/sec RecvrSide: BytesReceived(16s000ms): 55.28 MB, 164.29 MB, 208.22 MB, 219.34 MB, 223.05 MB, 224.17 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 1s610ms - TotalBytesReceived: 224.29 MB (235187958) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s605ms - NumBatchesAccepted: 16.92K (16923) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s411ms, % non-child: 0.26%) - ConvertRowBatchTime: 743.729ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19567231) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.74 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.59 MB, 225.97 MB, 587.91 MB, 1007.39 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s962ms - TotalBytesReceived: 2.66 GB (2854047951) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s401ms - NumBatchesAccepted: 113.83K (113828) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce180000020a (host=foo.232.32:22000):(Total: 10m37s, non-child: 6s733ms, % non-child: 1.06%) MemoryUsage(16s000ms): 137.65 MB, 284.88 MB, 289.36 MB, 289.36 MB, 289.36 MB, 368.57 MB, 537.00 MB, 536.79 MB, 536.78 MB, 536.99 MB, 537.12 MB, 536.83 MB, 536.91 MB, 536.91 MB, 537.15 MB, 536.68 MB, 536.70 MB, 537.01 MB, 536.82 MB, 536.64 MB, 536.92 MB, 536.61 MB, 536.82 MB, 536.91 MB, 536.69 MB, 536.73 MB, 536.70 MB, 536.77 MB, 536.77 MB, 536.90 MB, 536.53 MB, 536.84 MB, 536.66 MB, 536.44 MB, 536.49 MB, 537.16 MB, 536.71 MB, 536.34 MB, 536.69 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572788113) - PerHostPeakMemUsage: 1.42 GB (1522909179) - RowsProduced: 1.43M (1432316) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 2s050ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.61K (7611) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s286ms - TotalThreadsUserTime: 20s852ms - TotalThreadsVoluntaryContextSwitches: 121.88K (121881) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 36.881ms - ExecTreePrepareTime: 515.062us DataStreamSender (dst_id=23):(Total: 3s631ms, non-child: 3s631ms, % non-child: 100.00%) - BytesSent: 253.43 MB (265738717) - OverallThroughput: 69.79 MB/sec - PeakMemoryUsage: 5.86 MB (6144384) - RowsReturned: 1.43M (1432316) - SerializeBatchTime: 3s626ms - UncompressedRowBatchSize: 253.43 MB (265738717) CodeGen:(Total: 433.152ms, non-child: 433.152ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 132.942ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 273.611ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.995ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 280.405ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 729.576us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4659693) - ProbeRows: 1.43M (1432316) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 268.604ms - RowsReturned: 1.43M (1432316) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.981us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 475.241us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.803us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 433.715ms, non-child: 28.812us, % non-child: 0.01%) - ConvertRowBatchTime: 7.762us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 631.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 433.690ms - DataArrivalTimer: 433.687ms SenderSide: - DeserializeRowBatchTimer: 107.375us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s319ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498535) - BuildTime: 5s010ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661743) - ProbeRows: 19.57M (19572955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s844ms - RowsReturned: 1.43M (1432316) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s295ms - BuildRowsPartitioned: 9.50M (9498535) - GetNewBlockTime: 4.642ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.96K (49960) - HashTablesBuildTime: 700.747ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 387.712ms, % non-child: 0.45%) - ConvertRowBatchTime: 272.259ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498535) - RowsReturnedRate: 110.69 K/sec RecvrSide: BytesReceived(16s000ms): 62.16 MB, 168.46 MB, 209.21 MB, 219.50 MB, 223.04 MB, 224.06 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 567.165ms - TotalBytesReceived: 224.17 MB (235056217) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s737ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s351ms, % non-child: 0.25%) - ConvertRowBatchTime: 709.992ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572955) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.29 MB, 10.00 MB, 10.00 MB, 10.00 MB, 23.22 MB, 244.78 MB, 610.34 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s891ms - TotalBytesReceived: 2.66 GB (2854848111) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s251ms - NumBatchesAccepted: 113.86K (113858) - NumBatchesRejected: 111 (111) Instance 5f429df048b5534b:41bcce18000001dc (host=foo.232.31:22000):(Total: 10m37s, non-child: 6s934ms, % non-child: 1.09%) MemoryUsage(16s000ms): 139.40 MB, 284.95 MB, 289.40 MB, 289.39 MB, 289.40 MB, 376.31 MB, 536.57 MB, 537.09 MB, 536.84 MB, 536.89 MB, 536.61 MB, 536.85 MB, 536.81 MB, 536.96 MB, 536.62 MB, 536.72 MB, 536.47 MB, 536.74 MB, 536.60 MB, 536.75 MB, 536.47 MB, 536.49 MB, 536.57 MB, 536.80 MB, 536.75 MB, 536.85 MB, 536.82 MB, 536.79 MB, 536.60 MB, 536.62 MB, 536.71 MB, 536.55 MB, 536.51 MB, 536.88 MB, 536.51 MB, 536.65 MB, 536.84 MB, 536.31 MB, 536.97 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.27 MB (572802575) - PerHostPeakMemUsage: 1.42 GB (1528772547) - RowsProduced: 1.43M (1434991) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 1s761ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.75K (7747) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s283ms - TotalThreadsUserTime: 21s863ms - TotalThreadsVoluntaryContextSwitches: 122.20K (122198) Fragment Instance Lifecycle Timings: - ExecTime: 9m6s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.120ms - ExecTreePrepareTime: 408.502us DataStreamSender (dst_id=23):(Total: 3s698ms, non-child: 3s698ms, % non-child: 100.00%) - BytesSent: 254.01 MB (266348098) - OverallThroughput: 68.68 MB/sec - PeakMemoryUsage: 6.03 MB (6324608) - RowsReturned: 1.43M (1434991) - SerializeBatchTime: 3s694ms - UncompressedRowBatchSize: 254.01 MB (266348098) CodeGen:(Total: 438.840ms, non-child: 438.840ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.078ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.483ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.781ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 301.025ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 417.610us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4499792) - ProbeRows: 1.43M (1434991) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.777ms - RowsReturned: 1.43M (1434991) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.377us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 185.721us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.103us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 438.210ms, non-child: 24.327us, % non-child: 0.01%) - ConvertRowBatchTime: 12.702us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 625.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 438.189ms - DataArrivalTimer: 438.186ms SenderSide: - DeserializeRowBatchTimer: 107.743us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s614ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498121) - BuildTime: 5s040ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546653893) - ProbeRows: 19.58M (19578048) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s230ms - RowsReturned: 1.43M (1434991) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s446ms - BuildRowsPartitioned: 9.50M (9498121) - GetNewBlockTime: 1.805ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.81K (49810) - HashTablesBuildTime: 582.197ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 396.199ms, % non-child: 0.46%) - ConvertRowBatchTime: 278.224ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498121) - RowsReturnedRate: 111.46 K/sec RecvrSide: BytesReceived(16s000ms): 62.43 MB, 168.63 MB, 209.27 MB, 219.51 MB, 223.03 MB, 224.05 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 562.819ms - TotalBytesReceived: 224.15 MB (235042002) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s699ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s441ms, % non-child: 0.26%) - ConvertRowBatchTime: 746.523ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19578048) - RowsReturnedRate: 35.74 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.34 MB, 10.02 MB, 10.02 MB, 10.02 MB, 23.46 MB, 245.09 MB, 610.99 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s891ms - TotalBytesReceived: 2.66 GB (2855494139) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 17s315ms - NumBatchesAccepted: 113.90K (113896) - NumBatchesRejected: 95 (95) Instance 5f429df048b5534b:41bcce18000001ff (host=foo.232.33:22000):(Total: 10m37s, non-child: 6s939ms, % non-child: 1.09%) MemoryUsage(16s000ms): 131.89 MB, 284.86 MB, 289.38 MB, 289.38 MB, 289.38 MB, 366.92 MB, 536.86 MB, 536.99 MB, 537.02 MB, 536.95 MB, 536.59 MB, 536.59 MB, 536.75 MB, 536.96 MB, 536.57 MB, 536.71 MB, 536.41 MB, 536.44 MB, 536.80 MB, 536.49 MB, 536.94 MB, 536.48 MB, 536.77 MB, 536.80 MB, 536.87 MB, 536.54 MB, 536.62 MB, 536.67 MB, 536.53 MB, 536.71 MB, 536.53 MB, 536.61 MB, 536.82 MB, 536.68 MB, 536.52 MB, 536.46 MB, 536.47 MB, 536.98 MB, 536.12 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.43 MB (572971328) - PerHostPeakMemUsage: 1.43 GB (1538772744) - RowsProduced: 1.43M (1432674) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 2s161ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.62K (7621) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s347ms - TotalThreadsUserTime: 21s724ms - TotalThreadsVoluntaryContextSwitches: 122.22K (122215) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 52.743ms - ExecTreePrepareTime: 374.325us DataStreamSender (dst_id=23):(Total: 3s664ms, non-child: 3s664ms, % non-child: 100.00%) - BytesSent: 253.45 MB (265757009) - OverallThroughput: 69.16 MB/sec - PeakMemoryUsage: 6.27 MB (6570368) - RowsReturned: 1.43M (1432674) - SerializeBatchTime: 3s659ms - UncompressedRowBatchSize: 253.45 MB (265757009) CodeGen:(Total: 443.567ms, non-child: 443.567ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 138.751ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 266.271ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 37.455ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 301.186ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 759.833us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491273) - ProbeRows: 1.43M (1432674) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.495ms - RowsReturned: 1.43M (1432674) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56.002us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 475.178us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 122.960us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 429.222ms, non-child: 17.788us, % non-child: 0.00%) - ConvertRowBatchTime: 7.354us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 638.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 429.207ms - DataArrivalTimer: 429.205ms SenderSide: - DeserializeRowBatchTimer: 119.987us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s895ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498805) - BuildTime: 4s994ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664305) - ProbeRows: 19.57M (19569659) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s250ms - RowsReturned: 1.43M (1432674) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s271ms - BuildRowsPartitioned: 9.50M (9498805) - GetNewBlockTime: 1.416ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.14K (50144) - HashTablesBuildTime: 709.412ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 382.991ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.428ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498805) - RowsReturnedRate: 110.70 K/sec RecvrSide: BytesReceived(16s000ms): 61.61 MB, 168.20 MB, 209.12 MB, 219.49 MB, 223.02 MB, 224.06 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 547.980ms - TotalBytesReceived: 224.16 MB (235051857) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s651ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s456ms, % non-child: 0.27%) - ConvertRowBatchTime: 745.240ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569659) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.29 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.78 MB, 243.20 MB, 608.33 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s887ms - TotalBytesReceived: 2.66 GB (2854272989) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s766ms - NumBatchesAccepted: 113.84K (113837) - NumBatchesRejected: 114 (114) Instance 5f429df048b5534b:41bcce18000001f4 (host=foo.221.42:22000):(Total: 10m36s, non-child: 5s816ms, % non-child: 0.91%) MemoryUsage(16s000ms): 128.68 MB, 284.39 MB, 289.39 MB, 289.40 MB, 289.40 MB, 361.30 MB, 536.81 MB, 537.26 MB, 536.76 MB, 536.74 MB, 536.69 MB, 536.61 MB, 536.55 MB, 536.64 MB, 536.85 MB, 536.62 MB, 536.84 MB, 536.86 MB, 536.83 MB, 536.80 MB, 536.61 MB, 536.70 MB, 536.86 MB, 536.66 MB, 536.77 MB, 536.68 MB, 536.72 MB, 536.60 MB, 536.73 MB, 536.76 MB, 536.70 MB, 536.78 MB, 536.84 MB, 536.44 MB, 536.39 MB, 536.75 MB, 536.64 MB, 537.05 MB, 536.94 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.15 MB (572678784) - PerHostPeakMemUsage: 1.43 GB (1539857554) - RowsProduced: 1.43M (1433509) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 1s444ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.84K (7839) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s318ms - TotalThreadsUserTime: 21s341ms - TotalThreadsVoluntaryContextSwitches: 122.68K (122676) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.235ms - ExecTreePrepareTime: 472.211us DataStreamSender (dst_id=23):(Total: 3s618ms, non-child: 3s618ms, % non-child: 100.00%) - BytesSent: 253.63 MB (265953735) - OverallThroughput: 70.10 MB/sec - PeakMemoryUsage: 6.12 MB (6414720) - RowsReturned: 1.43M (1433509) - SerializeBatchTime: 3s613ms - UncompressedRowBatchSize: 253.63 MB (265953735) CodeGen:(Total: 514.661ms, non-child: 514.661ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 164.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 322.464ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.124ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 295.231ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 835.763us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493197) - ProbeRows: 1.43M (1433509) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.187ms - RowsReturned: 1.43M (1433509) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 71.184us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 362.063us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 121.752us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 739.334ms, non-child: 20.610us, % non-child: 0.00%) - ConvertRowBatchTime: 7.700us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 370.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 739.318ms - DataArrivalTimer: 739.314ms SenderSide: - DeserializeRowBatchTimer: 35.400us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s599ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503945) - BuildTime: 5s021ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660483) - ProbeRows: 19.58M (19575781) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s052ms - RowsReturned: 1.43M (1433509) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s326ms - BuildRowsPartitioned: 9.50M (9503945) - GetNewBlockTime: 1.614ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.66K (49662) - HashTablesBuildTime: 684.145ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 390.418ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.604ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503945) - RowsReturnedRate: 110.17 K/sec RecvrSide: BytesReceived(16s000ms): 58.28 MB, 166.14 MB, 208.69 MB, 219.46 MB, 223.08 MB, 224.17 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 1s077ms - TotalBytesReceived: 224.28 MB (235176982) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s663ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s396ms, % non-child: 0.25%) - ConvertRowBatchTime: 721.306ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575781) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.00 MB, 10.02 MB, 10.02 MB, 10.02 MB, 20.47 MB, 234.34 MB, 597.70 MB, 1018.16 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s423ms - TotalBytesReceived: 2.66 GB (2854960928) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s295ms - NumBatchesAccepted: 113.87K (113871) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001bd (host=foo.221.49:22000):(Total: 10m36s, non-child: 6s224ms, % non-child: 0.98%) MemoryUsage(16s000ms): 123.42 MB, 284.16 MB, 289.37 MB, 289.36 MB, 289.36 MB, 375.69 MB, 536.65 MB, 537.31 MB, 536.97 MB, 536.88 MB, 536.80 MB, 536.85 MB, 536.66 MB, 536.83 MB, 537.03 MB, 536.88 MB, 537.00 MB, 536.78 MB, 536.43 MB, 536.60 MB, 536.65 MB, 536.72 MB, 536.74 MB, 536.82 MB, 536.78 MB, 536.65 MB, 536.77 MB, 536.58 MB, 536.94 MB, 536.82 MB, 536.75 MB, 536.58 MB, 536.97 MB, 536.44 MB, 536.83 MB, 536.61 MB, 536.32 MB, 536.71 MB, 536.20 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.39 MB (572927457) - PerHostPeakMemUsage: 1.39 GB (1493206787) - RowsProduced: 1.43M (1433585) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 1s725ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.92K (7921) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s329ms - TotalThreadsUserTime: 21s345ms - TotalThreadsVoluntaryContextSwitches: 121.88K (121875) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.208ms - ExecTreePrepareTime: 434.855us DataStreamSender (dst_id=23):(Total: 3s659ms, non-child: 3s659ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265981666) - OverallThroughput: 69.32 MB/sec - PeakMemoryUsage: 6.42 MB (6734208) - RowsReturned: 1.43M (1433585) - SerializeBatchTime: 3s655ms - UncompressedRowBatchSize: 253.66 MB (265981666) CodeGen:(Total: 500.255ms, non-child: 500.255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 330.663ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.163ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 296.211ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 705.993us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4498573) - ProbeRows: 1.43M (1433585) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.323ms - RowsReturned: 1.43M (1433585) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.702us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 420.795us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 91.519us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 798.393ms, non-child: 18.272us, % non-child: 0.00%) - ConvertRowBatchTime: 7.741us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 343.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 798.379ms - DataArrivalTimer: 798.375ms SenderSide: - DeserializeRowBatchTimer: 171.405us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s435ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500987) - BuildTime: 4s882ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661975) - ProbeRows: 19.58M (19582894) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s060ms - RowsReturned: 1.43M (1433585) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s287ms - BuildRowsPartitioned: 9.50M (9500987) - GetNewBlockTime: 2.399ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.18K (50180) - HashTablesBuildTime: 580.298ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 388.570ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.066ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500987) - RowsReturnedRate: 111.62 K/sec RecvrSide: BytesReceived(16s000ms): 56.79 MB, 165.23 MB, 208.39 MB, 219.35 MB, 223.01 MB, 224.12 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 969.167ms - TotalBytesReceived: 224.24 MB (235130097) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s658ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s386ms, % non-child: 0.25%) - ConvertRowBatchTime: 737.135ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19582894) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.86 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.73 MB, 230.32 MB, 592.99 MB, 1013.31 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s299ms - TotalBytesReceived: 2.66 GB (2856276954) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s727ms - NumBatchesAccepted: 113.92K (113921) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce18000001ab (host=foo.221.41:22000):(Total: 10m36s, non-child: 5s830ms, % non-child: 0.92%) MemoryUsage(16s000ms): 123.43 MB, 284.19 MB, 289.37 MB, 289.37 MB, 289.37 MB, 375.80 MB, 536.61 MB, 536.86 MB, 536.94 MB, 536.77 MB, 536.65 MB, 536.59 MB, 536.67 MB, 536.75 MB, 536.47 MB, 536.84 MB, 536.37 MB, 536.26 MB, 537.16 MB, 536.87 MB, 536.39 MB, 536.45 MB, 536.65 MB, 536.73 MB, 536.54 MB, 536.55 MB, 536.90 MB, 536.79 MB, 536.48 MB, 536.64 MB, 536.58 MB, 536.69 MB, 536.73 MB, 536.51 MB, 536.64 MB, 536.59 MB, 536.67 MB, 536.72 MB, 537.05 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.08 MB (572602994) - PerHostPeakMemUsage: 1.43 GB (1531852975) - RowsProduced: 1.43M (1430239) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 1s446ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.65K (7654) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s298ms - TotalThreadsUserTime: 20s820ms - TotalThreadsVoluntaryContextSwitches: 122.85K (122853) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 37.115ms - ExecTreePrepareTime: 574.064us DataStreamSender (dst_id=23):(Total: 3s635ms, non-child: 3s635ms, % non-child: 100.00%) - BytesSent: 253.03 MB (265324224) - OverallThroughput: 69.60 MB/sec - PeakMemoryUsage: 6.61 MB (6930816) - RowsReturned: 1.43M (1430239) - SerializeBatchTime: 3s631ms - UncompressedRowBatchSize: 253.03 MB (265324224) CodeGen:(Total: 472.123ms, non-child: 472.123ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 137.365ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 306.585ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.525ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 289.273ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.212ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4663901) - ProbeRows: 1.43M (1430239) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 277.084ms - RowsReturned: 1.43M (1430239) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.096us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 921.646us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.135us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 988.591ms, non-child: 22.300us, % non-child: 0.00%) - ConvertRowBatchTime: 10.561us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 277.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 988.572ms - DataArrivalTimer: 988.569ms SenderSide: - DeserializeRowBatchTimer: 36.746us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s372ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497433) - BuildTime: 4s731ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661933) - ProbeRows: 19.58M (19578091) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s946ms - RowsReturned: 1.43M (1430239) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s103ms - BuildRowsPartitioned: 9.50M (9497433) - GetNewBlockTime: 1.792ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.52K (49523) - HashTablesBuildTime: 615.438ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 371.948ms, % non-child: 0.44%) - ConvertRowBatchTime: 265.115ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497433) - RowsReturnedRate: 111.18 K/sec RecvrSide: BytesReceived(16s000ms): 56.79 MB, 165.18 MB, 208.33 MB, 219.27 MB, 222.93 MB, 224.03 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB - FirstBatchArrivalWaitTime: 1s104ms - TotalBytesReceived: 224.14 MB (235031963) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s578ms - NumBatchesAccepted: 16.90K (16904) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s402ms, % non-child: 0.26%) - ConvertRowBatchTime: 724.798ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19578091) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.88 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.81 MB, 230.43 MB, 593.11 MB, 1013.53 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s464ms - TotalBytesReceived: 2.66 GB (2855100136) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s474ms - NumBatchesAccepted: 113.88K (113881) - NumBatchesRejected: 91 (91) Instance 5f429df048b5534b:41bcce1800000207 (host=foo.187.52:22000):(Total: 10m36s, non-child: 5s000ms, % non-child: 0.79%) MemoryUsage(16s000ms): 122.96 MB, 282.12 MB, 289.36 MB, 289.37 MB, 289.37 MB, 352.18 MB, 536.89 MB, 537.24 MB, 536.92 MB, 536.84 MB, 537.09 MB, 536.62 MB, 536.73 MB, 536.67 MB, 536.70 MB, 536.70 MB, 536.74 MB, 536.27 MB, 536.74 MB, 536.58 MB, 536.92 MB, 536.70 MB, 536.72 MB, 536.65 MB, 536.61 MB, 536.68 MB, 536.78 MB, 536.95 MB, 536.61 MB, 536.76 MB, 536.66 MB, 536.44 MB, 536.73 MB, 536.60 MB, 536.84 MB, 536.66 MB, 536.63 MB, 536.68 MB, 536.41 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.38 MB (572918893) - PerHostPeakMemUsage: 1.23 GB (1316359560) - RowsProduced: 1.43M (1432801) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 644.248ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.22K (8220) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s285ms - TotalThreadsUserTime: 21s366ms - TotalThreadsVoluntaryContextSwitches: 122.38K (122384) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 30.774ms - ExecTreePrepareTime: 215.371us DataStreamSender (dst_id=23):(Total: 3s643ms, non-child: 3s643ms, % non-child: 100.00%) - BytesSent: 253.52 MB (265833518) - OverallThroughput: 69.57 MB/sec - PeakMemoryUsage: 6.31 MB (6611328) - RowsReturned: 1.43M (1432801) - SerializeBatchTime: 3s639ms - UncompressedRowBatchSize: 253.52 MB (265833518) CodeGen:(Total: 454.931ms, non-child: 454.931ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 151.726ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 280.637ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.999ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 291.806ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 594.080us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.46 MB (4679802) - ProbeRows: 1.43M (1432801) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 280.288ms - RowsReturned: 1.43M (1432801) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 56.320us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 346.388us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 93.835us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s124ms, non-child: 21.343us, % non-child: 0.00%) - ConvertRowBatchTime: 9.134us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 243.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s124ms - DataArrivalTimer: 1s124ms SenderSide: - DeserializeRowBatchTimer: 39.378us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s557ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500191) - BuildTime: 5s005ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664160) - ProbeRows: 19.57M (19574508) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s052ms - RowsReturned: 1.43M (1432801) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s233ms - BuildRowsPartitioned: 9.50M (9500191) - GetNewBlockTime: 1.462ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.11K (50110) - HashTablesBuildTime: 757.799ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 380.346ms, % non-child: 0.44%) - ConvertRowBatchTime: 268.103ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500191) - RowsReturnedRate: 109.47 K/sec RecvrSide: BytesReceived(16s000ms): 54.60 MB, 163.76 MB, 207.97 MB, 219.20 MB, 222.95 MB, 224.09 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 1s467ms - TotalBytesReceived: 224.21 MB (235106123) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s585ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s430ms, % non-child: 0.26%) - ConvertRowBatchTime: 735.861ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574508) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.68 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.17 MB, 223.91 MB, 585.62 MB, 1004.91 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s793ms - TotalBytesReceived: 2.66 GB (2855005205) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s851ms - NumBatchesAccepted: 113.87K (113869) - NumBatchesRejected: 123 (123) Instance 5f429df048b5534b:41bcce18000001f8 (host=foo.187.44:22000):(Total: 10m36s, non-child: 4s734ms, % non-child: 0.74%) MemoryUsage(16s000ms): 118.88 MB, 279.74 MB, 289.38 MB, 289.38 MB, 289.39 MB, 351.58 MB, 536.74 MB, 537.25 MB, 536.97 MB, 537.09 MB, 537.10 MB, 536.86 MB, 536.77 MB, 536.70 MB, 536.72 MB, 536.92 MB, 536.66 MB, 536.51 MB, 536.68 MB, 536.69 MB, 536.60 MB, 536.70 MB, 536.91 MB, 536.82 MB, 536.78 MB, 536.76 MB, 536.73 MB, 536.63 MB, 536.69 MB, 536.48 MB, 536.71 MB, 536.70 MB, 536.56 MB, 536.86 MB, 536.47 MB, 536.78 MB, 537.14 MB, 537.47 MB, 536.33 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572777256) - PerHostPeakMemUsage: 1.24 GB (1327683132) - RowsProduced: 1.43M (1432784) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 318.560ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.27K (8273) - TotalThreadsTotalWallClockTime: 12m10s - TotalThreadsSysTime: 2s279ms - TotalThreadsUserTime: 21s530ms - TotalThreadsVoluntaryContextSwitches: 122.70K (122699) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m32s - PrepareTime: 37.356ms - ExecTreePrepareTime: 420.469us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.58 MB (265899757) - OverallThroughput: 69.64 MB/sec - PeakMemoryUsage: 6.34 MB (6652288) - RowsReturned: 1.43M (1432784) - SerializeBatchTime: 3s637ms - UncompressedRowBatchSize: 253.58 MB (265899757) CodeGen:(Total: 475.821ms, non-child: 475.821ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 307.941ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.211ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 298.286ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 330.702us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494591) - ProbeRows: 1.43M (1432784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.309ms - RowsReturned: 1.43M (1432784) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.109us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 112.231us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.927us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s715ms, non-child: 18.858us, % non-child: 0.00%) - ConvertRowBatchTime: 7.493us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 159.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 233.451ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s715ms - DataArrivalTimer: 1s715ms SenderSide: - DeserializeRowBatchTimer: 44.158us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s524ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499303) - BuildTime: 5s096ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661520) - ProbeRows: 19.58M (19577102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s011ms - RowsReturned: 1.43M (1432784) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s480ms - BuildRowsPartitioned: 9.50M (9499303) - GetNewBlockTime: 1.816ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.53K (50535) - HashTablesBuildTime: 601.321ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 380.171ms, % non-child: 0.44%) - ConvertRowBatchTime: 268.755ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499303) - RowsReturnedRate: 109.45 K/sec RecvrSide: BytesReceived(16s000ms): 53.73 MB, 163.23 MB, 207.83 MB, 219.14 MB, 222.89 MB, 224.05 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB - FirstBatchArrivalWaitTime: 1s755ms - TotalBytesReceived: 224.18 MB (235067080) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s690ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s405ms, % non-child: 0.26%) - ConvertRowBatchTime: 731.971ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577102) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.61 MB, 10.02 MB, 10.02 MB, 10.02 MB, 17.68 MB, 221.92 MB, 583.18 MB, 1001.74 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s108ms - TotalBytesReceived: 2.66 GB (2855417513) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s692ms - NumBatchesAccepted: 113.89K (113889) - NumBatchesRejected: 99 (99) Instance 5f429df048b5534b:41bcce18000001e3 (host=foo.187.47:22000):(Total: 10m36s, non-child: 4s775ms, % non-child: 0.75%) MemoryUsage(16s000ms): 118.38 MB, 276.85 MB, 289.37 MB, 289.36 MB, 289.36 MB, 346.02 MB, 536.98 MB, 537.24 MB, 536.97 MB, 536.77 MB, 536.99 MB, 536.65 MB, 536.73 MB, 536.71 MB, 537.11 MB, 537.10 MB, 536.79 MB, 536.90 MB, 536.31 MB, 536.69 MB, 536.74 MB, 536.80 MB, 536.76 MB, 536.93 MB, 536.66 MB, 536.72 MB, 536.80 MB, 536.76 MB, 536.77 MB, 536.54 MB, 536.89 MB, 536.50 MB, 536.74 MB, 536.62 MB, 536.70 MB, 536.82 MB, 536.67 MB, 537.05 MB, 536.05 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.27 MB (572807371) - PerHostPeakMemUsage: 1.23 GB (1315490468) - RowsProduced: 1.43M (1434735) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 336.725ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.11K (8114) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s264ms - TotalThreadsUserTime: 21s269ms - TotalThreadsVoluntaryContextSwitches: 122.86K (122859) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m32s - PrepareTime: 34.167ms - ExecTreePrepareTime: 619.417us DataStreamSender (dst_id=23):(Total: 3s638ms, non-child: 3s638ms, % non-child: 100.00%) - BytesSent: 253.87 MB (266205460) - OverallThroughput: 69.78 MB/sec - PeakMemoryUsage: 6.59 MB (6914432) - RowsReturned: 1.43M (1434735) - SerializeBatchTime: 3s633ms - UncompressedRowBatchSize: 253.87 MB (266205460) CodeGen:(Total: 460.218ms, non-child: 460.218ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 162.900ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 271.875ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.868ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 290.188ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 340.586us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494649) - ProbeRows: 1.43M (1434735) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 277.973ms - RowsReturned: 1.43M (1434735) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.005us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 125.018us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.853us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s682ms, non-child: 23.309us, % non-child: 0.00%) - ConvertRowBatchTime: 9.063us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 162.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 272.042ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s682ms - DataArrivalTimer: 1s682ms SenderSide: - DeserializeRowBatchTimer: 47.937us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s391ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503862) - BuildTime: 4s977ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662871) - ProbeRows: 19.58M (19576577) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s917ms - RowsReturned: 1.43M (1434735) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s360ms - BuildRowsPartitioned: 9.50M (9503862) - GetNewBlockTime: 1.631ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.29K (50290) - HashTablesBuildTime: 602.072ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 365.468ms, % non-child: 0.42%) - ConvertRowBatchTime: 257.280ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503862) - RowsReturnedRate: 109.34 K/sec RecvrSide: BytesReceived(16s000ms): 50.98 MB, 161.29 MB, 207.40 MB, 219.06 MB, 222.93 MB, 224.14 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 1s801ms - TotalBytesReceived: 224.28 MB (235172870) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s831ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s410ms, % non-child: 0.26%) - ConvertRowBatchTime: 732.044ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576577) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.37 MB, 10.00 MB, 10.00 MB, 10.00 MB, 16.18 MB, 214.15 MB, 574.00 MB, 991.76 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s131ms - TotalBytesReceived: 2.66 GB (2855333556) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s695ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001da (host=foo.187.54:22000):(Total: 10m36s, non-child: 4s956ms, % non-child: 0.78%) MemoryUsage(16s000ms): 122.88 MB, 284.05 MB, 289.37 MB, 289.37 MB, 289.37 MB, 361.97 MB, 536.80 MB, 537.13 MB, 536.71 MB, 537.10 MB, 536.80 MB, 536.75 MB, 536.69 MB, 536.60 MB, 536.83 MB, 536.64 MB, 536.35 MB, 536.87 MB, 536.88 MB, 536.62 MB, 536.91 MB, 536.80 MB, 536.66 MB, 536.63 MB, 536.79 MB, 536.76 MB, 536.75 MB, 536.63 MB, 536.94 MB, 536.63 MB, 536.79 MB, 536.63 MB, 536.77 MB, 536.88 MB, 536.55 MB, 536.46 MB, 536.39 MB, 536.34 MB, 536.94 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572775159) - PerHostPeakMemUsage: 1.23 GB (1321242967) - RowsProduced: 1.43M (1432195) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 791.780ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.97K (7966) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s355ms - TotalThreadsUserTime: 21s472ms - TotalThreadsVoluntaryContextSwitches: 122.01K (122009) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 31.639ms - ExecTreePrepareTime: 399.236us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.39 MB (265700774) - OverallThroughput: 69.34 MB/sec - PeakMemoryUsage: 6.33 MB (6635904) - RowsReturned: 1.43M (1432195) - SerializeBatchTime: 3s650ms - UncompressedRowBatchSize: 253.39 MB (265700774) CodeGen:(Total: 514.186ms, non-child: 514.186ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 187.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 303.523ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.968ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 302.093ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 252.585us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493267) - ProbeRows: 1.43M (1432195) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 290.005ms - RowsReturned: 1.43M (1432195) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 29.571us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 123.869us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.904us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s285ms, non-child: 10.348us, % non-child: 0.00%) - ConvertRowBatchTime: 4.083us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 213.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s285ms - DataArrivalTimer: 1s285ms SenderSide: - DeserializeRowBatchTimer: 238.192us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s510ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501274) - BuildTime: 5s044ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661387) - ProbeRows: 19.57M (19570529) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s987ms - RowsReturned: 1.43M (1432195) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s311ms - BuildRowsPartitioned: 9.50M (9501274) - GetNewBlockTime: 1.282ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.72K (49715) - HashTablesBuildTime: 717.574ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 380.065ms, % non-child: 0.44%) - ConvertRowBatchTime: 267.882ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501274) - RowsReturnedRate: 110.19 K/sec RecvrSide: BytesReceived(16s000ms): 55.86 MB, 164.69 MB, 208.27 MB, 219.29 MB, 222.99 MB, 224.10 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 1s457ms - TotalBytesReceived: 224.23 MB (235117239) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s712ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s436ms, % non-child: 0.26%) - ConvertRowBatchTime: 742.509ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19570529) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.79 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.07 MB, 228.18 MB, 590.21 MB, 1009.71 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s791ms - TotalBytesReceived: 2.66 GB (2854355684) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s935ms - NumBatchesAccepted: 113.84K (113843) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce1800000200 (host=foo.221.30:22000):(Total: 10m36s, non-child: 4s945ms, % non-child: 0.78%) MemoryUsage(16s000ms): 122.88 MB, 283.91 MB, 289.37 MB, 289.37 MB, 289.37 MB, 353.76 MB, 536.96 MB, 536.99 MB, 537.12 MB, 536.50 MB, 536.68 MB, 536.79 MB, 536.82 MB, 536.67 MB, 537.02 MB, 536.84 MB, 536.94 MB, 536.58 MB, 536.72 MB, 536.80 MB, 536.46 MB, 536.54 MB, 536.91 MB, 536.66 MB, 536.83 MB, 536.58 MB, 536.83 MB, 536.71 MB, 536.65 MB, 536.84 MB, 536.67 MB, 536.69 MB, 536.78 MB, 536.68 MB, 536.77 MB, 536.70 MB, 536.45 MB, 536.72 MB, 536.26 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.23 MB (572768633) - PerHostPeakMemUsage: 1.32 GB (1419515909) - RowsProduced: 1.43M (1433595) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 448.219ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.78K (7783) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s254ms - TotalThreadsUserTime: 20s964ms - TotalThreadsVoluntaryContextSwitches: 122.92K (122924) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 35.354ms - ExecTreePrepareTime: 403.801us DataStreamSender (dst_id=23):(Total: 3s607ms, non-child: 3s607ms, % non-child: 100.00%) - BytesSent: 253.71 MB (266036306) - OverallThroughput: 70.33 MB/sec - PeakMemoryUsage: 6.06 MB (6357376) - RowsReturned: 1.43M (1433595) - SerializeBatchTime: 3s603ms - UncompressedRowBatchSize: 253.71 MB (266036306) CodeGen:(Total: 442.046ms, non-child: 442.046ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 152.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 266.616ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.882ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 286.670ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 788.136us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488151) - ProbeRows: 1.43M (1433595) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 275.474ms - RowsReturned: 1.43M (1433595) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 90.726us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 416.728us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 141.981us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s140ms, non-child: 16.421us, % non-child: 0.00%) - ConvertRowBatchTime: 6.331us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 240.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s140ms - DataArrivalTimer: 1s140ms SenderSide: - DeserializeRowBatchTimer: 46.824us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s373ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503825) - BuildTime: 5s098ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662209) - ProbeRows: 19.57M (19571767) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s861ms - RowsReturned: 1.43M (1433595) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s425ms - BuildRowsPartitioned: 9.50M (9503825) - GetNewBlockTime: 1.189ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.18K (50176) - HashTablesBuildTime: 660.552ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 394.311ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.620ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503825) - RowsReturnedRate: 110.02 K/sec RecvrSide: BytesReceived(16s000ms): 55.03 MB, 164.06 MB, 208.13 MB, 219.30 MB, 223.03 MB, 224.16 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 1s272ms - TotalBytesReceived: 224.29 MB (235181085) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s605ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s375ms, % non-child: 0.25%) - ConvertRowBatchTime: 710.589ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571767) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.71 MB, 10.00 MB, 10.00 MB, 10.00 MB, 18.42 MB, 225.48 MB, 586.72 MB, 1005.85 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s607ms - TotalBytesReceived: 2.66 GB (2854520995) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s134ms - NumBatchesAccepted: 113.85K (113853) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001de (host=foo.232.12:22000):(Total: 10m36s, non-child: 5s556ms, % non-child: 0.87%) MemoryUsage(16s000ms): 131.35 MB, 284.63 MB, 289.37 MB, 289.37 MB, 289.37 MB, 364.03 MB, 536.77 MB, 536.86 MB, 536.96 MB, 537.13 MB, 536.44 MB, 536.91 MB, 536.77 MB, 536.75 MB, 536.37 MB, 536.49 MB, 536.35 MB, 536.41 MB, 536.81 MB, 536.71 MB, 536.91 MB, 536.60 MB, 536.77 MB, 536.64 MB, 536.67 MB, 536.65 MB, 536.75 MB, 536.69 MB, 536.78 MB, 536.64 MB, 536.70 MB, 536.68 MB, 536.76 MB, 536.72 MB, 536.65 MB, 536.68 MB, 536.91 MB, 536.45 MB, 536.92 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.01 MB (572535972) - PerHostPeakMemUsage: 1.39 GB (1491728620) - RowsProduced: 1.43M (1434279) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 1s028ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.83K (7831) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s364ms - TotalThreadsUserTime: 21s388ms - TotalThreadsVoluntaryContextSwitches: 122.59K (122592) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.063ms - ExecTreePrepareTime: 318.359us DataStreamSender (dst_id=23):(Total: 3s689ms, non-child: 3s689ms, % non-child: 100.00%) - BytesSent: 253.74 MB (266068748) - OverallThroughput: 68.77 MB/sec - PeakMemoryUsage: 6.13 MB (6431104) - RowsReturned: 1.43M (1434279) - SerializeBatchTime: 3s685ms - UncompressedRowBatchSize: 253.74 MB (266068748) CodeGen:(Total: 482.154ms, non-child: 482.154ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 315.882ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.541ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 290.705ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 694.300us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492646) - ProbeRows: 1.43M (1434279) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.324ms - RowsReturned: 1.43M (1434279) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.112us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 365.885us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 97.087us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 842.618ms, non-child: 20.298us, % non-child: 0.00%) - ConvertRowBatchTime: 9.618us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 325.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 842.601ms - DataArrivalTimer: 842.598ms SenderSide: - DeserializeRowBatchTimer: 129.151us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s570ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501867) - BuildTime: 4s850ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662934) - ProbeRows: 19.57M (19574331) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s095ms - RowsReturned: 1.43M (1434279) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s153ms - BuildRowsPartitioned: 9.50M (9501867) - GetNewBlockTime: 2.783ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.05K (50047) - HashTablesBuildTime: 684.413ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 382.317ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.088ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501867) - RowsReturnedRate: 110.11 K/sec RecvrSide: BytesReceived(16s000ms): 59.92 MB, 167.16 MB, 208.90 MB, 219.51 MB, 223.08 MB, 224.13 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 966.870ms - TotalBytesReceived: 224.25 MB (235138763) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s585ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s417ms, % non-child: 0.26%) - ConvertRowBatchTime: 730.787ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574331) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.14 MB, 10.01 MB, 10.01 MB, 10.01 MB, 21.70 MB, 238.93 MB, 603.14 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s305ms - TotalBytesReceived: 2.66 GB (2854928101) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s655ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 108 (108) Instance 5f429df048b5534b:41bcce18000001a9 (host=foo.232.25:22000):(Total: 10m36s, non-child: 6s144ms, % non-child: 0.97%) MemoryUsage(16s000ms): 129.43 MB, 284.40 MB, 289.37 MB, 289.37 MB, 289.37 MB, 378.42 MB, 536.67 MB, 536.98 MB, 536.60 MB, 536.67 MB, 536.94 MB, 536.80 MB, 536.69 MB, 536.88 MB, 536.75 MB, 536.75 MB, 537.03 MB, 537.20 MB, 536.73 MB, 536.67 MB, 536.61 MB, 536.68 MB, 537.01 MB, 536.82 MB, 536.70 MB, 536.69 MB, 536.78 MB, 536.60 MB, 536.72 MB, 536.57 MB, 536.61 MB, 536.54 MB, 536.67 MB, 536.50 MB, 536.71 MB, 536.63 MB, 536.75 MB, 536.47 MB, 536.32 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.22 MB (572754355) - PerHostPeakMemUsage: 1.41 GB (1513013883) - RowsProduced: 1.43M (1431839) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 1s815ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.71K (7708) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s260ms - TotalThreadsUserTime: 20s892ms - TotalThreadsVoluntaryContextSwitches: 122.02K (122022) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 45.712ms - ExecTreePrepareTime: 562.496us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.38 MB (265685354) - OverallThroughput: 69.33 MB/sec - PeakMemoryUsage: 6.61 MB (6930816) - RowsReturned: 1.43M (1431839) - SerializeBatchTime: 3s650ms - UncompressedRowBatchSize: 253.38 MB (265685354) CodeGen:(Total: 470.108ms, non-child: 470.108ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.916ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 292.165ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 35.914ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 294.472ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 587.950us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493203) - ProbeRows: 1.43M (1431839) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.330ms - RowsReturned: 1.43M (1431839) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55.250us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 344.157us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 91.861us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 683.234ms, non-child: 28.719us, % non-child: 0.00%) - ConvertRowBatchTime: 8.058us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 401.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 683.219ms - DataArrivalTimer: 683.206ms SenderSide: - DeserializeRowBatchTimer: 47.573us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s344ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497034) - BuildTime: 4s530ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660157) - ProbeRows: 19.57M (19573598) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s087ms - RowsReturned: 1.43M (1431839) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s911ms - BuildRowsPartitioned: 9.50M (9497034) - GetNewBlockTime: 1.274ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.94K (49944) - HashTablesBuildTime: 605.167ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 380.277ms, % non-child: 0.45%) - ConvertRowBatchTime: 266.235ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497034) - RowsReturnedRate: 111.32 K/sec RecvrSide: BytesReceived(16s000ms): 58.34 MB, 166.14 MB, 208.58 MB, 219.32 MB, 222.93 MB, 224.01 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB - FirstBatchArrivalWaitTime: 812.720ms - TotalBytesReceived: 224.13 MB (235016254) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s632ms - NumBatchesAccepted: 16.90K (16901) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s393ms, % non-child: 0.25%) - ConvertRowBatchTime: 720.666ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573598) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.01 MB, 10.00 MB, 10.00 MB, 10.00 MB, 20.79 MB, 234.56 MB, 597.93 MB, 1018.90 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s140ms - TotalBytesReceived: 2.66 GB (2854846337) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s898ms - NumBatchesAccepted: 113.86K (113857) - NumBatchesRejected: 91 (91) Instance 5f429df048b5534b:41bcce18000001d2 (host=foo.221.32:22000):(Total: 10m36s, non-child: 5s427ms, % non-child: 0.85%) MemoryUsage(16s000ms): 130.10 MB, 284.40 MB, 289.38 MB, 289.38 MB, 289.38 MB, 377.87 MB, 536.83 MB, 537.03 MB, 536.95 MB, 536.75 MB, 536.67 MB, 536.74 MB, 536.79 MB, 536.99 MB, 536.76 MB, 536.74 MB, 537.02 MB, 536.84 MB, 536.89 MB, 536.59 MB, 536.72 MB, 536.91 MB, 536.59 MB, 536.74 MB, 536.59 MB, 536.62 MB, 536.66 MB, 536.75 MB, 536.70 MB, 536.71 MB, 536.90 MB, 536.75 MB, 536.76 MB, 536.99 MB, 536.39 MB, 536.40 MB, 536.76 MB, 536.50 MB, 536.99 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.23 MB (572768623) - PerHostPeakMemUsage: 1.38 GB (1478564799) - RowsProduced: 1.43M (1433936) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 994.737ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7862) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s292ms - TotalThreadsUserTime: 21s380ms - TotalThreadsVoluntaryContextSwitches: 122.38K (122383) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 34.686ms - ExecTreePrepareTime: 480.295us DataStreamSender (dst_id=23):(Total: 3s672ms, non-child: 3s672ms, % non-child: 100.00%) - BytesSent: 253.80 MB (266133111) - OverallThroughput: 69.10 MB/sec - PeakMemoryUsage: 6.25 MB (6553984) - RowsReturned: 1.43M (1433936) - SerializeBatchTime: 3s668ms - UncompressedRowBatchSize: 253.80 MB (266133111) CodeGen:(Total: 452.558ms, non-child: 452.558ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.120ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.922ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 296.876ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 334.173us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494161) - ProbeRows: 1.43M (1433936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 284.519ms - RowsReturned: 1.43M (1433936) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 47.773us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 117.833us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.503us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s076ms, non-child: 13.356us, % non-child: 0.00%) - ConvertRowBatchTime: 4.667us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 254.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s076ms - DataArrivalTimer: 1s076ms SenderSide: - DeserializeRowBatchTimer: 165.301us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s475ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501960) - BuildTime: 4s895ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657990) - ProbeRows: 19.57M (19573579) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s073ms - RowsReturned: 1.43M (1433936) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s297ms - BuildRowsPartitioned: 9.50M (9501960) - GetNewBlockTime: 1.204ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.87K (49865) - HashTablesBuildTime: 584.202ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 373.428ms, % non-child: 0.44%) - ConvertRowBatchTime: 265.775ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501960) - RowsReturnedRate: 111.34 K/sec RecvrSide: BytesReceived(16s000ms): 58.40 MB, 166.25 MB, 208.70 MB, 219.44 MB, 223.06 MB, 224.14 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 1s187ms - TotalBytesReceived: 224.25 MB (235144028) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s484ms - NumBatchesAccepted: 16.91K (16914) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s417ms, % non-child: 0.26%) - ConvertRowBatchTime: 737.918ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573579) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.00 MB, 10.01 MB, 10.01 MB, 10.01 MB, 20.70 MB, 234.39 MB, 597.84 MB, 1018.37 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s538ms - TotalBytesReceived: 2.66 GB (2854666450) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s544ms - NumBatchesAccepted: 113.86K (113861) - NumBatchesRejected: 87 (87) Instance 5f429df048b5534b:41bcce18000001e8 (host=foo.187.43:22000):(Total: 10m36s, non-child: 4s690ms, % non-child: 0.74%) MemoryUsage(16s000ms): 118.45 MB, 279.46 MB, 289.38 MB, 289.39 MB, 289.39 MB, 348.11 MB, 536.90 MB, 537.01 MB, 536.80 MB, 536.90 MB, 536.88 MB, 536.80 MB, 536.77 MB, 536.46 MB, 536.66 MB, 536.59 MB, 536.71 MB, 537.16 MB, 537.06 MB, 536.74 MB, 536.81 MB, 536.78 MB, 536.67 MB, 536.72 MB, 536.75 MB, 536.85 MB, 536.74 MB, 536.74 MB, 536.64 MB, 536.73 MB, 536.77 MB, 536.69 MB, 536.88 MB, 536.69 MB, 536.56 MB, 536.42 MB, 536.87 MB, 536.38 MB, 536.62 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.15 MB (572681778) - PerHostPeakMemUsage: 1.31 GB (1402734431) - RowsProduced: 1.43M (1433356) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 345.234ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.09K (8091) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s398ms - TotalThreadsUserTime: 21s482ms - TotalThreadsVoluntaryContextSwitches: 123.44K (123435) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m32s - PrepareTime: 39.114ms - ExecTreePrepareTime: 695.186us DataStreamSender (dst_id=23):(Total: 3s642ms, non-child: 3s642ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265984709) - OverallThroughput: 69.64 MB/sec - PeakMemoryUsage: 6.20 MB (6504832) - RowsReturned: 1.43M (1433356) - SerializeBatchTime: 3s638ms - UncompressedRowBatchSize: 253.66 MB (265984709) CodeGen:(Total: 447.609ms, non-child: 447.609ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.147ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 288.343ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.535ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 301.782ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 457.253us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491260) - ProbeRows: 1.43M (1433356) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 289.290ms - RowsReturned: 1.43M (1433356) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 61.471us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 136.705us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 107.135us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s673ms, non-child: 22.310us, % non-child: 0.00%) - ConvertRowBatchTime: 8.373us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 163.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 276.705ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s673ms - DataArrivalTimer: 1s673ms SenderSide: - DeserializeRowBatchTimer: 50.527us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s552ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502033) - BuildTime: 5s032ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662867) - ProbeRows: 19.58M (19576926) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s117ms - RowsReturned: 1.43M (1433356) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s416ms - BuildRowsPartitioned: 9.50M (9502033) - GetNewBlockTime: 2.828ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.99K (49993) - HashTablesBuildTime: 601.470ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 389.034ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.090ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502033) - RowsReturnedRate: 109.37 K/sec RecvrSide: BytesReceived(16s000ms): 51.89 MB, 162.01 MB, 207.56 MB, 219.11 MB, 222.93 MB, 224.11 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 1s799ms - TotalBytesReceived: 224.24 MB (235136950) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s692ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s396ms, % non-child: 0.25%) - ConvertRowBatchTime: 722.384ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576926) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.44 MB, 10.01 MB, 10.01 MB, 10.01 MB, 16.68 MB, 216.73 MB, 576.94 MB, 995.05 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s156ms - TotalBytesReceived: 2.66 GB (2855430363) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 17s079ms - NumBatchesAccepted: 113.88K (113883) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001cc (host=foo.221.34:22000):(Total: 10m36s, non-child: 5s343ms, % non-child: 0.84%) MemoryUsage(16s000ms): 123.43 MB, 284.22 MB, 289.37 MB, 289.36 MB, 289.37 MB, 374.62 MB, 536.75 MB, 536.91 MB, 537.06 MB, 536.95 MB, 536.67 MB, 536.72 MB, 536.80 MB, 536.72 MB, 536.47 MB, 536.58 MB, 536.42 MB, 536.56 MB, 536.53 MB, 536.70 MB, 536.75 MB, 536.81 MB, 536.64 MB, 536.71 MB, 536.69 MB, 536.63 MB, 536.76 MB, 536.67 MB, 536.63 MB, 536.63 MB, 536.48 MB, 536.33 MB, 536.66 MB, 536.92 MB, 536.94 MB, 536.53 MB, 536.34 MB, 536.01 MB, 536.82 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.01 MB (6299648) - PeakMemoryUsage: 546.08 MB (572605388) - PerHostPeakMemUsage: 1.40 GB (1500830944) - RowsProduced: 1.43M (1433030) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 607.610ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.70K (7697) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s357ms - TotalThreadsUserTime: 21s601ms - TotalThreadsVoluntaryContextSwitches: 122.31K (122308) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 39.997ms - ExecTreePrepareTime: 890.276us DataStreamSender (dst_id=23):(Total: 3s649ms, non-child: 3s649ms, % non-child: 100.00%) - BytesSent: 253.56 MB (265877506) - OverallThroughput: 69.49 MB/sec - PeakMemoryUsage: 6.34 MB (6652288) - RowsReturned: 1.43M (1433030) - SerializeBatchTime: 3s645ms - UncompressedRowBatchSize: 253.56 MB (265877506) CodeGen:(Total: 468.244ms, non-child: 468.244ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 145.511ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 293.173ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.020ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 298.324ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 732.941us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4495611) - ProbeRows: 1.43M (1433030) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.243ms - RowsReturned: 1.43M (1433030) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 81.719us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 341.378us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.383us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s106ms, non-child: 17.414us, % non-child: 0.00%) - ConvertRowBatchTime: 7.764us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 247.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s106ms - DataArrivalTimer: 1s106ms SenderSide: - DeserializeRowBatchTimer: 39.662us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s721ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503205) - BuildTime: 5s153ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661853) - ProbeRows: 19.57M (19570063) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s126ms - RowsReturned: 1.43M (1433030) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s467ms - BuildRowsPartitioned: 9.50M (9503205) - GetNewBlockTime: 1.434ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.23K (50230) - HashTablesBuildTime: 670.136ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 386.409ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.504ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503205) - RowsReturnedRate: 111.65 K/sec RecvrSide: BytesReceived(16s000ms): 57.10 MB, 165.46 MB, 208.47 MB, 219.40 MB, 223.06 MB, 224.16 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 1s148ms - TotalBytesReceived: 224.28 MB (235170573) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s824ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s401ms, % non-child: 0.26%) - ConvertRowBatchTime: 732.390ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19570063) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.90 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.89 MB, 231.11 MB, 593.47 MB, 1013.62 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s483ms - TotalBytesReceived: 2.66 GB (2854196514) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s931ms - NumBatchesAccepted: 113.84K (113839) - NumBatchesRejected: 91 (91) Instance 5f429df048b5534b:41bcce1800000208 (host=foo.221.36:22000):(Total: 10m35s, non-child: 4s784ms, % non-child: 0.75%) MemoryUsage(16s000ms): 129.60 MB, 284.41 MB, 289.39 MB, 289.39 MB, 289.39 MB, 361.47 MB, 536.84 MB, 536.76 MB, 537.09 MB, 536.76 MB, 536.89 MB, 536.61 MB, 536.79 MB, 536.66 MB, 537.02 MB, 536.69 MB, 537.07 MB, 537.07 MB, 536.76 MB, 536.65 MB, 536.57 MB, 536.83 MB, 536.66 MB, 536.76 MB, 536.73 MB, 536.72 MB, 536.91 MB, 536.68 MB, 536.55 MB, 536.78 MB, 536.65 MB, 536.71 MB, 536.86 MB, 536.71 MB, 536.84 MB, 536.46 MB, 536.93 MB, 537.25 MB, 536.58 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.08 MB (572607324) - PerHostPeakMemUsage: 1.36 GB (1456874272) - RowsProduced: 1.43M (1433862) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 705.443ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.83K (7833) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s197ms - TotalThreadsUserTime: 20s912ms - TotalThreadsVoluntaryContextSwitches: 123.16K (123162) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 53.185ms - ExecTreePrepareTime: 384.367us DataStreamSender (dst_id=23):(Total: 3s600ms, non-child: 3s600ms, % non-child: 100.00%) - BytesSent: 253.75 MB (266074069) - OverallThroughput: 70.47 MB/sec - PeakMemoryUsage: 6.31 MB (6611328) - RowsReturned: 1.43M (1433862) - SerializeBatchTime: 3s595ms - UncompressedRowBatchSize: 253.75 MB (266074069) CodeGen:(Total: 453.833ms, non-child: 453.833ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 142.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 270.239ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 40.655ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 287.959ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 585.292us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4660995) - ProbeRows: 1.43M (1433862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 276.070ms - RowsReturned: 1.43M (1433862) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.640us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 379.415us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.007us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 816.031ms, non-child: 19.305us, % non-child: 0.00%) - ConvertRowBatchTime: 8.074us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 335.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 816.016ms - DataArrivalTimer: 816.013ms SenderSide: - DeserializeRowBatchTimer: 79.412us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s351ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506336) - BuildTime: 4s909ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658002) - ProbeRows: 19.57M (19568760) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s928ms - RowsReturned: 1.43M (1433862) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s275ms - BuildRowsPartitioned: 9.51M (9506336) - GetNewBlockTime: 1.258ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.99K (49987) - HashTablesBuildTime: 623.186ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 385.025ms, % non-child: 0.45%) - ConvertRowBatchTime: 271.625ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506336) - RowsReturnedRate: 109.99 K/sec RecvrSide: BytesReceived(16s000ms): 58.50 MB, 166.35 MB, 208.77 MB, 219.52 MB, 223.15 MB, 224.23 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB - FirstBatchArrivalWaitTime: 1s159ms - TotalBytesReceived: 224.34 MB (235241487) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s601ms - NumBatchesAccepted: 16.92K (16923) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s380ms, % non-child: 0.25%) - ConvertRowBatchTime: 716.258ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568760) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.01 MB, 10.02 MB, 10.02 MB, 10.02 MB, 20.57 MB, 234.08 MB, 597.52 MB, 1018.15 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s501ms - TotalBytesReceived: 2.66 GB (2853821293) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s236ms - NumBatchesAccepted: 113.83K (113833) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce180000020e (host=foo.187.45:22000):(Total: 10m35s, non-child: 4s343ms, % non-child: 0.68%) MemoryUsage(16s000ms): 118.45 MB, 279.50 MB, 289.39 MB, 289.39 MB, 289.39 MB, 347.42 MB, 537.18 MB, 537.04 MB, 536.73 MB, 536.71 MB, 536.59 MB, 537.06 MB, 536.64 MB, 536.73 MB, 536.57 MB, 536.42 MB, 536.93 MB, 536.77 MB, 536.68 MB, 536.61 MB, 536.90 MB, 536.85 MB, 536.57 MB, 536.81 MB, 536.75 MB, 536.70 MB, 536.72 MB, 536.73 MB, 536.40 MB, 536.74 MB, 536.59 MB, 536.64 MB, 536.82 MB, 536.43 MB, 536.66 MB, 536.63 MB, 536.62 MB, 537.47 MB, 535.95 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572788467) - PerHostPeakMemUsage: 1.31 GB (1401449535) - RowsProduced: 1.43M (1434688) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 80.792ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.49K (8488) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s270ms - TotalThreadsUserTime: 21s283ms - TotalThreadsVoluntaryContextSwitches: 122.80K (122796) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.433ms - ExecTreePrepareTime: 391.932us DataStreamSender (dst_id=23):(Total: 3s581ms, non-child: 3s581ms, % non-child: 100.00%) - BytesSent: 253.86 MB (266189226) - OverallThroughput: 70.87 MB/sec - PeakMemoryUsage: 6.20 MB (6504832) - RowsReturned: 1.43M (1434688) - SerializeBatchTime: 3s577ms - UncompressedRowBatchSize: 253.86 MB (266189226) CodeGen:(Total: 486.347ms, non-child: 486.347ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 167.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 290.090ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.779ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 297.608ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 346.134us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494095) - ProbeRows: 1.43M (1434688) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 285.919ms - RowsReturned: 1.43M (1434688) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.900us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 124.056us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.200us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s624ms, non-child: 23.143us, % non-child: 0.00%) - ConvertRowBatchTime: 8.096us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 168.00 /sec RecvrSide: BytesReceived(16s000ms): 3.10 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 214.003ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s624ms - DataArrivalTimer: 1s624ms SenderSide: - DeserializeRowBatchTimer: 92.959us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s558ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502730) - BuildTime: 4s881ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660421) - ProbeRows: 19.58M (19575108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s149ms - RowsReturned: 1.43M (1434688) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s280ms - BuildRowsPartitioned: 9.50M (9502730) - GetNewBlockTime: 1.262ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.25K (50249) - HashTablesBuildTime: 587.748ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m27s, non-child: 371.251ms, % non-child: 0.43%) - ConvertRowBatchTime: 262.597ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502730) - RowsReturnedRate: 109.22 K/sec RecvrSide: BytesReceived(16s000ms): 52.10 MB, 162.14 MB, 207.58 MB, 219.09 MB, 222.94 MB, 224.13 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB - FirstBatchArrivalWaitTime: 1s739ms - TotalBytesReceived: 224.26 MB (235155869) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s595ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s351ms, % non-child: 0.25%) - ConvertRowBatchTime: 710.758ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575108) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.46 MB, 10.02 MB, 10.02 MB, 10.02 MB, 16.76 MB, 217.23 MB, 577.22 MB, 994.92 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s086ms - TotalBytesReceived: 2.66 GB (2854834283) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s447ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 99 (99) Instance 5f429df048b5534b:41bcce18000001ec (host=foo.232.11:22000):(Total: 10m35s, non-child: 5s374ms, % non-child: 0.85%) MemoryUsage(16s000ms): 131.36 MB, 284.54 MB, 289.38 MB, 289.38 MB, 289.38 MB, 363.48 MB, 537.10 MB, 536.91 MB, 537.00 MB, 536.74 MB, 536.65 MB, 536.88 MB, 536.69 MB, 536.96 MB, 536.78 MB, 537.01 MB, 536.41 MB, 536.29 MB, 536.55 MB, 536.85 MB, 536.61 MB, 536.71 MB, 536.82 MB, 536.65 MB, 536.67 MB, 536.55 MB, 536.82 MB, 536.67 MB, 536.91 MB, 536.56 MB, 536.64 MB, 536.47 MB, 536.82 MB, 536.60 MB, 536.66 MB, 536.67 MB, 536.37 MB, 537.04 MB, 536.17 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.31 MB (572844025) - PerHostPeakMemUsage: 1.40 GB (1507459617) - RowsProduced: 1.43M (1433613) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 784.598ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.95K (7952) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s298ms - TotalThreadsUserTime: 21s304ms - TotalThreadsVoluntaryContextSwitches: 121.92K (121921) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 40.566ms - ExecTreePrepareTime: 388.228us DataStreamSender (dst_id=23):(Total: 3s657ms, non-child: 3s657ms, % non-child: 100.00%) - BytesSent: 253.68 MB (266000370) - OverallThroughput: 69.36 MB/sec - PeakMemoryUsage: 6.42 MB (6734208) - RowsReturned: 1.43M (1433613) - SerializeBatchTime: 3s652ms - UncompressedRowBatchSize: 253.68 MB (266000370) CodeGen:(Total: 460.953ms, non-child: 460.953ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 134.854ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 296.271ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.290ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 291.540ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 372.829us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493130) - ProbeRows: 1.43M (1433613) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 279.437ms - RowsReturned: 1.43M (1433613) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 45.518us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 160.004us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.770us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 853.577ms, non-child: 21.213us, % non-child: 0.00%) - ConvertRowBatchTime: 8.807us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 321.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 853.561ms - DataArrivalTimer: 853.557ms SenderSide: - DeserializeRowBatchTimer: 53.603us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s421ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499701) - BuildTime: 5s172ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658973) - ProbeRows: 19.57M (19571163) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s982ms - RowsReturned: 1.43M (1433613) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s533ms - BuildRowsPartitioned: 9.50M (9499701) - GetNewBlockTime: 1.651ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.08K (50083) - HashTablesBuildTime: 623.252ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 394.362ms, % non-child: 0.46%) - ConvertRowBatchTime: 278.557ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499701) - RowsReturnedRate: 110.53 K/sec RecvrSide: BytesReceived(16s000ms): 59.44 MB, 166.93 MB, 208.82 MB, 219.42 MB, 223.03 MB, 224.09 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 970.728ms - TotalBytesReceived: 224.20 MB (235091958) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s870ms - NumBatchesAccepted: 16.90K (16900) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s409ms, % non-child: 0.26%) - ConvertRowBatchTime: 726.593ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571163) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.09 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.36 MB, 237.85 MB, 601.86 MB, 1022.83 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s312ms - TotalBytesReceived: 2.66 GB (2854262811) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s095ms - NumBatchesAccepted: 113.85K (113846) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001c6 (host=foo.221.20:22000):(Total: 10m35s, non-child: 4s926ms, % non-child: 0.77%) MemoryUsage(16s000ms): 122.95 MB, 284.11 MB, 289.40 MB, 289.40 MB, 289.40 MB, 372.13 MB, 536.81 MB, 536.44 MB, 536.99 MB, 537.01 MB, 536.79 MB, 536.90 MB, 536.63 MB, 536.90 MB, 536.76 MB, 536.60 MB, 536.77 MB, 536.35 MB, 536.66 MB, 536.88 MB, 536.78 MB, 536.88 MB, 536.63 MB, 536.69 MB, 536.73 MB, 536.54 MB, 536.63 MB, 536.76 MB, 536.84 MB, 536.76 MB, 536.87 MB, 536.47 MB, 536.84 MB, 536.54 MB, 536.60 MB, 536.33 MB, 536.40 MB, 536.65 MB, 536.91 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.18 MB (572707299) - PerHostPeakMemUsage: 1.39 GB (1494618394) - RowsProduced: 1.43M (1434434) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 623.525ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.11K (8108) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s275ms - TotalThreadsUserTime: 21s425ms - TotalThreadsVoluntaryContextSwitches: 122.06K (122064) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 34.854ms - ExecTreePrepareTime: 393.303us DataStreamSender (dst_id=23):(Total: 3s625ms, non-child: 3s625ms, % non-child: 100.00%) - BytesSent: 253.74 MB (266069683) - OverallThroughput: 69.99 MB/sec - PeakMemoryUsage: 6.27 MB (6578560) - RowsReturned: 1.43M (1434434) - SerializeBatchTime: 3s621ms - UncompressedRowBatchSize: 253.74 MB (266069683) CodeGen:(Total: 457.593ms, non-child: 457.593ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 292.154ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.617ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 294.557ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 635.190us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489399) - ProbeRows: 1.43M (1434434) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.788ms - RowsReturned: 1.43M (1434434) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57.629us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 368.359us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.548us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s209ms, non-child: 21.646us, % non-child: 0.00%) - ConvertRowBatchTime: 11.550us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 226.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s209ms - DataArrivalTimer: 1s209ms SenderSide: - DeserializeRowBatchTimer: 67.489us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s530ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500117) - BuildTime: 4s970ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662266) - ProbeRows: 19.58M (19575821) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s085ms - RowsReturned: 1.43M (1434434) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s273ms - BuildRowsPartitioned: 9.50M (9500117) - GetNewBlockTime: 1.556ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.24K (50244) - HashTablesBuildTime: 680.877ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 385.980ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.523ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500117) - RowsReturnedRate: 111.10 K/sec RecvrSide: BytesReceived(16s000ms): 56.18 MB, 164.85 MB, 208.28 MB, 219.30 MB, 222.98 MB, 224.08 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 1s340ms - TotalBytesReceived: 224.20 MB (235092682) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s756ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s371ms, % non-child: 0.25%) - ConvertRowBatchTime: 733.121ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575821) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.83 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.36 MB, 228.46 MB, 590.65 MB, 1010.98 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s694ms - TotalBytesReceived: 2.66 GB (2855112935) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s532ms - NumBatchesAccepted: 113.88K (113882) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce1800000204 (host=foo.187.48:22000):(Total: 10m35s, non-child: 4s349ms, % non-child: 0.68%) MemoryUsage(16s000ms): 118.88 MB, 279.82 MB, 289.38 MB, 289.38 MB, 289.38 MB, 351.61 MB, 536.93 MB, 536.78 MB, 536.81 MB, 536.78 MB, 536.95 MB, 536.69 MB, 536.77 MB, 536.96 MB, 536.83 MB, 536.32 MB, 536.89 MB, 537.42 MB, 536.85 MB, 536.52 MB, 536.54 MB, 536.60 MB, 536.73 MB, 536.78 MB, 536.76 MB, 536.70 MB, 536.76 MB, 536.82 MB, 536.78 MB, 536.68 MB, 536.53 MB, 536.58 MB, 536.74 MB, 536.80 MB, 536.84 MB, 536.50 MB, 536.31 MB, 537.01 MB, 536.65 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.59 MB (573142237) - PerHostPeakMemUsage: 1.30 GB (1400009380) - RowsProduced: 1.43M (1432889) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 88.589ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.83K (7831) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s316ms - TotalThreadsUserTime: 21s490ms - TotalThreadsVoluntaryContextSwitches: 122.40K (122397) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m32s - PrepareTime: 33.378ms - ExecTreePrepareTime: 539.218us DataStreamSender (dst_id=23):(Total: 3s667ms, non-child: 3s667ms, % non-child: 100.00%) - BytesSent: 253.45 MB (265760849) - OverallThroughput: 69.11 MB/sec - PeakMemoryUsage: 6.12 MB (6414720) - RowsReturned: 1.43M (1432889) - SerializeBatchTime: 3s663ms - UncompressedRowBatchSize: 253.45 MB (265760849) CodeGen:(Total: 449.566ms, non-child: 449.566ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 141.126ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.495ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.445ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 307.928ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 570.454us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4669624) - ProbeRows: 1.43M (1432889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.530ms - RowsReturned: 1.43M (1432889) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 52.679us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 330.501us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.597us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s609ms, non-child: 20.501us, % non-child: 0.00%) - ConvertRowBatchTime: 8.148us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 170.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 215.913ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s609ms - DataArrivalTimer: 1s609ms SenderSide: - DeserializeRowBatchTimer: 176.503us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s720ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499525) - BuildTime: 5s079ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657349) - ProbeRows: 19.57M (19572985) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s198ms - RowsReturned: 1.43M (1432889) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s376ms - BuildRowsPartitioned: 9.50M (9499525) - GetNewBlockTime: 1.376ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.92K (49920) - HashTablesBuildTime: 688.634ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 382.302ms, % non-child: 0.44%) - ConvertRowBatchTime: 267.468ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499525) - RowsReturnedRate: 109.30 K/sec RecvrSide: BytesReceived(16s000ms): 54.09 MB, 163.50 MB, 207.89 MB, 219.15 MB, 222.91 MB, 224.06 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB - FirstBatchArrivalWaitTime: 1s740ms - TotalBytesReceived: 224.19 MB (235080388) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s669ms - NumBatchesAccepted: 16.91K (16905) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s384ms, % non-child: 0.25%) - ConvertRowBatchTime: 719.621ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572985) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.66 MB, 10.01 MB, 10.01 MB, 10.01 MB, 17.85 MB, 222.60 MB, 584.19 MB, 1003.28 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s072ms - TotalBytesReceived: 2.66 GB (2854555548) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s640ms - NumBatchesAccepted: 113.87K (113866) - NumBatchesRejected: 109 (109) Instance 5f429df048b5534b:41bcce18000001fb (host=foo.187.40:22000):(Total: 10m35s, non-child: 4s465ms, % non-child: 0.70%) MemoryUsage(16s000ms): 118.49 MB, 279.58 MB, 289.39 MB, 289.39 MB, 289.39 MB, 348.46 MB, 536.70 MB, 537.07 MB, 536.94 MB, 537.00 MB, 536.65 MB, 536.66 MB, 536.79 MB, 536.70 MB, 536.82 MB, 537.02 MB, 536.65 MB, 537.19 MB, 536.96 MB, 536.89 MB, 536.70 MB, 536.86 MB, 536.69 MB, 536.66 MB, 536.80 MB, 536.57 MB, 536.75 MB, 536.74 MB, 536.72 MB, 536.65 MB, 536.93 MB, 536.64 MB, 536.71 MB, 536.57 MB, 536.73 MB, 536.85 MB, 536.96 MB, 536.61 MB, 536.72 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.64 MB (573191511) - PerHostPeakMemUsage: 1.23 GB (1316349865) - RowsProduced: 1.43M (1432433) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 95.412ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.20K (8204) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s289ms - TotalThreadsUserTime: 21s483ms - TotalThreadsVoluntaryContextSwitches: 122.34K (122344) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 35.060ms - ExecTreePrepareTime: 457.962us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.46 MB (265770684) - OverallThroughput: 69.35 MB/sec - PeakMemoryUsage: 6.25 MB (6553984) - RowsReturned: 1.43M (1432433) - SerializeBatchTime: 3s650ms - UncompressedRowBatchSize: 253.46 MB (265770684) CodeGen:(Total: 493.038ms, non-child: 493.038ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.172ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 323.722ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.648ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 290.668ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 354.402us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4496181) - ProbeRows: 1.43M (1432433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.972ms - RowsReturned: 1.43M (1432433) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49.048us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 99.462us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.629us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s576ms, non-child: 30.006us, % non-child: 0.00%) - ConvertRowBatchTime: 8.242us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 173.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 178.687ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s576ms - DataArrivalTimer: 1s576ms SenderSide: - DeserializeRowBatchTimer: 31.810us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s488ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506066) - BuildTime: 4s983ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662604) - ProbeRows: 19.58M (19578957) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s038ms - RowsReturned: 1.43M (1432433) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s369ms - BuildRowsPartitioned: 9.51M (9506066) - GetNewBlockTime: 2.030ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.33K (50331) - HashTablesBuildTime: 604.001ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 382.781ms, % non-child: 0.44%) - ConvertRowBatchTime: 270.373ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506066) - RowsReturnedRate: 109.44 K/sec RecvrSide: BytesReceived(16s000ms): 52.48 MB, 162.46 MB, 207.76 MB, 219.23 MB, 223.04 MB, 224.21 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB - FirstBatchArrivalWaitTime: 1s704ms - TotalBytesReceived: 224.35 MB (235244898) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s537ms - NumBatchesAccepted: 16.92K (16918) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s403ms, % non-child: 0.26%) - ConvertRowBatchTime: 733.832ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19578957) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.51 MB, 10.02 MB, 10.02 MB, 10.02 MB, 17.04 MB, 218.39 MB, 578.81 MB, 997.29 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s030ms - TotalBytesReceived: 2.66 GB (2855650307) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s449ms - NumBatchesAccepted: 113.90K (113896) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001ef (host=foo.187.55:22000):(Total: 10m35s, non-child: 4s585ms, % non-child: 0.72%) MemoryUsage(16s000ms): 118.95 MB, 279.78 MB, 289.36 MB, 289.36 MB, 289.36 MB, 351.59 MB, 536.70 MB, 536.87 MB, 537.08 MB, 537.03 MB, 536.52 MB, 536.93 MB, 536.70 MB, 536.62 MB, 536.51 MB, 536.63 MB, 536.45 MB, 536.69 MB, 536.72 MB, 536.70 MB, 536.63 MB, 536.85 MB, 537.09 MB, 536.82 MB, 536.44 MB, 536.60 MB, 536.63 MB, 536.58 MB, 536.73 MB, 536.65 MB, 536.70 MB, 536.50 MB, 536.84 MB, 536.36 MB, 536.68 MB, 536.71 MB, 536.56 MB, 536.42 MB, 537.20 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.36 MB (572900149) - PerHostPeakMemUsage: 1.31 GB (1401305784) - RowsProduced: 1.44M (1435367) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 340.680ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.00K (7996) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s451ms - TotalThreadsUserTime: 21s245ms - TotalThreadsVoluntaryContextSwitches: 122.56K (122557) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 36.221ms - ExecTreePrepareTime: 429.399us DataStreamSender (dst_id=23):(Total: 3s640ms, non-child: 3s640ms, % non-child: 100.00%) - BytesSent: 254.00 MB (266339012) - OverallThroughput: 69.77 MB/sec - PeakMemoryUsage: 6.57 MB (6889856) - RowsReturned: 1.44M (1435367) - SerializeBatchTime: 3s636ms - UncompressedRowBatchSize: 254.00 MB (266339012) CodeGen:(Total: 432.329ms, non-child: 432.329ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.897ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 271.752ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.204ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 295.903ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 579.270us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4487053) - ProbeRows: 1.44M (1435367) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.689ms - RowsReturned: 1.44M (1435367) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 45.922us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 303.327us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.021us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s502ms, non-child: 14.830us, % non-child: 0.00%) - ConvertRowBatchTime: 5.512us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 182.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 91.697ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s502ms - DataArrivalTimer: 1s502ms SenderSide: - DeserializeRowBatchTimer: 95.326us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s639ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504950) - BuildTime: 4s986ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663034) - ProbeRows: 19.58M (19577706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s117ms - RowsReturned: 1.44M (1435367) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s279ms - BuildRowsPartitioned: 9.50M (9504950) - GetNewBlockTime: 1.846ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.66K (49659) - HashTablesBuildTime: 694.110ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 379.587ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.069ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504950) - RowsReturnedRate: 109.45 K/sec RecvrSide: BytesReceived(16s000ms): 53.91 MB, 163.44 MB, 207.98 MB, 219.26 MB, 223.04 MB, 224.19 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB - FirstBatchArrivalWaitTime: 1s616ms - TotalBytesReceived: 224.31 MB (235208297) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s760ms - NumBatchesAccepted: 16.92K (16921) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s386ms, % non-child: 0.25%) - ConvertRowBatchTime: 728.865ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577706) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.63 MB, 10.00 MB, 10.00 MB, 10.00 MB, 17.71 MB, 222.12 MB, 583.44 MB, 1002.46 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s942ms - TotalBytesReceived: 2.66 GB (2855167927) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s800ms - NumBatchesAccepted: 113.89K (113888) - NumBatchesRejected: 105 (105) Instance 5f429df048b5534b:41bcce18000001f5 (host=foo.221.21:22000):(Total: 10m35s, non-child: 4s789ms, % non-child: 0.75%) MemoryUsage(16s000ms): 122.95 MB, 283.94 MB, 289.39 MB, 289.39 MB, 289.39 MB, 354.15 MB, 536.91 MB, 537.02 MB, 537.02 MB, 537.05 MB, 536.91 MB, 536.65 MB, 536.73 MB, 536.81 MB, 536.76 MB, 536.78 MB, 536.99 MB, 536.91 MB, 536.70 MB, 536.74 MB, 536.90 MB, 536.88 MB, 536.62 MB, 536.64 MB, 536.75 MB, 536.96 MB, 536.83 MB, 536.56 MB, 536.59 MB, 536.69 MB, 536.70 MB, 536.52 MB, 536.92 MB, 536.66 MB, 536.31 MB, 536.50 MB, 536.70 MB, 536.23 MB, 536.73 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.08 MB (572610350) - PerHostPeakMemUsage: 1.40 GB (1500370086) - RowsProduced: 1.43M (1432330) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 457.834ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.71K (7715) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s398ms - TotalThreadsUserTime: 21s437ms - TotalThreadsVoluntaryContextSwitches: 122.36K (122365) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 41.702ms - ExecTreePrepareTime: 554.127us DataStreamSender (dst_id=23):(Total: 3s687ms, non-child: 3s687ms, % non-child: 100.00%) - BytesSent: 253.49 MB (265804529) - OverallThroughput: 68.75 MB/sec - PeakMemoryUsage: 6.23 MB (6537600) - RowsReturned: 1.43M (1432330) - SerializeBatchTime: 3s682ms - UncompressedRowBatchSize: 253.49 MB (265804529) CodeGen:(Total: 468.734ms, non-child: 468.734ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 153.909ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.071ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.278ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 298.457ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 645.144us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.30 MB (4504727) - ProbeRows: 1.43M (1432330) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.732ms - RowsReturned: 1.43M (1432330) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 32.198us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 440.473us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.871us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s150ms, non-child: 27.119us, % non-child: 0.00%) - ConvertRowBatchTime: 11.811us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 238.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s150ms - DataArrivalTimer: 1s150ms SenderSide: - DeserializeRowBatchTimer: 84.048us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s679ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501681) - BuildTime: 4s897ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664445) - ProbeRows: 19.57M (19574121) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s167ms - RowsReturned: 1.43M (1432330) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s191ms - BuildRowsPartitioned: 9.50M (9501681) - GetNewBlockTime: 1.934ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.84K (49836) - HashTablesBuildTime: 692.433ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 383.269ms, % non-child: 0.44%) - ConvertRowBatchTime: 271.559ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501681) - RowsReturnedRate: 109.65 K/sec RecvrSide: BytesReceived(16s000ms): 55.08 MB, 164.11 MB, 208.09 MB, 219.25 MB, 222.99 MB, 224.11 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 1s321ms - TotalBytesReceived: 224.24 MB (235130295) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s686ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s399ms, % non-child: 0.26%) - ConvertRowBatchTime: 740.827ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574121) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.72 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.46 MB, 225.52 MB, 587.38 MB, 1006.87 MB, 1.38 GB, 1.66 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s659ms - TotalBytesReceived: 2.66 GB (2855054965) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 17s001ms - NumBatchesAccepted: 113.87K (113868) - NumBatchesRejected: 107 (107) Instance 5f429df048b5534b:41bcce18000001e1 (host=foo.187.46:22000):(Total: 10m35s, non-child: 4s476ms, % non-child: 0.70%) MemoryUsage(16s000ms): 118.95 MB, 279.65 MB, 289.37 MB, 289.37 MB, 289.37 MB, 350.03 MB, 536.83 MB, 536.90 MB, 536.79 MB, 536.95 MB, 536.72 MB, 536.73 MB, 536.55 MB, 536.73 MB, 536.89 MB, 536.82 MB, 536.86 MB, 536.43 MB, 536.72 MB, 536.95 MB, 536.90 MB, 536.86 MB, 536.56 MB, 536.67 MB, 536.75 MB, 536.65 MB, 536.39 MB, 536.80 MB, 536.58 MB, 536.85 MB, 536.49 MB, 536.77 MB, 536.46 MB, 536.66 MB, 536.90 MB, 536.92 MB, 536.78 MB, 536.94 MB, 536.58 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.19 MB (572719369) - PerHostPeakMemUsage: 1.36 GB (1457509964) - RowsProduced: 1.43M (1432836) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 160.158ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.65K (7652) - TotalThreadsTotalWallClockTime: 12m9s - TotalThreadsSysTime: 2s341ms - TotalThreadsUserTime: 21s446ms - TotalThreadsVoluntaryContextSwitches: 122.69K (122692) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 39.839ms - ExecTreePrepareTime: 456.790us DataStreamSender (dst_id=23):(Total: 3s671ms, non-child: 3s671ms, % non-child: 100.00%) - BytesSent: 253.57 MB (265883059) - OverallThroughput: 69.05 MB/sec - PeakMemoryUsage: 6.40 MB (6709632) - RowsReturned: 1.43M (1432836) - SerializeBatchTime: 3s667ms - UncompressedRowBatchSize: 253.57 MB (265883059) CodeGen:(Total: 454.872ms, non-child: 454.872ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 136.104ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 288.304ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.807ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 305.996ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 750.587us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490478) - ProbeRows: 1.43M (1432836) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 292.840ms - RowsReturned: 1.43M (1432836) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 106.044us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 238.740us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 178.365us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s650ms, non-child: 24.916us, % non-child: 0.00%) - ConvertRowBatchTime: 10.695us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 166.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 254.920ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s650ms - DataArrivalTimer: 1s650ms SenderSide: - DeserializeRowBatchTimer: 74.689us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s719ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500179) - BuildTime: 5s006ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660109) - ProbeRows: 19.57M (19571065) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s281ms - RowsReturned: 1.43M (1432836) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s386ms - BuildRowsPartitioned: 9.50M (9500179) - GetNewBlockTime: 1.299ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.15K (50153) - HashTablesBuildTime: 605.409ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 379.834ms, % non-child: 0.44%) - ConvertRowBatchTime: 268.039ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500179) - RowsReturnedRate: 109.36 K/sec RecvrSide: BytesReceived(16s000ms): 52.98 MB, 162.73 MB, 207.73 MB, 219.12 MB, 222.92 MB, 224.08 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 1s781ms - TotalBytesReceived: 224.21 MB (235102003) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s732ms - NumBatchesAccepted: 16.92K (16916) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s378ms, % non-child: 0.25%) - ConvertRowBatchTime: 728.853ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571065) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.55 MB, 10.01 MB, 10.01 MB, 10.01 MB, 17.34 MB, 219.91 MB, 580.34 MB, 998.69 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s118ms - TotalBytesReceived: 2.66 GB (2854170418) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s848ms - NumBatchesAccepted: 113.86K (113855) - NumBatchesRejected: 99 (99) Instance 5f429df048b5534b:41bcce18000001b7 (host=foo.221.15:22000):(Total: 10m35s, non-child: 5s099ms, % non-child: 0.80%) MemoryUsage(16s000ms): 123.10 MB, 284.17 MB, 289.39 MB, 289.39 MB, 289.39 MB, 373.27 MB, 537.05 MB, 536.93 MB, 537.13 MB, 536.79 MB, 536.70 MB, 536.78 MB, 536.66 MB, 536.87 MB, 536.85 MB, 536.59 MB, 536.64 MB, 536.62 MB, 536.65 MB, 536.87 MB, 536.49 MB, 536.65 MB, 536.65 MB, 536.86 MB, 536.74 MB, 536.77 MB, 536.73 MB, 536.68 MB, 536.61 MB, 536.67 MB, 536.65 MB, 536.91 MB, 536.61 MB, 536.52 MB, 536.46 MB, 536.79 MB, 536.61 MB, 537.21 MB, 536.75 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.19 MB (572722216) - PerHostPeakMemUsage: 1.42 GB (1528716801) - RowsProduced: 1.43M (1433496) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 777.605ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.51K (7506) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s270ms - TotalThreadsUserTime: 21s343ms - TotalThreadsVoluntaryContextSwitches: 122.65K (122653) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.558ms - ExecTreePrepareTime: 566.769us DataStreamSender (dst_id=23):(Total: 3s679ms, non-child: 3s679ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265986258) - OverallThroughput: 68.93 MB/sec - PeakMemoryUsage: 6.27 MB (6578560) - RowsReturned: 1.43M (1433496) - SerializeBatchTime: 3s675ms - UncompressedRowBatchSize: 253.66 MB (265986258) CodeGen:(Total: 481.905ms, non-child: 481.905ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 144.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 314.899ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.137ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 307.269ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 379.831us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4497546) - ProbeRows: 1.43M (1433496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.480ms - RowsReturned: 1.43M (1433496) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.115us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 148.844us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.257us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s250ms, non-child: 17.915us, % non-child: 0.00%) - ConvertRowBatchTime: 8.098us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 219.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s250ms - DataArrivalTimer: 1s250ms SenderSide: - DeserializeRowBatchTimer: 48.404us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s618ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497961) - BuildTime: 4s889ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660000) - ProbeRows: 19.57M (19565568) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s229ms - RowsReturned: 1.43M (1433496) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s184ms - BuildRowsPartitioned: 9.50M (9497961) - GetNewBlockTime: 1.434ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.32K (50318) - HashTablesBuildTime: 691.068ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 383.381ms, % non-child: 0.45%) - ConvertRowBatchTime: 271.955ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497961) - RowsReturnedRate: 110.94 K/sec RecvrSide: BytesReceived(16s000ms): 56.43 MB, 165.01 MB, 208.30 MB, 219.28 MB, 222.94 MB, 224.04 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 1s367ms - TotalBytesReceived: 224.16 MB (235050210) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s674ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s375ms, % non-child: 0.25%) - ConvertRowBatchTime: 720.710ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19565568) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.86 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.61 MB, 229.43 MB, 591.94 MB, 1011.86 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s681ms - TotalBytesReceived: 2.66 GB (2853785483) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s618ms - NumBatchesAccepted: 113.83K (113827) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001dd (host=foo.221.27:22000):(Total: 10m35s, non-child: 4s727ms, % non-child: 0.74%) MemoryUsage(16s000ms): 123.35 MB, 284.23 MB, 289.36 MB, 289.36 MB, 289.36 MB, 364.60 MB, 536.82 MB, 536.89 MB, 537.12 MB, 536.77 MB, 536.81 MB, 536.71 MB, 536.81 MB, 536.61 MB, 536.60 MB, 536.74 MB, 536.71 MB, 536.89 MB, 536.90 MB, 536.80 MB, 536.40 MB, 536.77 MB, 536.81 MB, 536.57 MB, 536.78 MB, 536.73 MB, 536.69 MB, 536.78 MB, 536.74 MB, 536.71 MB, 536.54 MB, 536.85 MB, 536.65 MB, 536.46 MB, 536.63 MB, 536.81 MB, 536.50 MB, 536.82 MB, 536.32 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.04 MB (572566990) - PerHostPeakMemUsage: 1.20 GB (1292996464) - RowsProduced: 1.43M (1432875) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 563.783ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.06K (8060) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s279ms - TotalThreadsUserTime: 20s896ms - TotalThreadsVoluntaryContextSwitches: 122.26K (122258) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.357ms - ExecTreePrepareTime: 920.457us DataStreamSender (dst_id=23):(Total: 3s625ms, non-child: 3s625ms, % non-child: 100.00%) - BytesSent: 253.64 MB (265955745) - OverallThroughput: 69.96 MB/sec - PeakMemoryUsage: 6.30 MB (6603136) - RowsReturned: 1.43M (1432875) - SerializeBatchTime: 3s620ms - UncompressedRowBatchSize: 253.64 MB (265955745) CodeGen:(Total: 462.870ms, non-child: 462.870ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 154.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 280.845ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.966ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 277.344ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 366.338us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489828) - ProbeRows: 1.43M (1432875) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 265.363ms - RowsReturned: 1.43M (1432875) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.708us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 149.447us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 77.874us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s195ms, non-child: 20.161us, % non-child: 0.00%) - ConvertRowBatchTime: 7.614us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 229.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s195ms - DataArrivalTimer: 1s195ms SenderSide: - DeserializeRowBatchTimer: 102.770us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s226ms, % non-child: 1.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498067) - BuildTime: 4s762ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546666666) - ProbeRows: 19.57M (19568830) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s901ms - RowsReturned: 1.43M (1432875) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s090ms - BuildRowsPartitioned: 9.50M (9498067) - GetNewBlockTime: 1.736ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.26K (50260) - HashTablesBuildTime: 658.150ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 372.357ms, % non-child: 0.43%) - ConvertRowBatchTime: 262.967ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498067) - RowsReturnedRate: 110.04 K/sec RecvrSide: BytesReceived(16s000ms): 57.04 MB, 165.34 MB, 208.38 MB, 219.27 MB, 222.94 MB, 224.04 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 1s307ms - TotalBytesReceived: 224.15 MB (235043452) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s632ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s398ms, % non-child: 0.25%) - ConvertRowBatchTime: 720.882ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568830) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.90 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.82 MB, 231.22 MB, 594.11 MB, 1014.39 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s658ms - TotalBytesReceived: 2.66 GB (2853995026) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s314ms - NumBatchesAccepted: 113.83K (113835) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001cb (host=foo.187.41:22000):(Total: 10m35s, non-child: 4s624ms, % non-child: 0.73%) MemoryUsage(16s000ms): 118.88 MB, 279.84 MB, 289.40 MB, 289.40 MB, 289.40 MB, 368.69 MB, 537.05 MB, 536.47 MB, 537.08 MB, 537.07 MB, 536.78 MB, 536.82 MB, 536.83 MB, 536.68 MB, 537.09 MB, 536.64 MB, 536.93 MB, 537.04 MB, 536.66 MB, 536.77 MB, 536.83 MB, 536.64 MB, 536.56 MB, 536.76 MB, 536.81 MB, 536.60 MB, 536.62 MB, 536.75 MB, 536.92 MB, 536.42 MB, 536.63 MB, 536.59 MB, 536.59 MB, 536.91 MB, 536.56 MB, 536.27 MB, 536.59 MB, 536.74 MB, 536.64 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.23 MB (572767214) - PerHostPeakMemUsage: 1.30 GB (1397928494) - RowsProduced: 1.43M (1430873) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 171.107ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.13K (8129) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s450ms - TotalThreadsUserTime: 21s288ms - TotalThreadsVoluntaryContextSwitches: 122.91K (122907) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.350ms - ExecTreePrepareTime: 363.953us DataStreamSender (dst_id=23):(Total: 3s674ms, non-child: 3s674ms, % non-child: 100.00%) - BytesSent: 253.30 MB (265604658) - OverallThroughput: 68.94 MB/sec - PeakMemoryUsage: 6.65 MB (6971776) - RowsReturned: 1.43M (1430873) - SerializeBatchTime: 3s669ms - UncompressedRowBatchSize: 253.30 MB (265604658) CodeGen:(Total: 521.444ms, non-child: 521.444ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 187.861ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 310.636ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.393ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 311.408ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 456.504us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493016) - ProbeRows: 1.43M (1430873) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 298.734ms - RowsReturned: 1.43M (1430873) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.971us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 248.263us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.681us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s594ms, non-child: 22.057us, % non-child: 0.00%) - ConvertRowBatchTime: 7.851us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 171.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 179.956ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s594ms - DataArrivalTimer: 1s594ms SenderSide: - DeserializeRowBatchTimer: 113.758us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s623ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497523) - BuildTime: 4s758ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664333) - ProbeRows: 19.57M (19569695) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s283ms - RowsReturned: 1.43M (1430873) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s139ms - BuildRowsPartitioned: 9.50M (9497523) - GetNewBlockTime: 3.091ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.03K (50035) - HashTablesBuildTime: 603.016ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 379.659ms, % non-child: 0.44%) - ConvertRowBatchTime: 266.728ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497523) - RowsReturnedRate: 110.42 K/sec RecvrSide: BytesReceived(16s000ms): 54.10 MB, 163.51 MB, 207.87 MB, 219.11 MB, 222.88 MB, 224.02 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 1s710ms - TotalBytesReceived: 224.15 MB (235033139) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s604ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s395ms, % non-child: 0.25%) - ConvertRowBatchTime: 733.873ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569695) - RowsReturnedRate: 35.62 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.67 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.05 MB, 222.53 MB, 583.76 MB, 1002.23 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s039ms - TotalBytesReceived: 2.66 GB (2854013160) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s748ms - NumBatchesAccepted: 113.84K (113841) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce18000001d9 (host=foo.187.39:22000):(Total: 10m35s, non-child: 4s459ms, % non-child: 0.70%) MemoryUsage(16s000ms): 118.88 MB, 279.84 MB, 289.39 MB, 289.39 MB, 289.39 MB, 359.37 MB, 536.80 MB, 536.68 MB, 537.29 MB, 537.04 MB, 536.76 MB, 536.76 MB, 536.91 MB, 536.84 MB, 536.87 MB, 536.33 MB, 536.73 MB, 536.40 MB, 536.75 MB, 536.84 MB, 536.61 MB, 536.97 MB, 536.72 MB, 536.67 MB, 536.75 MB, 536.55 MB, 536.59 MB, 536.72 MB, 536.73 MB, 536.83 MB, 536.69 MB, 536.64 MB, 536.44 MB, 536.80 MB, 537.22 MB, 536.42 MB, 536.89 MB, 536.97 MB, 536.96 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.27 MB (572808653) - PerHostPeakMemUsage: 1.31 GB (1408008825) - RowsProduced: 1.43M (1430815) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 150.925ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.00K (7997) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s335ms - TotalThreadsUserTime: 21s809ms - TotalThreadsVoluntaryContextSwitches: 123.04K (123039) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 36.328ms - ExecTreePrepareTime: 388.261us DataStreamSender (dst_id=23):(Total: 3s711ms, non-child: 3s711ms, % non-child: 100.00%) - BytesSent: 253.21 MB (265509714) - OverallThroughput: 68.22 MB/sec - PeakMemoryUsage: 6.26 MB (6562176) - RowsReturned: 1.43M (1430815) - SerializeBatchTime: 3s707ms - UncompressedRowBatchSize: 253.21 MB (265509714) CodeGen:(Total: 448.967ms, non-child: 448.967ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 156.033ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 264.979ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.439ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 310.741ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 802.225us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4661472) - ProbeRows: 1.43M (1430815) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 298.987ms - RowsReturned: 1.43M (1430815) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60.769us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 376.790us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.467us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s627ms, non-child: 26.610us, % non-child: 0.00%) - ConvertRowBatchTime: 11.968us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 168.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 235.450ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s627ms - DataArrivalTimer: 1s627ms SenderSide: - DeserializeRowBatchTimer: 377.670us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s811ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498119) - BuildTime: 5s179ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659872) - ProbeRows: 19.57M (19571122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s326ms - RowsReturned: 1.43M (1430815) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s564ms - BuildRowsPartitioned: 9.50M (9498119) - GetNewBlockTime: 1.773ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.76K (49762) - HashTablesBuildTime: 600.157ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 392.279ms, % non-child: 0.45%) - ConvertRowBatchTime: 276.716ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498119) - RowsReturnedRate: 110.08 K/sec RecvrSide: BytesReceived(16s000ms): 54.13 MB, 163.48 MB, 207.90 MB, 219.14 MB, 222.89 MB, 224.03 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 1s764ms - TotalBytesReceived: 224.15 MB (235041882) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s651ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s392ms, % non-child: 0.25%) - ConvertRowBatchTime: 735.330ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571122) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.66 MB, 10.02 MB, 10.02 MB, 10.02 MB, 17.92 MB, 222.60 MB, 583.70 MB, 1002.54 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s099ms - TotalBytesReceived: 2.66 GB (2854270870) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s686ms - NumBatchesAccepted: 113.84K (113839) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001fe (host=foo.232.29:22000):(Total: 10m35s, non-child: 5s606ms, % non-child: 0.88%) MemoryUsage(16s000ms): 139.83 MB, 285.13 MB, 289.40 MB, 289.40 MB, 289.40 MB, 370.85 MB, 537.28 MB, 536.65 MB, 537.27 MB, 537.00 MB, 536.71 MB, 536.82 MB, 536.88 MB, 536.39 MB, 536.76 MB, 536.63 MB, 536.61 MB, 536.82 MB, 536.73 MB, 536.70 MB, 536.51 MB, 536.62 MB, 536.80 MB, 536.62 MB, 536.73 MB, 536.59 MB, 536.79 MB, 536.67 MB, 536.84 MB, 536.76 MB, 536.69 MB, 536.60 MB, 536.94 MB, 536.77 MB, 536.37 MB, 536.45 MB, 536.65 MB, 537.11 MB, 536.78 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.03 MB (572555462) - PerHostPeakMemUsage: 1.40 GB (1507296406) - RowsProduced: 1.43M (1431516) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 1s069ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.85K (7847) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s370ms - TotalThreadsUserTime: 21s328ms - TotalThreadsVoluntaryContextSwitches: 122.53K (122529) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 45.945ms - ExecTreePrepareTime: 478.654us DataStreamSender (dst_id=23):(Total: 3s616ms, non-child: 3s616ms, % non-child: 100.00%) - BytesSent: 253.27 MB (265573673) - OverallThroughput: 70.03 MB/sec - PeakMemoryUsage: 6.40 MB (6709632) - RowsReturned: 1.43M (1431516) - SerializeBatchTime: 3s612ms - UncompressedRowBatchSize: 253.27 MB (265573673) CodeGen:(Total: 449.826ms, non-child: 449.826ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 280.615ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 37.180ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 294.657ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 588.822us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4660746) - ProbeRows: 1.43M (1431516) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.144ms - RowsReturned: 1.43M (1431516) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53.618us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 353.801us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.700us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 434.733ms, non-child: 17.748us, % non-child: 0.00%) - ConvertRowBatchTime: 7.865us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 630.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 434.719ms - DataArrivalTimer: 434.716ms SenderSide: - DeserializeRowBatchTimer: 195.218us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s533ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500799) - BuildTime: 5s102ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661242) - ProbeRows: 19.58M (19576029) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s025ms - RowsReturned: 1.43M (1431516) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s388ms - BuildRowsPartitioned: 9.50M (9500799) - GetNewBlockTime: 2.312ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.04K (50038) - HashTablesBuildTime: 698.692ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 388.410ms, % non-child: 0.45%) - ConvertRowBatchTime: 272.232ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500799) - RowsReturnedRate: 110.87 K/sec RecvrSide: BytesReceived(16s000ms): 63.57 MB, 169.30 MB, 209.49 MB, 219.62 MB, 223.11 MB, 224.11 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB - FirstBatchArrivalWaitTime: 548.898ms - TotalBytesReceived: 224.22 MB (235106847) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s736ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s413ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.554ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576029) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.45 MB, 10.02 MB, 10.02 MB, 10.02 MB, 24.20 MB, 248.49 MB, 614.51 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s873ms - TotalBytesReceived: 2.66 GB (2855080764) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s337ms - NumBatchesAccepted: 113.87K (113874) - NumBatchesRejected: 112 (112) Instance 5f429df048b5534b:41bcce1800000201 (host=foo.221.25:22000):(Total: 10m35s, non-child: 4s574ms, % non-child: 0.72%) MemoryUsage(16s000ms): 122.95 MB, 283.98 MB, 289.39 MB, 289.39 MB, 289.39 MB, 354.27 MB, 536.80 MB, 537.03 MB, 536.72 MB, 537.11 MB, 536.83 MB, 536.64 MB, 536.87 MB, 536.71 MB, 536.69 MB, 536.43 MB, 536.74 MB, 536.17 MB, 536.48 MB, 536.83 MB, 536.77 MB, 536.49 MB, 536.51 MB, 536.69 MB, 536.81 MB, 536.74 MB, 536.64 MB, 536.48 MB, 536.69 MB, 536.72 MB, 536.65 MB, 536.68 MB, 536.82 MB, 536.58 MB, 536.63 MB, 536.96 MB, 536.79 MB, 535.88 MB, 536.67 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.58 MB (573131203) - PerHostPeakMemUsage: 1.32 GB (1416696524) - RowsProduced: 1.43M (1433199) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 337.378ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.31K (8312) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s287ms - TotalThreadsUserTime: 21s685ms - TotalThreadsVoluntaryContextSwitches: 121.96K (121964) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 38.351ms - ExecTreePrepareTime: 380.392us DataStreamSender (dst_id=23):(Total: 3s632ms, non-child: 3s632ms, % non-child: 100.00%) - BytesSent: 253.63 MB (265955030) - OverallThroughput: 69.83 MB/sec - PeakMemoryUsage: 6.62 MB (6939008) - RowsReturned: 1.43M (1433199) - SerializeBatchTime: 3s627ms - UncompressedRowBatchSize: 253.63 MB (265955030) CodeGen:(Total: 473.603ms, non-child: 473.603ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 157.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 286.915ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.458ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 290.608ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 727.102us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4664557) - ProbeRows: 1.43M (1433199) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 279.235ms - RowsReturned: 1.43M (1433199) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53.332us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 522.546us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.912us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s188ms, non-child: 12.056us, % non-child: 0.00%) - ConvertRowBatchTime: 5.059us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 230.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s188ms - DataArrivalTimer: 1s188ms SenderSide: - DeserializeRowBatchTimer: 59.433us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s684ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9505952) - BuildTime: 4s923ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546655388) - ProbeRows: 19.57M (19574320) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s181ms - RowsReturned: 1.43M (1433199) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s211ms - BuildRowsPartitioned: 9.51M (9505952) - GetNewBlockTime: 1.183ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.98K (49977) - HashTablesBuildTime: 701.261ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 378.293ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.098ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9505952) - RowsReturnedRate: 109.70 K/sec RecvrSide: BytesReceived(16s000ms): 55.42 MB, 164.45 MB, 208.23 MB, 219.35 MB, 223.09 MB, 224.22 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB - FirstBatchArrivalWaitTime: 1s312ms - TotalBytesReceived: 224.34 MB (235234650) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s352ms - NumBatchesAccepted: 16.92K (16918) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s404ms, % non-child: 0.26%) - ConvertRowBatchTime: 739.748ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574320) - RowsReturnedRate: 35.69 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.75 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.66 MB, 226.43 MB, 588.11 MB, 1007.84 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s663ms - TotalBytesReceived: 2.66 GB (2854995426) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s785ms - NumBatchesAccepted: 113.87K (113867) - NumBatchesRejected: 109 (109) Instance 5f429df048b5534b:41bcce1800000202 (host=foo.232.17:22000):(Total: 10m35s, non-child: 5s331ms, % non-child: 0.84%) MemoryUsage(16s000ms): 139.82 MB, 285.09 MB, 289.39 MB, 289.39 MB, 289.39 MB, 370.77 MB, 536.89 MB, 536.72 MB, 536.77 MB, 536.78 MB, 536.81 MB, 536.83 MB, 536.70 MB, 536.88 MB, 536.70 MB, 536.85 MB, 536.68 MB, 537.21 MB, 536.84 MB, 536.79 MB, 536.84 MB, 536.80 MB, 536.68 MB, 536.71 MB, 536.70 MB, 536.55 MB, 536.86 MB, 536.65 MB, 536.74 MB, 536.76 MB, 536.88 MB, 536.45 MB, 536.82 MB, 536.70 MB, 536.43 MB, 536.63 MB, 536.55 MB, 536.61 MB, 536.98 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.32 MB (572863263) - PerHostPeakMemUsage: 1.41 GB (1512670434) - RowsProduced: 1.43M (1431236) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 882.251ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.06K (8060) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s229ms - TotalThreadsUserTime: 21s306ms - TotalThreadsVoluntaryContextSwitches: 122.48K (122478) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 44.605ms - ExecTreePrepareTime: 554.682us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.28 MB (265585482) - OverallThroughput: 69.55 MB/sec - PeakMemoryUsage: 6.38 MB (6685056) - RowsReturned: 1.43M (1431236) - SerializeBatchTime: 3s637ms - UncompressedRowBatchSize: 253.28 MB (265585482) CodeGen:(Total: 470.460ms, non-child: 470.460ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 148.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 288.109ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.576ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 285.217ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 712.876us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490748) - ProbeRows: 1.43M (1431236) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 273.258ms - RowsReturned: 1.43M (1431236) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.258us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 421.430us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.242us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 79.988ms, non-child: 18.372us, % non-child: 0.02%) - ConvertRowBatchTime: 7.531us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 3.42 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 79.973ms - DataArrivalTimer: 79.971ms SenderSide: - DeserializeRowBatchTimer: 42.555us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s452ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503031) - BuildTime: 5s047ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660850) - ProbeRows: 19.57M (19571409) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s976ms - RowsReturned: 1.43M (1431236) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s374ms - BuildRowsPartitioned: 9.50M (9503031) - GetNewBlockTime: 2.628ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.50K (49502) - HashTablesBuildTime: 658.946ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 400.827ms, % non-child: 0.47%) - ConvertRowBatchTime: 278.482ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503031) - RowsReturnedRate: 111.04 K/sec RecvrSide: BytesReceived(16s000ms): 63.44 MB, 169.29 MB, 209.52 MB, 219.66 MB, 223.16 MB, 224.17 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB - FirstBatchArrivalWaitTime: 420.429ms - TotalBytesReceived: 224.27 MB (235168499) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s821ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s393ms, % non-child: 0.25%) - ConvertRowBatchTime: 718.380ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571409) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.42 MB, 10.02 MB, 10.02 MB, 10.02 MB, 24.05 MB, 248.00 MB, 614.19 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s748ms - TotalBytesReceived: 2.66 GB (2854485973) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s417ms - NumBatchesAccepted: 113.85K (113850) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001fc (host=foo.221.19:22000):(Total: 10m35s, non-child: 4s620ms, % non-child: 0.73%) MemoryUsage(16s000ms): 122.95 MB, 283.97 MB, 289.37 MB, 289.38 MB, 289.37 MB, 354.78 MB, 536.88 MB, 537.21 MB, 536.94 MB, 536.84 MB, 537.01 MB, 536.96 MB, 536.81 MB, 536.62 MB, 536.57 MB, 536.75 MB, 536.66 MB, 536.29 MB, 536.52 MB, 536.87 MB, 536.74 MB, 536.63 MB, 536.70 MB, 536.77 MB, 536.56 MB, 536.74 MB, 536.79 MB, 536.71 MB, 536.67 MB, 536.71 MB, 536.60 MB, 536.75 MB, 536.91 MB, 536.71 MB, 536.59 MB, 536.22 MB, 536.68 MB, 536.37 MB, 536.93 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.59 MB (573142734) - PerHostPeakMemUsage: 1.22 GB (1309530511) - RowsProduced: 1.43M (1432045) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 105.415ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.95K (7954) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s301ms - TotalThreadsUserTime: 21s254ms - TotalThreadsVoluntaryContextSwitches: 123.36K (123361) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 35.236ms - ExecTreePrepareTime: 444.979us DataStreamSender (dst_id=23):(Total: 3s667ms, non-child: 3s667ms, % non-child: 100.00%) - BytesSent: 253.44 MB (265748105) - OverallThroughput: 69.11 MB/sec - PeakMemoryUsage: 6.09 MB (6381952) - RowsReturned: 1.43M (1432045) - SerializeBatchTime: 3s662ms - UncompressedRowBatchSize: 253.44 MB (265748105) CodeGen:(Total: 474.318ms, non-child: 474.318ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 153.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 295.309ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.760ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 281.330ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 2.076ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489636) - ProbeRows: 1.43M (1432045) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 269.505ms - RowsReturned: 1.43M (1432045) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 48.830us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.440ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.835us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 966.273ms, non-child: 30.266us, % non-child: 0.00%) - ConvertRowBatchTime: 18.823us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 283.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 966.247ms - DataArrivalTimer: 966.244ms SenderSide: - DeserializeRowBatchTimer: 36.428us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s533ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9495519) - BuildTime: 4s637ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546655747) - ProbeRows: 19.58M (19577510) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s069ms - RowsReturned: 1.43M (1432045) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s941ms - BuildRowsPartitioned: 9.50M (9495519) - GetNewBlockTime: 1.424ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.62K (49624) - HashTablesBuildTime: 682.726ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 375.185ms, % non-child: 0.43%) - ConvertRowBatchTime: 264.475ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9495519) - RowsReturnedRate: 109.28 K/sec RecvrSide: BytesReceived(16s000ms): 55.42 MB, 164.30 MB, 208.05 MB, 219.15 MB, 222.86 MB, 223.98 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB - FirstBatchArrivalWaitTime: 1s310ms - TotalBytesReceived: 224.10 MB (234986881) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s539ms - NumBatchesAccepted: 16.90K (16898) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s409ms, % non-child: 0.26%) - ConvertRowBatchTime: 726.431ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577510) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.75 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.75 MB, 226.94 MB, 588.85 MB, 1008.37 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s656ms - TotalBytesReceived: 2.66 GB (2855319454) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 17s164ms - NumBatchesAccepted: 113.89K (113887) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce18000001fa (host=foo.187.56:22000):(Total: 10m35s, non-child: 4s572ms, % non-child: 0.72%) MemoryUsage(16s000ms): 122.95 MB, 283.93 MB, 289.40 MB, 289.40 MB, 289.40 MB, 354.38 MB, 536.68 MB, 536.66 MB, 536.85 MB, 536.61 MB, 536.55 MB, 536.63 MB, 536.75 MB, 536.94 MB, 536.62 MB, 536.51 MB, 536.69 MB, 536.60 MB, 536.59 MB, 536.72 MB, 536.87 MB, 536.69 MB, 536.87 MB, 536.88 MB, 536.80 MB, 536.67 MB, 536.76 MB, 536.77 MB, 536.70 MB, 536.79 MB, 536.61 MB, 536.81 MB, 536.47 MB, 536.46 MB, 536.74 MB, 536.87 MB, 536.99 MB, 536.26 MB, 536.70 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.16 MB (572692097) - PerHostPeakMemUsage: 1.25 GB (1340240933) - RowsProduced: 1.43M (1433293) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 198.928ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.83K (7831) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s308ms - TotalThreadsUserTime: 21s128ms - TotalThreadsVoluntaryContextSwitches: 123.01K (123006) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 41.042ms - ExecTreePrepareTime: 337.559us DataStreamSender (dst_id=23):(Total: 3s617ms, non-child: 3s617ms, % non-child: 100.00%) - BytesSent: 253.56 MB (265882042) - OverallThroughput: 70.10 MB/sec - PeakMemoryUsage: 6.32 MB (6627712) - RowsReturned: 1.43M (1433293) - SerializeBatchTime: 3s612ms - UncompressedRowBatchSize: 253.56 MB (265882042) CodeGen:(Total: 465.849ms, non-child: 465.849ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 165.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 268.359ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 31.178ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 301.049ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 530.459us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4663492) - ProbeRows: 1.43M (1433293) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.392ms - RowsReturned: 1.43M (1433293) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.664us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 361.155us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.925us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s326ms, non-child: 10.626us, % non-child: 0.00%) - ConvertRowBatchTime: 4.459us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 206.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s326ms - DataArrivalTimer: 1s326ms SenderSide: - DeserializeRowBatchTimer: 107.951us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s468ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501607) - BuildTime: 4s766ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662259) - ProbeRows: 19.57M (19567054) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s089ms - RowsReturned: 1.43M (1433293) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s151ms - BuildRowsPartitioned: 9.50M (9501607) - GetNewBlockTime: 1.462ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.20K (50203) - HashTablesBuildTime: 600.305ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 380.086ms, % non-child: 0.44%) - ConvertRowBatchTime: 270.276ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501607) - RowsReturnedRate: 109.45 K/sec RecvrSide: BytesReceived(16s000ms): 55.03 MB, 164.12 MB, 208.12 MB, 219.25 MB, 222.98 MB, 224.12 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 1s440ms - TotalBytesReceived: 224.24 MB (235137178) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s633ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s381ms, % non-child: 0.25%) - ConvertRowBatchTime: 729.839ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19567054) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.72 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.49 MB, 225.36 MB, 587.04 MB, 1006.25 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.08 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s772ms - TotalBytesReceived: 2.66 GB (2853623199) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s858ms - NumBatchesAccepted: 113.83K (113830) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001b3 (host=foo.221.11:22000):(Total: 10m35s, non-child: 4s930ms, % non-child: 0.78%) MemoryUsage(16s000ms): 122.95 MB, 283.91 MB, 289.39 MB, 289.39 MB, 289.39 MB, 370.75 MB, 536.65 MB, 536.85 MB, 536.87 MB, 536.62 MB, 536.66 MB, 536.65 MB, 536.64 MB, 536.77 MB, 536.86 MB, 536.78 MB, 536.81 MB, 536.70 MB, 536.75 MB, 536.57 MB, 536.44 MB, 536.54 MB, 536.90 MB, 536.53 MB, 536.61 MB, 536.69 MB, 536.58 MB, 536.65 MB, 536.72 MB, 536.71 MB, 536.62 MB, 536.99 MB, 536.66 MB, 536.56 MB, 536.75 MB, 536.68 MB, 536.91 MB, 536.29 MB, 537.22 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.32 MB (572860815) - PerHostPeakMemUsage: 1.39 GB (1488551165) - RowsProduced: 1.43M (1432176) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 616.359ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.72K (7724) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s343ms - TotalThreadsUserTime: 21s224ms - TotalThreadsVoluntaryContextSwitches: 122.76K (122763) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 37.837ms - ExecTreePrepareTime: 416.726us DataStreamSender (dst_id=23):(Total: 3s627ms, non-child: 3s627ms, % non-child: 100.00%) - BytesSent: 253.45 MB (265759459) - OverallThroughput: 69.88 MB/sec - PeakMemoryUsage: 6.09 MB (6390144) - RowsReturned: 1.43M (1432176) - SerializeBatchTime: 3s623ms - UncompressedRowBatchSize: 253.45 MB (265759459) CodeGen:(Total: 480.953ms, non-child: 480.953ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 149.967ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 302.898ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.393ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 292.762ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 311.328us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4495363) - ProbeRows: 1.43M (1432176) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 280.780ms - RowsReturned: 1.43M (1432176) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.621us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 135.250us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.959us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s229ms, non-child: 15.974us, % non-child: 0.00%) - ConvertRowBatchTime: 8.822us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 222.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s229ms - DataArrivalTimer: 1s229ms SenderSide: - DeserializeRowBatchTimer: 41.656us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s360ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502993) - BuildTime: 5s021ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661348) - ProbeRows: 19.57M (19573534) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s991ms - RowsReturned: 1.43M (1432176) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s400ms - BuildRowsPartitioned: 9.50M (9502993) - GetNewBlockTime: 2.081ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.30K (50300) - HashTablesBuildTime: 605.440ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 391.202ms, % non-child: 0.46%) - ConvertRowBatchTime: 275.603ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502993) - RowsReturnedRate: 111.30 K/sec RecvrSide: BytesReceived(16s000ms): 54.99 MB, 164.12 MB, 208.18 MB, 219.32 MB, 223.01 MB, 224.14 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB - FirstBatchArrivalWaitTime: 1s357ms - TotalBytesReceived: 224.27 MB (235160621) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s671ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s378ms, % non-child: 0.25%) - ConvertRowBatchTime: 724.612ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573534) - RowsReturnedRate: 35.62 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.71 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.61 MB, 224.90 MB, 586.39 MB, 1005.50 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s709ms - TotalBytesReceived: 2.66 GB (2854613351) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s671ms - NumBatchesAccepted: 113.86K (113864) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001e5 (host=foo.221.40:22000):(Total: 10m35s, non-child: 4s581ms, % non-child: 0.72%) MemoryUsage(16s000ms): 123.42 MB, 284.26 MB, 289.37 MB, 289.37 MB, 289.37 MB, 358.76 MB, 536.92 MB, 536.76 MB, 537.22 MB, 536.78 MB, 536.79 MB, 536.68 MB, 536.67 MB, 536.70 MB, 536.61 MB, 536.88 MB, 536.86 MB, 536.51 MB, 536.95 MB, 536.51 MB, 536.66 MB, 536.79 MB, 536.61 MB, 536.61 MB, 536.78 MB, 536.79 MB, 536.68 MB, 536.80 MB, 536.86 MB, 536.85 MB, 536.68 MB, 536.71 MB, 536.67 MB, 537.06 MB, 536.95 MB, 536.42 MB, 536.58 MB, 536.37 MB, 536.35 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.19 MB (572724259) - PerHostPeakMemUsage: 1.23 GB (1324343334) - RowsProduced: 1.43M (1431453) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 598.206ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.27K (8268) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s259ms - TotalThreadsUserTime: 20s609ms - TotalThreadsVoluntaryContextSwitches: 122.49K (122487) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 40.957ms - ExecTreePrepareTime: 296.162us DataStreamSender (dst_id=23):(Total: 3s580ms, non-child: 3s580ms, % non-child: 100.00%) - BytesSent: 253.35 MB (265656614) - OverallThroughput: 70.77 MB/sec - PeakMemoryUsage: 6.20 MB (6496640) - RowsReturned: 1.43M (1431453) - SerializeBatchTime: 3s576ms - UncompressedRowBatchSize: 253.35 MB (265656614) CodeGen:(Total: 446.051ms, non-child: 446.051ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 138.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 275.130ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.267ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 276.514ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 605.030us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4660231) - ProbeRows: 1.43M (1431453) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.217ms - RowsReturned: 1.43M (1431453) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55.832us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 338.531us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.900us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s018ms, non-child: 16.765us, % non-child: 0.00%) - ConvertRowBatchTime: 7.475us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 268.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s018ms - DataArrivalTimer: 1s018ms SenderSide: - DeserializeRowBatchTimer: 37.035us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s205ms, % non-child: 1.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498573) - BuildTime: 4s772ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661794) - ProbeRows: 19.57M (19572235) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s777ms - RowsReturned: 1.43M (1431453) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s077ms - BuildRowsPartitioned: 9.50M (9498573) - GetNewBlockTime: 1.928ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.02K (50024) - HashTablesBuildTime: 678.667ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 384.893ms, % non-child: 0.44%) - ConvertRowBatchTime: 271.974ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498573) - RowsReturnedRate: 109.73 K/sec RecvrSide: BytesReceived(16s000ms): 57.21 MB, 165.49 MB, 208.42 MB, 219.31 MB, 222.96 MB, 224.05 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 1s137ms - TotalBytesReceived: 224.17 MB (235054050) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s557ms - NumBatchesAccepted: 16.90K (16904) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s368ms, % non-child: 0.25%) - ConvertRowBatchTime: 704.618ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572235) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.92 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.77 MB, 231.11 MB, 593.53 MB, 1013.75 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s486ms - TotalBytesReceived: 2.66 GB (2854362979) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s974ms - NumBatchesAccepted: 113.86K (113855) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce1800000209 (host=foo.187.53:22000):(Total: 10m35s, non-child: 4s233ms, % non-child: 0.67%) MemoryUsage(16s000ms): 122.88 MB, 284.09 MB, 289.40 MB, 289.40 MB, 289.40 MB, 355.74 MB, 536.91 MB, 536.93 MB, 537.05 MB, 537.09 MB, 536.81 MB, 536.71 MB, 536.73 MB, 536.65 MB, 536.95 MB, 536.88 MB, 536.66 MB, 536.54 MB, 536.71 MB, 536.89 MB, 537.02 MB, 536.80 MB, 536.73 MB, 536.74 MB, 536.80 MB, 536.73 MB, 536.74 MB, 536.88 MB, 536.56 MB, 536.93 MB, 536.57 MB, 536.55 MB, 536.85 MB, 536.44 MB, 536.34 MB, 536.66 MB, 536.75 MB, 536.17 MB, 536.98 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.32 MB (572855636) - PerHostPeakMemUsage: 1.23 GB (1320013673) - RowsProduced: 1.43M (1431186) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 135.486ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7856) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s261ms - TotalThreadsUserTime: 21s150ms - TotalThreadsVoluntaryContextSwitches: 122.26K (122258) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 41.754ms - ExecTreePrepareTime: 383.941us DataStreamSender (dst_id=23):(Total: 3s636ms, non-child: 3s636ms, % non-child: 100.00%) - BytesSent: 253.30 MB (265607400) - OverallThroughput: 69.65 MB/sec - PeakMemoryUsage: 6.23 MB (6537600) - RowsReturned: 1.43M (1431186) - SerializeBatchTime: 3s632ms - UncompressedRowBatchSize: 253.30 MB (265607400) CodeGen:(Total: 459.658ms, non-child: 459.658ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 144.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.637ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.492ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 287.453ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 569.708us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4487068) - ProbeRows: 1.43M (1431186) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 275.854ms - RowsReturned: 1.43M (1431186) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 45.024us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 347.406us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.051us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s107ms, non-child: 20.009us, % non-child: 0.00%) - ConvertRowBatchTime: 10.954us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 247.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s107ms - DataArrivalTimer: 1s107ms SenderSide: - DeserializeRowBatchTimer: 48.425us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m27s, non-child: 8s393ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502434) - BuildTime: 4s946ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662577) - ProbeRows: 19.57M (19573901) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s994ms - RowsReturned: 1.43M (1431186) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s270ms - BuildRowsPartitioned: 9.50M (9502434) - GetNewBlockTime: 2.275ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.14K (50143) - HashTablesBuildTime: 664.432ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 379.010ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.391ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502434) - RowsReturnedRate: 109.57 K/sec RecvrSide: BytesReceived(16s000ms): 56.10 MB, 164.84 MB, 208.29 MB, 219.32 MB, 223.02 MB, 224.14 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB - FirstBatchArrivalWaitTime: 1s447ms - TotalBytesReceived: 224.26 MB (235155496) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s649ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s395ms, % non-child: 0.25%) - ConvertRowBatchTime: 720.279ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573901) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.82 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.11 MB, 228.17 MB, 590.43 MB, 1010.13 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s774ms - TotalBytesReceived: 2.66 GB (2854649079) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s950ms - NumBatchesAccepted: 113.86K (113863) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001eb (host=foo.221.24:22000):(Total: 10m35s, non-child: 4s548ms, % non-child: 0.72%) MemoryUsage(16s000ms): 123.35 MB, 284.27 MB, 289.39 MB, 289.39 MB, 289.39 MB, 358.37 MB, 537.43 MB, 536.97 MB, 536.88 MB, 536.83 MB, 536.81 MB, 536.61 MB, 536.57 MB, 536.85 MB, 537.04 MB, 536.61 MB, 536.79 MB, 537.05 MB, 536.89 MB, 536.65 MB, 536.63 MB, 536.89 MB, 536.61 MB, 536.70 MB, 536.80 MB, 536.64 MB, 536.66 MB, 536.61 MB, 536.64 MB, 536.67 MB, 536.55 MB, 536.65 MB, 536.89 MB, 536.61 MB, 536.82 MB, 536.35 MB, 536.68 MB, 536.46 MB, 537.11 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.17 MB (572704479) - PerHostPeakMemUsage: 1.29 GB (1390088687) - RowsProduced: 1.43M (1432013) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 148.340ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.18K (8182) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s306ms - TotalThreadsUserTime: 21s373ms - TotalThreadsVoluntaryContextSwitches: 122.88K (122880) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m32s - ExecTreeOpenTime: 1m31s - PrepareTime: 42.392ms - ExecTreePrepareTime: 370.844us DataStreamSender (dst_id=23):(Total: 3s624ms, non-child: 3s624ms, % non-child: 100.00%) - BytesSent: 253.46 MB (265770261) - OverallThroughput: 69.93 MB/sec - PeakMemoryUsage: 6.12 MB (6414720) - RowsReturned: 1.43M (1432013) - SerializeBatchTime: 3s620ms - UncompressedRowBatchSize: 253.46 MB (265770261) CodeGen:(Total: 474.390ms, non-child: 474.390ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 150.103ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 292.081ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 31.505ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 287.850ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 460.277us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4498838) - ProbeRows: 1.43M (1432013) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 275.604ms - RowsReturned: 1.43M (1432013) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 54.328us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 199.385us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 93.358us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s118ms, non-child: 17.804us, % non-child: 0.00%) - ConvertRowBatchTime: 7.992us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 244.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s118ms - DataArrivalTimer: 1s118ms SenderSide: - DeserializeRowBatchTimer: 58.191us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s570ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500796) - BuildTime: 4s963ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661010) - ProbeRows: 19.57M (19569971) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s084ms - RowsReturned: 1.43M (1432013) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s264ms - BuildRowsPartitioned: 9.50M (9500796) - GetNewBlockTime: 2.226ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.42K (50424) - HashTablesBuildTime: 683.635ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 373.853ms, % non-child: 0.43%) - ConvertRowBatchTime: 266.203ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500796) - RowsReturnedRate: 109.79 K/sec RecvrSide: BytesReceived(16s000ms): 57.33 MB, 165.57 MB, 208.47 MB, 219.35 MB, 223.00 MB, 224.10 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 1s290ms - TotalBytesReceived: 224.21 MB (235103443) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s601ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s391ms, % non-child: 0.25%) - ConvertRowBatchTime: 727.809ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569971) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.93 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.85 MB, 231.48 MB, 594.47 MB, 1014.60 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s644ms - TotalBytesReceived: 2.66 GB (2854300033) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s799ms - NumBatchesAccepted: 113.84K (113843) - NumBatchesRejected: 103 (103) Instance 5f429df048b5534b:41bcce18000001e6 (host=foo.221.43:22000):(Total: 10m35s, non-child: 4s885ms, % non-child: 0.77%) MemoryUsage(16s000ms): 123.43 MB, 284.25 MB, 289.39 MB, 289.39 MB, 289.39 MB, 358.32 MB, 536.72 MB, 537.08 MB, 536.72 MB, 537.19 MB, 536.73 MB, 536.80 MB, 536.64 MB, 536.69 MB, 537.25 MB, 536.80 MB, 537.09 MB, 537.40 MB, 536.79 MB, 536.62 MB, 536.73 MB, 536.62 MB, 536.48 MB, 536.73 MB, 536.79 MB, 536.67 MB, 536.86 MB, 536.78 MB, 536.76 MB, 536.66 MB, 536.76 MB, 536.72 MB, 536.88 MB, 536.93 MB, 536.62 MB, 536.52 MB, 536.57 MB, 536.59 MB, 536.86 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.53 MB (573075662) - PerHostPeakMemUsage: 1.29 GB (1384844262) - RowsProduced: 1.43M (1433445) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 545.504ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.19K (8194) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s433ms - TotalThreadsUserTime: 21s897ms - TotalThreadsVoluntaryContextSwitches: 122.52K (122516) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 35.742ms - ExecTreePrepareTime: 306.010us DataStreamSender (dst_id=23):(Total: 3s661ms, non-child: 3s661ms, % non-child: 100.00%) - BytesSent: 253.69 MB (266010586) - OverallThroughput: 69.28 MB/sec - PeakMemoryUsage: 6.18 MB (6480256) - RowsReturned: 1.43M (1433445) - SerializeBatchTime: 3s657ms - UncompressedRowBatchSize: 253.69 MB (266010586) CodeGen:(Total: 453.546ms, non-child: 453.546ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 150.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 276.054ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.494ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 300.538ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 837.417us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491944) - ProbeRows: 1.43M (1433445) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.424ms - RowsReturned: 1.43M (1433445) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60.035us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 489.959us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.522us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s011ms, non-child: 20.847us, % non-child: 0.00%) - ConvertRowBatchTime: 8.102us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 270.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s011ms - DataArrivalTimer: 1s011ms SenderSide: - DeserializeRowBatchTimer: 92.032us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s846ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501835) - BuildTime: 5s268ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661561) - ProbeRows: 19.58M (19577940) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s200ms - RowsReturned: 1.43M (1433445) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s556ms - BuildRowsPartitioned: 9.50M (9501835) - GetNewBlockTime: 2.063ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.01K (50011) - HashTablesBuildTime: 698.167ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 391.163ms, % non-child: 0.45%) - ConvertRowBatchTime: 276.656ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501835) - RowsReturnedRate: 110.42 K/sec RecvrSide: BytesReceived(16s000ms): 57.21 MB, 165.51 MB, 208.51 MB, 219.38 MB, 223.02 MB, 224.12 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 1s130ms - TotalBytesReceived: 224.24 MB (235130682) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s627ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s402ms, % non-child: 0.26%) - ConvertRowBatchTime: 739.713ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577940) - RowsReturnedRate: 35.73 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.91 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.80 MB, 231.53 MB, 594.37 MB, 1014.77 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s461ms - TotalBytesReceived: 2.66 GB (2855311746) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s798ms - NumBatchesAccepted: 113.89K (113885) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001ca (host=foo.221.26:22000):(Total: 10m35s, non-child: 4s529ms, % non-child: 0.71%) MemoryUsage(16s000ms): 123.36 MB, 284.24 MB, 289.37 MB, 289.38 MB, 289.37 MB, 375.67 MB, 536.71 MB, 536.74 MB, 537.00 MB, 537.04 MB, 536.84 MB, 536.81 MB, 536.64 MB, 536.59 MB, 536.83 MB, 536.70 MB, 536.59 MB, 536.38 MB, 536.74 MB, 536.76 MB, 536.88 MB, 536.71 MB, 536.70 MB, 536.76 MB, 536.68 MB, 536.87 MB, 536.70 MB, 536.67 MB, 536.66 MB, 536.77 MB, 536.77 MB, 536.77 MB, 536.44 MB, 536.69 MB, 536.75 MB, 537.13 MB, 536.96 MB, 536.08 MB, 536.60 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.49 MB (573036585) - PerHostPeakMemUsage: 1.21 GB (1302146071) - RowsProduced: 1.43M (1432268) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 380.461ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.93K (7930) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s354ms - TotalThreadsUserTime: 21s038ms - TotalThreadsVoluntaryContextSwitches: 122.56K (122562) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 36.470ms - ExecTreePrepareTime: 583.040us DataStreamSender (dst_id=23):(Total: 3s586ms, non-child: 3s586ms, % non-child: 100.00%) - BytesSent: 253.36 MB (265664559) - OverallThroughput: 70.65 MB/sec - PeakMemoryUsage: 5.98 MB (6275456) - RowsReturned: 1.43M (1432268) - SerializeBatchTime: 3s582ms - UncompressedRowBatchSize: 253.36 MB (265664559) CodeGen:(Total: 474.610ms, non-child: 474.610ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 144.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 302.433ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.325ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 270.317ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 552.709us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492572) - ProbeRows: 1.43M (1432268) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 258.764ms - RowsReturned: 1.43M (1432268) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 69.808us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 321.439us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 101.000us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s183ms, non-child: 10.961us, % non-child: 0.00%) - ConvertRowBatchTime: 4.082us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 231.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s183ms - DataArrivalTimer: 1s183ms SenderSide: - DeserializeRowBatchTimer: 28.789us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s094ms, % non-child: 1.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9496433) - BuildTime: 4s994ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658278) - ProbeRows: 19.57M (19569047) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s709ms - RowsReturned: 1.43M (1432268) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s346ms - BuildRowsPartitioned: 9.50M (9496433) - GetNewBlockTime: 2.923ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.94K (49939) - HashTablesBuildTime: 632.023ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 384.510ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.605ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9496433) - RowsReturnedRate: 111.20 K/sec RecvrSide: BytesReceived(16s000ms): 57.14 MB, 165.39 MB, 208.34 MB, 219.24 MB, 222.90 MB, 224.00 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB, 224.12 MB - FirstBatchArrivalWaitTime: 1s293ms - TotalBytesReceived: 224.12 MB (235006357) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s717ms - NumBatchesAccepted: 16.90K (16902) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s390ms, % non-child: 0.25%) - ConvertRowBatchTime: 709.793ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569047) - RowsReturnedRate: 35.58 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.91 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.96 MB, 231.38 MB, 594.06 MB, 1014.24 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s633ms - TotalBytesReceived: 2.66 GB (2854079396) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s798ms - NumBatchesAccepted: 113.84K (113840) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001f1 (host=foo.221.29:22000):(Total: 10m35s, non-child: 4s479ms, % non-child: 0.70%) MemoryUsage(16s000ms): 123.35 MB, 284.30 MB, 289.39 MB, 289.39 MB, 289.39 MB, 359.98 MB, 536.67 MB, 537.07 MB, 536.95 MB, 537.16 MB, 536.88 MB, 536.76 MB, 536.77 MB, 536.77 MB, 536.80 MB, 536.86 MB, 536.98 MB, 536.68 MB, 536.72 MB, 536.78 MB, 536.64 MB, 536.72 MB, 536.70 MB, 536.72 MB, 536.75 MB, 536.63 MB, 536.56 MB, 536.76 MB, 536.67 MB, 536.92 MB, 536.64 MB, 537.04 MB, 536.76 MB, 536.34 MB, 536.76 MB, 536.77 MB, 536.72 MB, 536.75 MB, 536.89 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.19 MB (572720772) - PerHostPeakMemUsage: 1.22 GB (1307896255) - RowsProduced: 1.43M (1432933) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 346.279ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.68K (7677) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s211ms - TotalThreadsUserTime: 20s974ms - TotalThreadsVoluntaryContextSwitches: 122.76K (122756) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 34.821ms - ExecTreePrepareTime: 380.125us DataStreamSender (dst_id=23):(Total: 3s639ms, non-child: 3s639ms, % non-child: 100.00%) - BytesSent: 253.55 MB (265871623) - OverallThroughput: 69.66 MB/sec - PeakMemoryUsage: 6.08 MB (6373760) - RowsReturned: 1.43M (1432933) - SerializeBatchTime: 3s635ms - UncompressedRowBatchSize: 253.55 MB (265871623) CodeGen:(Total: 462.964ms, non-child: 462.964ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 156.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 279.712ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.154ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 286.055ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 584.508us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491189) - ProbeRows: 1.43M (1432933) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 274.397ms - RowsReturned: 1.43M (1432933) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62.431us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 245.558us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 110.845us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s119ms, non-child: 21.058us, % non-child: 0.00%) - ConvertRowBatchTime: 11.039us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 244.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s119ms - DataArrivalTimer: 1s119ms SenderSide: - DeserializeRowBatchTimer: 37.596us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s306ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506165) - BuildTime: 4s858ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657763) - ProbeRows: 19.58M (19579715) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s914ms - RowsReturned: 1.43M (1432933) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s220ms - BuildRowsPartitioned: 9.51M (9506165) - GetNewBlockTime: 1.247ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.10K (50105) - HashTablesBuildTime: 622.627ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 384.447ms, % non-child: 0.44%) - ConvertRowBatchTime: 270.402ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506165) - RowsReturnedRate: 109.85 K/sec RecvrSide: BytesReceived(16s000ms): 57.53 MB, 165.79 MB, 208.64 MB, 219.49 MB, 223.14 MB, 224.23 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB - FirstBatchArrivalWaitTime: 1s251ms - TotalBytesReceived: 224.34 MB (235241218) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s760ms - NumBatchesAccepted: 16.92K (16921) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s362ms, % non-child: 0.25%) - ConvertRowBatchTime: 715.181ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19579715) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.94 MB, 10.02 MB, 10.02 MB, 10.02 MB, 20.00 MB, 232.32 MB, 595.37 MB, 1016.10 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s603ms - TotalBytesReceived: 2.66 GB (2855384381) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s306ms - NumBatchesAccepted: 113.90K (113901) - NumBatchesRejected: 103 (103) Instance 5f429df048b5534b:41bcce18000001b0 (host=foo.187.49:22000):(Total: 10m35s, non-child: 4s249ms, % non-child: 0.67%) MemoryUsage(16s000ms): 118.88 MB, 279.70 MB, 289.37 MB, 289.36 MB, 289.37 MB, 368.11 MB, 537.10 MB, 536.75 MB, 536.82 MB, 536.68 MB, 536.81 MB, 536.74 MB, 536.72 MB, 536.99 MB, 536.65 MB, 536.80 MB, 536.73 MB, 536.81 MB, 537.00 MB, 536.65 MB, 536.46 MB, 536.35 MB, 536.59 MB, 536.88 MB, 536.62 MB, 536.83 MB, 536.83 MB, 536.67 MB, 536.72 MB, 536.68 MB, 536.69 MB, 536.88 MB, 536.78 MB, 536.72 MB, 536.73 MB, 536.77 MB, 536.59 MB, 536.42 MB, 536.78 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.18 MB (572714516) - PerHostPeakMemUsage: 1.31 GB (1403865257) - RowsProduced: 1.43M (1432921) - TotalNetworkReceiveTime: 10m36s - TotalNetworkSendTime: 78.654ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.15K (8154) - TotalThreadsTotalWallClockTime: 12m8s - TotalThreadsSysTime: 2s241ms - TotalThreadsUserTime: 20s973ms - TotalThreadsVoluntaryContextSwitches: 122.48K (122484) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 40.220ms - ExecTreePrepareTime: 501.794us DataStreamSender (dst_id=23):(Total: 3s622ms, non-child: 3s622ms, % non-child: 100.00%) - BytesSent: 253.61 MB (265930056) - OverallThroughput: 70.01 MB/sec - PeakMemoryUsage: 6.13 MB (6431104) - RowsReturned: 1.43M (1432921) - SerializeBatchTime: 3s618ms - UncompressedRowBatchSize: 253.61 MB (265930056) CodeGen:(Total: 451.048ms, non-child: 451.048ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 138.430ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.959ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.907ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 300.157ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 227.981us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493137) - ProbeRows: 1.43M (1432921) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 287.690ms - RowsReturned: 1.43M (1432921) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.654us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 64.860us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.557us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s668ms, non-child: 28.943us, % non-child: 0.00%) - ConvertRowBatchTime: 3.838us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 164.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 274.110ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s668ms - DataArrivalTimer: 1s668ms SenderSide: - DeserializeRowBatchTimer: 45.351us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s305ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498263) - BuildTime: 4s567ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662412) - ProbeRows: 19.58M (19575481) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s045ms - RowsReturned: 1.43M (1432921) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s973ms - BuildRowsPartitioned: 9.50M (9498263) - GetNewBlockTime: 1.778ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.15K (50148) - HashTablesBuildTime: 579.953ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 379.387ms, % non-child: 0.44%) - ConvertRowBatchTime: 268.189ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498263) - RowsReturnedRate: 110.13 K/sec RecvrSide: BytesReceived(16s000ms): 53.43 MB, 163.00 MB, 207.75 MB, 219.07 MB, 222.87 MB, 224.02 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 1s796ms - TotalBytesReceived: 224.15 MB (235040947) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s638ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s385ms, % non-child: 0.25%) - ConvertRowBatchTime: 727.564ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575481) - RowsReturnedRate: 35.59 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.58 MB, 10.00 MB, 10.00 MB, 10.00 MB, 17.67 MB, 220.99 MB, 582.28 MB, 1000.82 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s140ms - TotalBytesReceived: 2.66 GB (2855345158) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s451ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 91 (91) Instance 5f429df048b5534b:41bcce18000001e9 (host=foo.232.39:22000):(Total: 10m35s, non-child: 5s705ms, % non-child: 0.90%) MemoryUsage(16s000ms): 140.04 MB, 285.17 MB, 289.40 MB, 289.39 MB, 289.39 MB, 371.77 MB, 536.92 MB, 537.00 MB, 536.90 MB, 536.96 MB, 536.49 MB, 536.69 MB, 536.61 MB, 536.61 MB, 536.88 MB, 536.67 MB, 536.88 MB, 536.59 MB, 536.61 MB, 536.69 MB, 536.51 MB, 536.62 MB, 536.66 MB, 536.70 MB, 536.64 MB, 536.79 MB, 536.68 MB, 536.70 MB, 536.85 MB, 536.52 MB, 536.81 MB, 536.38 MB, 536.69 MB, 537.01 MB, 536.91 MB, 536.48 MB, 536.17 MB, 535.93 MB, 536.61 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.22 MB (572753981) - PerHostPeakMemUsage: 1.33 GB (1428372172) - RowsProduced: 1.43M (1432000) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 1s162ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.74K (7735) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s262ms - TotalThreadsUserTime: 21s672ms - TotalThreadsVoluntaryContextSwitches: 122.14K (122136) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 33.781ms - ExecTreePrepareTime: 436.989us DataStreamSender (dst_id=23):(Total: 3s657ms, non-child: 3s657ms, % non-child: 100.00%) - BytesSent: 253.32 MB (265621209) - OverallThroughput: 69.26 MB/sec - PeakMemoryUsage: 6.32 MB (6627712) - RowsReturned: 1.43M (1432000) - SerializeBatchTime: 3s653ms - UncompressedRowBatchSize: 253.32 MB (265621209) CodeGen:(Total: 445.681ms, non-child: 445.681ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 147.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 273.329ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.303ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 304.091ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 482.636us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489651) - ProbeRows: 1.43M (1432000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 291.788ms - RowsReturned: 1.43M (1432000) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.174us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 323.887us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.690us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 232.620ms, non-child: 14.167us, % non-child: 0.01%) - ConvertRowBatchTime: 7.187us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.18 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 232.608ms - DataArrivalTimer: 232.606ms SenderSide: - DeserializeRowBatchTimer: 149.364us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s645ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504489) - BuildTime: 5s191ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658661) - ProbeRows: 19.56M (19561834) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s127ms - RowsReturned: 1.43M (1432000) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s469ms - BuildRowsPartitioned: 9.50M (9504489) - GetNewBlockTime: 1.658ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.06K (50065) - HashTablesBuildTime: 706.284ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 379.472ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.749ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504489) - RowsReturnedRate: 111.30 K/sec RecvrSide: BytesReceived(16s000ms): 64.14 MB, 169.68 MB, 209.66 MB, 219.73 MB, 223.21 MB, 224.20 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB - FirstBatchArrivalWaitTime: 363.718ms - TotalBytesReceived: 224.31 MB (235201966) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s801ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s400ms, % non-child: 0.26%) - ConvertRowBatchTime: 724.057ms - PeakMemoryUsage: 0 - RowsReturned: 19.56M (19561834) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.47 MB, 10.02 MB, 10.02 MB, 10.02 MB, 24.58 MB, 249.50 MB, 615.47 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s705ms - TotalBytesReceived: 2.66 GB (2852991695) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s342ms - NumBatchesAccepted: 113.80K (113796) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001ac (host=foo.187.42:22000):(Total: 10m35s, non-child: 4s482ms, % non-child: 0.71%) MemoryUsage(16s000ms): 118.95 MB, 279.72 MB, 289.38 MB, 289.38 MB, 289.38 MB, 367.98 MB, 537.06 MB, 536.37 MB, 536.97 MB, 537.09 MB, 536.84 MB, 536.64 MB, 536.60 MB, 536.70 MB, 536.75 MB, 536.67 MB, 536.34 MB, 537.25 MB, 536.70 MB, 536.65 MB, 536.83 MB, 536.71 MB, 536.57 MB, 536.59 MB, 536.58 MB, 536.79 MB, 536.77 MB, 536.70 MB, 536.78 MB, 536.74 MB, 536.66 MB, 536.59 MB, 536.55 MB, 536.77 MB, 536.73 MB, 536.69 MB, 536.88 MB, 536.37 MB, 536.43 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.31 MB (572844962) - PerHostPeakMemUsage: 1.21 GB (1294039108) - RowsProduced: 1.43M (1433377) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 80.923ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.17K (8168) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s322ms - TotalThreadsUserTime: 21s730ms - TotalThreadsVoluntaryContextSwitches: 121.69K (121689) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 37.637ms - ExecTreePrepareTime: 489.464us DataStreamSender (dst_id=23):(Total: 3s678ms, non-child: 3s678ms, % non-child: 100.00%) - BytesSent: 253.73 MB (266052276) - OverallThroughput: 68.97 MB/sec - PeakMemoryUsage: 6.27 MB (6578560) - RowsReturned: 1.43M (1433377) - SerializeBatchTime: 3s674ms - UncompressedRowBatchSize: 253.73 MB (266052276) CodeGen:(Total: 479.714ms, non-child: 479.714ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 145.568ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 306.032ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.525ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 289.570ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 408.865us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493004) - ProbeRows: 1.43M (1433377) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 277.274ms - RowsReturned: 1.43M (1433377) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.780us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 135.902us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.403us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s588ms, non-child: 23.667us, % non-child: 0.00%) - ConvertRowBatchTime: 11.029us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 172.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 183.993ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s588ms - DataArrivalTimer: 1s588ms SenderSide: - DeserializeRowBatchTimer: 35.418us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s639ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501493) - BuildTime: 5s017ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664163) - ProbeRows: 19.57M (19574252) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s129ms - RowsReturned: 1.43M (1433377) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s321ms - BuildRowsPartitioned: 9.50M (9501493) - GetNewBlockTime: 1.120ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.49K (50492) - HashTablesBuildTime: 685.761ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 374.605ms, % non-child: 0.44%) - ConvertRowBatchTime: 265.893ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501493) - RowsReturnedRate: 110.72 K/sec RecvrSide: BytesReceived(16s000ms): 53.38 MB, 163.03 MB, 207.86 MB, 219.19 MB, 222.96 MB, 224.12 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 1s707ms - TotalBytesReceived: 224.25 MB (235141852) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s668ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s428ms, % non-child: 0.26%) - ConvertRowBatchTime: 748.608ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574252) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.60 MB, 10.02 MB, 10.02 MB, 10.02 MB, 17.71 MB, 221.02 MB, 581.97 MB, 1001.08 MB, 1.37 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 20s031ms - TotalBytesReceived: 2.66 GB (2854932521) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s737ms - NumBatchesAccepted: 113.87K (113867) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce1800000205 (host=foo.221.45:22000):(Total: 10m35s, non-child: 4s536ms, % non-child: 0.71%) MemoryUsage(16s000ms): 131.38 MB, 284.60 MB, 289.37 MB, 289.37 MB, 289.37 MB, 364.09 MB, 536.80 MB, 537.16 MB, 537.04 MB, 536.78 MB, 536.91 MB, 536.95 MB, 536.61 MB, 536.90 MB, 536.67 MB, 536.58 MB, 536.94 MB, 537.10 MB, 536.83 MB, 536.58 MB, 536.54 MB, 536.76 MB, 536.92 MB, 536.79 MB, 536.72 MB, 536.71 MB, 536.78 MB, 536.83 MB, 536.65 MB, 537.07 MB, 536.59 MB, 536.81 MB, 536.76 MB, 536.48 MB, 536.93 MB, 536.89 MB, 536.56 MB, 536.25 MB, 536.66 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.31 MB (572848370) - PerHostPeakMemUsage: 1.22 GB (1309290671) - RowsProduced: 1.43M (1433385) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 298.120ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.76K (7762) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s301ms - TotalThreadsUserTime: 21s078ms - TotalThreadsVoluntaryContextSwitches: 122.43K (122426) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 38.037ms - ExecTreePrepareTime: 405.263us DataStreamSender (dst_id=23):(Total: 3s672ms, non-child: 3s672ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265982648) - OverallThroughput: 69.07 MB/sec - PeakMemoryUsage: 6.19 MB (6488448) - RowsReturned: 1.43M (1433385) - SerializeBatchTime: 3s667ms - UncompressedRowBatchSize: 253.66 MB (265982648) CodeGen:(Total: 450.214ms, non-child: 450.214ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 277.729ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.810ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 293.371ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 384.222us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494029) - ProbeRows: 1.43M (1433385) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 280.684ms - RowsReturned: 1.43M (1433385) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 45.188us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 179.219us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.628us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 893.954ms, non-child: 15.650us, % non-child: 0.00%) - ConvertRowBatchTime: 7.230us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 306.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 893.942ms - DataArrivalTimer: 893.939ms SenderSide: - DeserializeRowBatchTimer: 48.819us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s408ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503545) - BuildTime: 4s846ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662377) - ProbeRows: 19.58M (19577480) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s988ms - RowsReturned: 1.43M (1433385) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s211ms - BuildRowsPartitioned: 9.50M (9503545) - GetNewBlockTime: 1.509ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.12K (50117) - HashTablesBuildTime: 620.241ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 383.071ms, % non-child: 0.44%) - ConvertRowBatchTime: 271.674ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503545) - RowsReturnedRate: 110.00 K/sec RecvrSide: BytesReceived(16s000ms): 59.88 MB, 167.18 MB, 208.95 MB, 219.53 MB, 223.11 MB, 224.17 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 1s062ms - TotalBytesReceived: 224.28 MB (235175471) - TotalGetBatchTime: 1m26s - DataArrivalTimer: 1m26s SenderSide: - DeserializeRowBatchTimer: 1s358ms - NumBatchesAccepted: 16.92K (16917) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s403ms, % non-child: 0.26%) - ConvertRowBatchTime: 723.483ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577480) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.13 MB, 10.01 MB, 10.01 MB, 10.01 MB, 21.62 MB, 238.67 MB, 603.08 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s407ms - TotalBytesReceived: 2.66 GB (2855174263) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s252ms - NumBatchesAccepted: 113.89K (113888) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce18000001ad (host=foo.232.13:22000):(Total: 10m35s, non-child: 4s963ms, % non-child: 0.78%) MemoryUsage(16s000ms): 123.42 MB, 284.28 MB, 289.40 MB, 289.40 MB, 289.40 MB, 376.73 MB, 536.74 MB, 536.93 MB, 537.14 MB, 536.84 MB, 536.73 MB, 536.75 MB, 536.82 MB, 536.73 MB, 536.90 MB, 536.63 MB, 536.55 MB, 537.02 MB, 536.83 MB, 536.72 MB, 536.81 MB, 536.59 MB, 536.87 MB, 536.79 MB, 536.56 MB, 536.77 MB, 536.57 MB, 536.77 MB, 536.53 MB, 536.82 MB, 536.60 MB, 536.68 MB, 536.87 MB, 536.97 MB, 536.67 MB, 536.55 MB, 536.66 MB, 536.11 MB, 536.66 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.18 MB (572709768) - PerHostPeakMemUsage: 1.41 GB (1510408439) - RowsProduced: 1.43M (1434288) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 764.927ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.53K (7529) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s290ms - TotalThreadsUserTime: 20s620ms - TotalThreadsVoluntaryContextSwitches: 122.61K (122614) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 39.016ms - ExecTreePrepareTime: 555.562us DataStreamSender (dst_id=23):(Total: 3s597ms, non-child: 3s597ms, % non-child: 100.00%) - BytesSent: 253.85 MB (266183499) - OverallThroughput: 70.56 MB/sec - PeakMemoryUsage: 6.45 MB (6766976) - RowsReturned: 1.43M (1434288) - SerializeBatchTime: 3s592ms - UncompressedRowBatchSize: 253.85 MB (266183499) CodeGen:(Total: 438.807ms, non-child: 438.807ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.045ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 277.136ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 30.015ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 250.439ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 549.515us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.48 MB (4698285) - ProbeRows: 1.43M (1434288) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 238.878ms - RowsReturned: 1.43M (1434288) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33.083us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 342.350us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.178us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 942.699ms, non-child: 19.575us, % non-child: 0.00%) - ConvertRowBatchTime: 8.048us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 290.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 942.683ms - DataArrivalTimer: 942.680ms SenderSide: - DeserializeRowBatchTimer: 11.156us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s132ms, % non-child: 1.30%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501590) - BuildTime: 5s007ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661916) - ProbeRows: 19.58M (19580638) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s759ms - RowsReturned: 1.43M (1434288) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s350ms - BuildRowsPartitioned: 9.50M (9501590) - GetNewBlockTime: 1.771ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.98K (49977) - HashTablesBuildTime: 642.771ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 379.668ms, % non-child: 0.45%) - ConvertRowBatchTime: 269.118ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501590) - RowsReturnedRate: 111.70 K/sec RecvrSide: BytesReceived(16s000ms): 57.22 MB, 165.54 MB, 208.47 MB, 219.36 MB, 223.01 MB, 224.11 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 990.942ms - TotalBytesReceived: 224.23 MB (235119035) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s761ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s307ms, % non-child: 0.24%) - ConvertRowBatchTime: 679.246ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580638) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.93 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.96 MB, 231.38 MB, 594.39 MB, 1015.06 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s319ms - TotalBytesReceived: 2.66 GB (2855772671) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s029ms - NumBatchesAccepted: 113.91K (113909) - NumBatchesRejected: 92 (92) Instance 5f429df048b5534b:41bcce18000001ce (host=foo.221.46:22000):(Total: 10m35s, non-child: 4s720ms, % non-child: 0.74%) MemoryUsage(16s000ms): 130.68 MB, 284.44 MB, 289.39 MB, 289.39 MB, 289.38 MB, 377.35 MB, 536.56 MB, 536.83 MB, 536.74 MB, 536.78 MB, 537.05 MB, 536.96 MB, 536.74 MB, 536.85 MB, 536.64 MB, 536.69 MB, 536.90 MB, 536.83 MB, 536.64 MB, 536.64 MB, 536.65 MB, 536.68 MB, 536.65 MB, 536.60 MB, 536.66 MB, 536.82 MB, 536.92 MB, 536.60 MB, 536.83 MB, 536.65 MB, 536.84 MB, 536.65 MB, 536.76 MB, 537.08 MB, 536.58 MB, 536.53 MB, 536.53 MB, 536.28 MB, 537.14 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.34 MB (572877523) - PerHostPeakMemUsage: 1.38 GB (1481371800) - RowsProduced: 1.43M (1430995) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 419.547ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.81K (7809) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s378ms - TotalThreadsUserTime: 21s612ms - TotalThreadsVoluntaryContextSwitches: 122.13K (122134) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 39.107ms - ExecTreePrepareTime: 616.945us DataStreamSender (dst_id=23):(Total: 3s636ms, non-child: 3s636ms, % non-child: 100.00%) - BytesSent: 253.24 MB (265540144) - OverallThroughput: 69.63 MB/sec - PeakMemoryUsage: 6.19 MB (6488448) - RowsReturned: 1.43M (1430995) - SerializeBatchTime: 3s632ms - UncompressedRowBatchSize: 253.24 MB (265540144) CodeGen:(Total: 445.321ms, non-child: 445.321ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 281.844ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.069ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 293.046ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 612.386us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.46 MB (4678753) - ProbeRows: 1.43M (1430995) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 281.055ms - RowsReturned: 1.43M (1430995) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.693us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 321.922us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.771us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 943.305ms, non-child: 20.028us, % non-child: 0.00%) - ConvertRowBatchTime: 9.636us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 290.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 943.288ms - DataArrivalTimer: 943.286ms SenderSide: - DeserializeRowBatchTimer: 69.356us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s749ms, % non-child: 1.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497885) - BuildTime: 5s020ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663934) - ProbeRows: 19.57M (19570314) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s257ms - RowsReturned: 1.43M (1430995) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s327ms - BuildRowsPartitioned: 9.50M (9497885) - GetNewBlockTime: 2.158ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.40K (50397) - HashTablesBuildTime: 679.385ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 384.404ms, % non-child: 0.45%) - ConvertRowBatchTime: 271.714ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497885) - RowsReturnedRate: 111.49 K/sec RecvrSide: BytesReceived(16s000ms): 58.61 MB, 166.29 MB, 208.61 MB, 219.34 MB, 222.96 MB, 224.03 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB - FirstBatchArrivalWaitTime: 1s063ms - TotalBytesReceived: 224.14 MB (235031814) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s617ms - NumBatchesAccepted: 16.90K (16904) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s438ms, % non-child: 0.26%) - ConvertRowBatchTime: 753.416ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19570314) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.03 MB, 10.02 MB, 10.02 MB, 10.02 MB, 20.92 MB, 235.07 MB, 598.41 MB, 1018.81 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s410ms - TotalBytesReceived: 2.66 GB (2854251920) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s969ms - NumBatchesAccepted: 113.84K (113842) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce18000001c4 (host=foo.187.51:22000):(Total: 10m35s, non-child: 4s228ms, % non-child: 0.67%) MemoryUsage(16s000ms): 118.96 MB, 279.81 MB, 289.38 MB, 289.38 MB, 289.38 MB, 369.29 MB, 536.71 MB, 537.27 MB, 536.80 MB, 536.98 MB, 536.84 MB, 536.69 MB, 536.77 MB, 536.83 MB, 536.68 MB, 536.79 MB, 536.58 MB, 537.05 MB, 536.90 MB, 536.74 MB, 536.64 MB, 536.79 MB, 536.48 MB, 536.51 MB, 536.63 MB, 536.66 MB, 536.81 MB, 536.70 MB, 536.72 MB, 536.73 MB, 536.55 MB, 536.65 MB, 536.76 MB, 536.84 MB, 536.77 MB, 536.65 MB, 536.26 MB, 535.93 MB, 536.86 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.21 MB (572738217) - PerHostPeakMemUsage: 1.23 GB (1324771929) - RowsProduced: 1.43M (1432159) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 130.730ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.83K (7829) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s295ms - TotalThreadsUserTime: 20s754ms - TotalThreadsVoluntaryContextSwitches: 122.50K (122504) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 32.933ms - ExecTreePrepareTime: 343.027us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.46 MB (265775390) - OverallThroughput: 69.35 MB/sec - PeakMemoryUsage: 6.51 MB (6824320) - RowsReturned: 1.43M (1432159) - SerializeBatchTime: 3s649ms - UncompressedRowBatchSize: 253.46 MB (265775390) CodeGen:(Total: 415.954ms, non-child: 415.954ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 257.350ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.142ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 288.449ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 559.766us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488915) - ProbeRows: 1.43M (1432159) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 276.905ms - RowsReturned: 1.43M (1432159) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49.494us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 150.807us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 104.185us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s470ms, non-child: 19.717us, % non-child: 0.00%) - ConvertRowBatchTime: 8.189us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 186.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 69.268ms - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s470ms - DataArrivalTimer: 1s470ms SenderSide: - DeserializeRowBatchTimer: 64.458us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s251ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9495864) - BuildTime: 4s622ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658612) - ProbeRows: 19.57M (19573161) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s997ms - RowsReturned: 1.43M (1432159) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s038ms - BuildRowsPartitioned: 9.50M (9495864) - GetNewBlockTime: 2.872ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.95K (49946) - HashTablesBuildTime: 569.350ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 374.549ms, % non-child: 0.44%) - ConvertRowBatchTime: 262.921ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9495864) - RowsReturnedRate: 110.45 K/sec RecvrSide: BytesReceived(16s000ms): 54.06 MB, 163.43 MB, 207.82 MB, 219.08 MB, 222.82 MB, 223.97 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB, 224.09 MB - FirstBatchArrivalWaitTime: 1s591ms - TotalBytesReceived: 224.09 MB (234979598) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s364ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s390ms, % non-child: 0.25%) - ConvertRowBatchTime: 730.634ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573161) - RowsReturnedRate: 35.60 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.65 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.05 MB, 222.74 MB, 584.14 MB, 1002.93 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s929ms - TotalBytesReceived: 2.66 GB (2854695691) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s158ms - NumBatchesAccepted: 113.86K (113859) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce18000001c7 (host=foo.234.38:22000):(Total: 10m35s, non-child: 5s623ms, % non-child: 0.89%) MemoryUsage(16s000ms): 147.04 MB, 285.47 MB, 289.39 MB, 289.39 MB, 289.39 MB, 393.41 MB, 537.19 MB, 536.96 MB, 536.98 MB, 536.85 MB, 536.96 MB, 536.60 MB, 536.75 MB, 536.68 MB, 536.55 MB, 536.43 MB, 536.88 MB, 537.08 MB, 536.82 MB, 536.59 MB, 536.90 MB, 536.78 MB, 536.57 MB, 536.85 MB, 536.71 MB, 536.53 MB, 536.82 MB, 536.69 MB, 536.79 MB, 536.72 MB, 536.79 MB, 536.48 MB, 536.97 MB, 536.75 MB, 536.91 MB, 536.53 MB, 536.32 MB, 536.23 MB, 537.06 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572787879) - PerHostPeakMemUsage: 1.22 GB (1311282730) - RowsProduced: 1.43M (1433983) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 959.820ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.55K (7549) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s221ms - TotalThreadsUserTime: 20s609ms - TotalThreadsVoluntaryContextSwitches: 122.53K (122530) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 45.858ms - ExecTreePrepareTime: 643.528us DataStreamSender (dst_id=23):(Total: 3s678ms, non-child: 3s678ms, % non-child: 100.00%) - BytesSent: 253.67 MB (265989284) - OverallThroughput: 68.96 MB/sec - PeakMemoryUsage: 6.51 MB (6824320) - RowsReturned: 1.43M (1433983) - SerializeBatchTime: 3s674ms - UncompressedRowBatchSize: 253.67 MB (265989284) CodeGen:(Total: 420.954ms, non-child: 420.954ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 125.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 259.525ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 35.729ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 257.621ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 426.288us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493236) - ProbeRows: 1.43M (1433983) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 244.787ms - RowsReturned: 1.43M (1433983) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.954us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 185.094us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.486us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 29.131ms, non-child: 19.067us, % non-child: 0.07%) - ConvertRowBatchTime: 7.748us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 9.40 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 29.116ms - DataArrivalTimer: 29.112ms SenderSide: - DeserializeRowBatchTimer: 28.229us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 7s907ms, % non-child: 1.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498463) - BuildTime: 5s084ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660820) - ProbeRows: 19.57M (19574029) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s293ms - RowsReturned: 1.43M (1433983) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s421ms - BuildRowsPartitioned: 9.50M (9498463) - GetNewBlockTime: 1.025ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.12K (50117) - HashTablesBuildTime: 649.961ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 375.398ms, % non-child: 0.45%) - ConvertRowBatchTime: 272.487ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498463) - RowsReturnedRate: 112.83 K/sec RecvrSide: BytesReceived(16s000ms): 66.29 MB, 170.73 MB, 209.83 MB, 219.68 MB, 223.11 MB, 224.08 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 151.038ms - TotalBytesReceived: 224.17 MB (235061948) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s429ms - NumBatchesAccepted: 16.90K (16901) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s374ms, % non-child: 0.25%) - ConvertRowBatchTime: 739.288ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574029) - RowsReturnedRate: 35.65 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.65 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.31 MB, 255.26 MB, 622.57 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s497ms - TotalBytesReceived: 2.66 GB (2854835680) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s991ms - NumBatchesAccepted: 113.87K (113869) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce180000019c (host=foo.232.21:22000):(Total: 10m35s, non-child: 5s838ms, % non-child: 0.92%) MemoryUsage(16s000ms): 137.89 MB, 284.91 MB, 289.37 MB, 289.37 MB, 289.37 MB, 392.81 MB, 536.78 MB, 536.95 MB, 536.74 MB, 537.09 MB, 536.73 MB, 536.70 MB, 536.87 MB, 536.83 MB, 536.51 MB, 536.70 MB, 536.49 MB, 536.85 MB, 536.44 MB, 536.78 MB, 536.77 MB, 536.43 MB, 536.58 MB, 536.72 MB, 536.69 MB, 536.50 MB, 536.71 MB, 536.64 MB, 536.74 MB, 536.76 MB, 536.48 MB, 536.79 MB, 536.63 MB, 536.67 MB, 536.75 MB, 536.74 MB, 536.74 MB, 537.25 MB, 536.18 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.20 MB (572728179) - PerHostPeakMemUsage: 1.39 GB (1494598744) - RowsProduced: 1.43M (1432723) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 1s462ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.03K (8032) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s275ms - TotalThreadsUserTime: 20s817ms - TotalThreadsVoluntaryContextSwitches: 123.13K (123129) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 40.922ms - ExecTreePrepareTime: 554.869us DataStreamSender (dst_id=23):(Total: 3s594ms, non-child: 3s594ms, % non-child: 100.00%) - BytesSent: 253.60 MB (265922432) - OverallThroughput: 70.55 MB/sec - PeakMemoryUsage: 6.13 MB (6422912) - RowsReturned: 1.43M (1432723) - SerializeBatchTime: 3s590ms - UncompressedRowBatchSize: 253.60 MB (265922432) CodeGen:(Total: 452.739ms, non-child: 452.739ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 281.111ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.046ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 287.301ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 549.066us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.30 MB (4505064) - ProbeRows: 1.43M (1432723) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 276.076ms - RowsReturned: 1.43M (1432723) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.573us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 325.688us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.277us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 437.152ms, non-child: 15.726us, % non-child: 0.00%) - ConvertRowBatchTime: 7.216us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 626.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 437.139ms - DataArrivalTimer: 437.137ms SenderSide: - DeserializeRowBatchTimer: 92.032us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s252ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501367) - BuildTime: 4s886ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664596) - ProbeRows: 19.58M (19575664) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s822ms - RowsReturned: 1.43M (1432723) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s251ms - BuildRowsPartitioned: 9.50M (9501367) - GetNewBlockTime: 1.709ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.59K (49590) - HashTablesBuildTime: 619.779ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 377.484ms, % non-child: 0.45%) - ConvertRowBatchTime: 268.340ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501367) - RowsReturnedRate: 112.72 K/sec RecvrSide: BytesReceived(16s000ms): 62.26 MB, 168.52 MB, 209.30 MB, 219.60 MB, 223.11 MB, 224.13 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 558.485ms - TotalBytesReceived: 224.24 MB (235129702) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s529ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s365ms, % non-child: 0.25%) - ConvertRowBatchTime: 704.958ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575664) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.32 MB, 10.01 MB, 10.01 MB, 10.01 MB, 23.48 MB, 244.72 MB, 610.40 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s901ms - TotalBytesReceived: 2.66 GB (2855000691) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s381ms - NumBatchesAccepted: 113.88K (113876) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce18000001b6 (host=foo.221.14:22000):(Total: 10m35s, non-child: 4s203ms, % non-child: 0.66%) MemoryUsage(16s000ms): 118.58 MB, 279.63 MB, 289.37 MB, 289.37 MB, 289.37 MB, 365.42 MB, 537.01 MB, 536.90 MB, 537.11 MB, 536.89 MB, 537.02 MB, 536.76 MB, 536.52 MB, 536.85 MB, 536.84 MB, 536.61 MB, 537.08 MB, 537.10 MB, 536.61 MB, 536.85 MB, 536.71 MB, 536.62 MB, 536.65 MB, 536.67 MB, 536.81 MB, 536.46 MB, 536.76 MB, 536.78 MB, 536.71 MB, 536.79 MB, 536.63 MB, 536.71 MB, 536.77 MB, 536.46 MB, 536.62 MB, 536.66 MB, 536.98 MB, 537.82 MB, 535.80 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.01 MB (6299648) - PeakMemoryUsage: 546.31 MB (572843125) - PerHostPeakMemUsage: 1.25 GB (1338050302) - RowsProduced: 1.43M (1432733) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 129.745ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.90K (7898) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s267ms - TotalThreadsUserTime: 20s952ms - TotalThreadsVoluntaryContextSwitches: 122.99K (122986) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 45.384ms - ExecTreePrepareTime: 409.218us DataStreamSender (dst_id=23):(Total: 3s599ms, non-child: 3s599ms, % non-child: 100.00%) - BytesSent: 253.63 MB (265950916) - OverallThroughput: 70.47 MB/sec - PeakMemoryUsage: 5.95 MB (6234496) - RowsReturned: 1.43M (1432733) - SerializeBatchTime: 3s594ms - UncompressedRowBatchSize: 253.63 MB (265950916) CodeGen:(Total: 528.271ms, non-child: 528.271ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 167.302ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 326.279ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.640ms HASH_JOIN_NODE (id=11):(Total: 10m27s, non-child: 281.977ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 969.576us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4498249) - ProbeRows: 1.43M (1432733) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 269.737ms - RowsReturned: 1.43M (1432733) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 67.653us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 536.234us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.994us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s329ms, non-child: 27.282us, % non-child: 0.00%) - ConvertRowBatchTime: 16.251us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 206.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s329ms - DataArrivalTimer: 1s329ms SenderSide: - DeserializeRowBatchTimer: 34.594us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s276ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500689) - BuildTime: 5s035ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664192) - ProbeRows: 19.57M (19573540) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s813ms - RowsReturned: 1.43M (1432733) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s333ms - BuildRowsPartitioned: 9.50M (9500689) - GetNewBlockTime: 1.268ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.11K (50114) - HashTablesBuildTime: 688.563ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 389.565ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.175ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500689) - RowsReturnedRate: 111.07 K/sec RecvrSide: BytesReceived(16s000ms): 56.48 MB, 165.06 MB, 208.37 MB, 219.34 MB, 223.00 MB, 224.09 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 1s444ms - TotalBytesReceived: 224.21 MB (235105708) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s709ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s363ms, % non-child: 0.25%) - ConvertRowBatchTime: 698.979ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573540) - RowsReturnedRate: 35.60 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.85 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.58 MB, 229.51 MB, 591.65 MB, 1011.52 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s795ms - TotalBytesReceived: 2.66 GB (2854426098) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 15s907ms - NumBatchesAccepted: 113.86K (113865) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001bc (host=foo.221.13:22000):(Total: 10m35s, non-child: 4s304ms, % non-child: 0.68%) MemoryUsage(16s000ms): 122.88 MB, 283.97 MB, 289.40 MB, 289.40 MB, 289.40 MB, 371.28 MB, 537.20 MB, 537.09 MB, 536.89 MB, 536.68 MB, 536.97 MB, 536.53 MB, 536.90 MB, 536.55 MB, 536.91 MB, 536.78 MB, 536.66 MB, 536.25 MB, 536.52 MB, 536.85 MB, 536.69 MB, 536.74 MB, 536.82 MB, 536.63 MB, 537.00 MB, 536.72 MB, 536.68 MB, 536.65 MB, 536.76 MB, 536.68 MB, 536.77 MB, 536.69 MB, 536.78 MB, 536.46 MB, 536.52 MB, 536.70 MB, 536.73 MB, 536.21 MB, 536.60 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.50 MB (573048451) - PerHostPeakMemUsage: 1.24 GB (1326661336) - RowsProduced: 1.43M (1433951) - TotalNetworkReceiveTime: 10m35s - TotalNetworkSendTime: 129.065ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.47K (7475) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s309ms - TotalThreadsUserTime: 20s998ms - TotalThreadsVoluntaryContextSwitches: 122.54K (122536) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.432ms - ExecTreePrepareTime: 396.569us DataStreamSender (dst_id=23):(Total: 3s634ms, non-child: 3s634ms, % non-child: 100.00%) - BytesSent: 253.79 MB (266120173) - OverallThroughput: 69.82 MB/sec - PeakMemoryUsage: 6.32 MB (6627712) - RowsReturned: 1.43M (1433951) - SerializeBatchTime: 3s629ms - UncompressedRowBatchSize: 253.79 MB (266120173) CodeGen:(Total: 451.958ms, non-child: 451.958ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 138.454ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 284.419ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.467ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 283.233ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.023ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4498522) - ProbeRows: 1.43M (1433951) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 271.649ms - RowsReturned: 1.43M (1433951) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 63.804us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 655.231us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.076us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s387ms, non-child: 23.393us, % non-child: 0.00%) - ConvertRowBatchTime: 9.953us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 197.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s387ms - DataArrivalTimer: 1s387ms SenderSide: - DeserializeRowBatchTimer: 85.514us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s370ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501936) - BuildTime: 5s257ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657121) - ProbeRows: 19.58M (19580817) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s843ms - RowsReturned: 1.43M (1433951) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s589ms - BuildRowsPartitioned: 9.50M (9501936) - GetNewBlockTime: 3.378ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.27K (50270) - HashTablesBuildTime: 652.113ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 388.957ms, % non-child: 0.46%) - ConvertRowBatchTime: 275.645ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501936) - RowsReturnedRate: 111.32 K/sec RecvrSide: BytesReceived(16s000ms): 55.22 MB, 164.25 MB, 208.20 MB, 219.29 MB, 223.01 MB, 224.13 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 1s519ms - TotalBytesReceived: 224.25 MB (235144970) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s764ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s370ms, % non-child: 0.25%) - ConvertRowBatchTime: 702.670ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580817) - RowsReturnedRate: 35.62 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.74 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.76 MB, 225.98 MB, 587.99 MB, 1007.48 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s845ms - TotalBytesReceived: 2.66 GB (2855578174) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s098ms - NumBatchesAccepted: 113.90K (113904) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce1800000206 (host=foo.232.20:22000):(Total: 10m35s, non-child: 4s477ms, % non-child: 0.70%) MemoryUsage(16s000ms): 131.82 MB, 284.74 MB, 289.40 MB, 289.40 MB, 289.40 MB, 365.07 MB, 536.86 MB, 536.82 MB, 536.80 MB, 536.65 MB, 536.87 MB, 536.91 MB, 536.27 MB, 536.69 MB, 536.24 MB, 536.47 MB, 536.99 MB, 536.81 MB, 536.82 MB, 536.62 MB, 536.62 MB, 536.85 MB, 536.78 MB, 536.79 MB, 536.77 MB, 536.49 MB, 536.70 MB, 536.60 MB, 536.83 MB, 536.94 MB, 536.52 MB, 536.67 MB, 536.56 MB, 536.76 MB, 536.74 MB, 536.57 MB, 536.46 MB, 536.02 MB, 536.96 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.22 MB (572754388) - PerHostPeakMemUsage: 1.37 GB (1474452829) - RowsProduced: 1.44M (1435091) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 136.664ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.23K (7228) - TotalThreadsTotalWallClockTime: 12m7s - TotalThreadsSysTime: 2s358ms - TotalThreadsUserTime: 20s857ms - TotalThreadsVoluntaryContextSwitches: 122.81K (122810) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 36.186ms - ExecTreePrepareTime: 432.921us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.94 MB (266271624) - OverallThroughput: 69.73 MB/sec - PeakMemoryUsage: 6.45 MB (6758784) - RowsReturned: 1.44M (1435091) - SerializeBatchTime: 3s637ms - UncompressedRowBatchSize: 253.94 MB (266271624) CodeGen:(Total: 459.706ms, non-child: 459.706ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 287.732ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.557ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 289.381ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 592.890us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4496340) - ProbeRows: 1.44M (1435091) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 277.395ms - RowsReturned: 1.44M (1435091) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 66.230us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 321.504us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.937us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 766.735ms, non-child: 18.843us, % non-child: 0.00%) - ConvertRowBatchTime: 7.507us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 357.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 766.721ms - DataArrivalTimer: 766.717ms SenderSide: - DeserializeRowBatchTimer: 70.943us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s384ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9509941) - BuildTime: 4s941ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658406) - ProbeRows: 19.57M (19572141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s003ms - RowsReturned: 1.44M (1435091) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s262ms - BuildRowsPartitioned: 9.51M (9509941) - GetNewBlockTime: 1.208ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.93K (49927) - HashTablesBuildTime: 665.798ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 385.508ms, % non-child: 0.45%) - ConvertRowBatchTime: 271.205ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9509941) - RowsReturnedRate: 110.37 K/sec RecvrSide: BytesReceived(16s000ms): 60.86 MB, 167.83 MB, 209.23 MB, 219.70 MB, 223.28 MB, 224.32 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB, 224.43 MB - FirstBatchArrivalWaitTime: 887.536ms - TotalBytesReceived: 224.43 MB (235332291) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s697ms - NumBatchesAccepted: 16.93K (16929) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s386ms, % non-child: 0.25%) - ConvertRowBatchTime: 706.604ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572141) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.21 MB, 10.02 MB, 10.02 MB, 10.02 MB, 22.22 MB, 240.94 MB, 605.20 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s214ms - TotalBytesReceived: 2.66 GB (2854640366) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s455ms - NumBatchesAccepted: 113.85K (113853) - NumBatchesRejected: 106 (106) Instance 5f429df048b5534b:41bcce18000001c3 (host=foo.232.49:22000):(Total: 10m35s, non-child: 5s584ms, % non-child: 0.88%) MemoryUsage(16s000ms): 139.89 MB, 284.96 MB, 289.38 MB, 289.38 MB, 289.38 MB, 385.64 MB, 537.11 MB, 536.64 MB, 536.84 MB, 537.02 MB, 537.10 MB, 536.73 MB, 536.72 MB, 536.97 MB, 536.42 MB, 536.36 MB, 536.96 MB, 536.46 MB, 536.65 MB, 536.74 MB, 536.81 MB, 536.76 MB, 536.80 MB, 536.67 MB, 536.91 MB, 536.78 MB, 536.58 MB, 536.85 MB, 536.67 MB, 536.60 MB, 536.70 MB, 536.77 MB, 536.61 MB, 536.52 MB, 536.81 MB, 536.81 MB, 536.84 MB, 536.25 MB, 537.05 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.29 MB (572822917) - PerHostPeakMemUsage: 1.41 GB (1511109593) - RowsProduced: 1.43M (1432094) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 1s199ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.71K (7708) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s299ms - TotalThreadsUserTime: 21s986ms - TotalThreadsVoluntaryContextSwitches: 122.17K (122170) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 42.677ms - ExecTreePrepareTime: 533.715us DataStreamSender (dst_id=23):(Total: 3s682ms, non-child: 3s682ms, % non-child: 100.00%) - BytesSent: 253.46 MB (265770570) - OverallThroughput: 68.82 MB/sec - PeakMemoryUsage: 6.25 MB (6553984) - RowsReturned: 1.43M (1432094) - SerializeBatchTime: 3s677ms - UncompressedRowBatchSize: 253.46 MB (265770570) CodeGen:(Total: 458.896ms, non-child: 458.896ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 153.401ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 272.327ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.598ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 298.969ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 514.187us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4485926) - ProbeRows: 1.43M (1432094) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 287.290ms - RowsReturned: 1.43M (1432094) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 31.898us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 353.827us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.814us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 173.197ms, non-child: 19.072us, % non-child: 0.01%) - ConvertRowBatchTime: 8.135us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.58 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 173.182ms - DataArrivalTimer: 173.178ms SenderSide: - DeserializeRowBatchTimer: 164.232us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s882ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498195) - BuildTime: 5s207ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662506) - ProbeRows: 19.57M (19572996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s258ms - RowsReturned: 1.43M (1432094) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s511ms - BuildRowsPartitioned: 9.50M (9498195) - GetNewBlockTime: 2.399ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.89K (49886) - HashTablesBuildTime: 680.386ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 397.586ms, % non-child: 0.47%) - ConvertRowBatchTime: 279.166ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498195) - RowsReturnedRate: 112.78 K/sec RecvrSide: BytesReceived(16s000ms): 62.58 MB, 168.67 MB, 209.27 MB, 219.53 MB, 223.04 MB, 224.06 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 291.976ms - TotalBytesReceived: 224.16 MB (235048344) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s743ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s445ms, % non-child: 0.26%) - ConvertRowBatchTime: 745.028ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572996) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.34 MB, 10.01 MB, 10.01 MB, 10.01 MB, 23.66 MB, 245.72 MB, 611.20 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s641ms - TotalBytesReceived: 2.66 GB (2854516732) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 17s146ms - NumBatchesAccepted: 113.86K (113863) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001cd (host=foo.221.33:22000):(Total: 10m35s, non-child: 4s281ms, % non-child: 0.67%) MemoryUsage(16s000ms): 123.18 MB, 284.15 MB, 289.36 MB, 289.36 MB, 289.36 MB, 373.17 MB, 536.76 MB, 536.95 MB, 536.83 MB, 536.86 MB, 537.06 MB, 536.77 MB, 537.03 MB, 536.87 MB, 536.71 MB, 536.63 MB, 536.57 MB, 536.77 MB, 536.59 MB, 536.69 MB, 536.86 MB, 536.90 MB, 536.55 MB, 536.77 MB, 536.82 MB, 536.66 MB, 536.49 MB, 536.76 MB, 536.63 MB, 536.76 MB, 536.79 MB, 536.70 MB, 536.41 MB, 536.92 MB, 536.64 MB, 536.77 MB, 536.74 MB, 537.35 MB, 536.20 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572782595) - PerHostPeakMemUsage: 1.40 GB (1500362839) - RowsProduced: 1.43M (1430733) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 121.948ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.15K (8150) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s371ms - TotalThreadsUserTime: 21s149ms - TotalThreadsVoluntaryContextSwitches: 122.45K (122455) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 46.619ms - ExecTreePrepareTime: 486.132us DataStreamSender (dst_id=23):(Total: 3s613ms, non-child: 3s613ms, % non-child: 100.00%) - BytesSent: 253.21 MB (265514754) - OverallThroughput: 70.08 MB/sec - PeakMemoryUsage: 6.63 MB (6955392) - RowsReturned: 1.43M (1430733) - SerializeBatchTime: 3s608ms - UncompressedRowBatchSize: 253.21 MB (265514754) CodeGen:(Total: 485.235ms, non-child: 485.235ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 151.653ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 299.302ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.328ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 285.015ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 400.483us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494235) - ProbeRows: 1.43M (1430733) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 273.056ms - RowsReturned: 1.43M (1430733) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 50.102us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 188.998us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.884us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s014ms, non-child: 20.369us, % non-child: 0.00%) - ConvertRowBatchTime: 8.164us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 270.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s014ms - DataArrivalTimer: 1s014ms SenderSide: - DeserializeRowBatchTimer: 82.537us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s380ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497429) - BuildTime: 4s990ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660343) - ProbeRows: 19.57M (19573786) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s999ms - RowsReturned: 1.43M (1430733) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s295ms - BuildRowsPartitioned: 9.50M (9497429) - GetNewBlockTime: 2.101ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.59K (49586) - HashTablesBuildTime: 680.342ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 395.128ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.418ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497429) - RowsReturnedRate: 111.36 K/sec RecvrSide: BytesReceived(16s000ms): 56.54 MB, 165.03 MB, 208.28 MB, 219.23 MB, 222.91 MB, 224.01 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB, 224.13 MB - FirstBatchArrivalWaitTime: 1s131ms - TotalBytesReceived: 224.13 MB (235018868) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s693ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s390ms, % non-child: 0.25%) - ConvertRowBatchTime: 721.222ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573786) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.85 MB, 10.00 MB, 10.00 MB, 10.00 MB, 19.64 MB, 229.54 MB, 592.10 MB, 1012.36 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s477ms - TotalBytesReceived: 2.66 GB (2854778611) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s637ms - NumBatchesAccepted: 113.87K (113867) - NumBatchesRejected: 95 (95) Instance 5f429df048b5534b:41bcce1800000210 (host=foo.232.43:22000):(Total: 10m35s, non-child: 4s928ms, % non-child: 0.78%) MemoryUsage(16s000ms): 139.90 MB, 285.16 MB, 289.40 MB, 289.40 MB, 289.40 MB, 371.20 MB, 536.82 MB, 536.99 MB, 536.80 MB, 536.89 MB, 536.83 MB, 536.75 MB, 536.58 MB, 536.48 MB, 537.00 MB, 536.93 MB, 536.35 MB, 536.58 MB, 536.76 MB, 536.73 MB, 536.87 MB, 536.56 MB, 536.75 MB, 536.84 MB, 536.85 MB, 536.50 MB, 536.73 MB, 536.73 MB, 536.77 MB, 536.81 MB, 536.74 MB, 536.54 MB, 536.98 MB, 536.79 MB, 536.86 MB, 536.51 MB, 536.76 MB, 537.11 MB, 536.79 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.55 MB (573096356) - PerHostPeakMemUsage: 1.43 GB (1530522299) - RowsProduced: 1.43M (1431759) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 759.052ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.95K (7948) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s273ms - TotalThreadsUserTime: 21s207ms - TotalThreadsVoluntaryContextSwitches: 122.05K (122052) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.935ms - ExecTreePrepareTime: 572.655us DataStreamSender (dst_id=23):(Total: 3s634ms, non-child: 3s634ms, % non-child: 100.00%) - BytesSent: 253.33 MB (265630542) - OverallThroughput: 69.70 MB/sec - PeakMemoryUsage: 6.34 MB (6644096) - RowsReturned: 1.43M (1431759) - SerializeBatchTime: 3s629ms - UncompressedRowBatchSize: 253.33 MB (265630542) CodeGen:(Total: 479.582ms, non-child: 479.582ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 163.982ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 285.691ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.392ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 288.404ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 695.245us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4487065) - ProbeRows: 1.43M (1431759) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 276.221ms - RowsReturned: 1.43M (1431759) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33.440us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 452.380us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.727us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 38.385ms, non-child: 17.390us, % non-child: 0.05%) - ConvertRowBatchTime: 7.420us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 7.14 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 38.371ms - DataArrivalTimer: 38.368ms SenderSide: - DeserializeRowBatchTimer: 117.070us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s564ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498427) - BuildTime: 4s871ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661493) - ProbeRows: 19.57M (19573085) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s083ms - RowsReturned: 1.43M (1431759) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s154ms - BuildRowsPartitioned: 9.50M (9498427) - GetNewBlockTime: 2.127ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.08K (50077) - HashTablesBuildTime: 701.744ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 393.474ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.729ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498427) - RowsReturnedRate: 111.02 K/sec RecvrSide: BytesReceived(16s000ms): 63.86 MB, 169.38 MB, 209.46 MB, 219.57 MB, 223.06 MB, 224.06 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 145.262ms - TotalBytesReceived: 224.16 MB (235052033) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s616ms - NumBatchesAccepted: 16.90K (16902) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s414ms, % non-child: 0.26%) - ConvertRowBatchTime: 725.865ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573085) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.46 MB, 10.02 MB, 10.02 MB, 10.02 MB, 24.40 MB, 249.16 MB, 615.34 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s488ms - TotalBytesReceived: 2.66 GB (2854546290) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s367ms - NumBatchesAccepted: 113.87K (113867) - NumBatchesRejected: 113 (113) Instance 5f429df048b5534b:41bcce18000001b5 (host=foo.232.18:22000):(Total: 10m35s, non-child: 4s591ms, % non-child: 0.72%) MemoryUsage(16s000ms): 131.42 MB, 284.47 MB, 289.40 MB, 289.40 MB, 289.40 MB, 378.40 MB, 536.80 MB, 537.05 MB, 536.65 MB, 536.93 MB, 536.83 MB, 536.63 MB, 536.89 MB, 536.49 MB, 536.93 MB, 536.84 MB, 536.62 MB, 536.95 MB, 536.76 MB, 536.78 MB, 537.05 MB, 536.43 MB, 536.85 MB, 536.82 MB, 536.63 MB, 536.98 MB, 536.89 MB, 536.76 MB, 536.64 MB, 536.67 MB, 536.78 MB, 536.67 MB, 536.77 MB, 536.78 MB, 536.70 MB, 536.57 MB, 536.71 MB, 536.30 MB, 536.65 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572776425) - PerHostPeakMemUsage: 1.36 GB (1459405202) - RowsProduced: 1.43M (1433965) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 337.905ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.97K (7970) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s291ms - TotalThreadsUserTime: 20s604ms - TotalThreadsVoluntaryContextSwitches: 123.06K (123057) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 45.643ms - ExecTreePrepareTime: 737.426us DataStreamSender (dst_id=23):(Total: 3s582ms, non-child: 3s582ms, % non-child: 100.00%) - BytesSent: 253.69 MB (266014902) - OverallThroughput: 70.82 MB/sec - PeakMemoryUsage: 6.31 MB (6611328) - RowsReturned: 1.43M (1433965) - SerializeBatchTime: 3s577ms - UncompressedRowBatchSize: 253.69 MB (266014902) CodeGen:(Total: 459.248ms, non-child: 459.248ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.535ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.130ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 284.699ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 596.097us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489437) - ProbeRows: 1.43M (1433965) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 272.298ms - RowsReturned: 1.43M (1433965) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.478us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 383.416us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.288us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 702.986ms, non-child: 22.356us, % non-child: 0.00%) - ConvertRowBatchTime: 7.858us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 389.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 702.969ms - DataArrivalTimer: 702.964ms SenderSide: - DeserializeRowBatchTimer: 117.391us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s261ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500996) - BuildTime: 4s796ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663264) - ProbeRows: 19.58M (19575682) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s788ms - RowsReturned: 1.43M (1433965) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s111ms - BuildRowsPartitioned: 9.50M (9500996) - GetNewBlockTime: 1.587ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.91K (49914) - HashTablesBuildTime: 671.706ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 390.623ms, % non-child: 0.46%) - ConvertRowBatchTime: 275.331ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500996) - RowsReturnedRate: 111.59 K/sec RecvrSide: BytesReceived(16s000ms): 58.93 MB, 166.55 MB, 208.74 MB, 219.43 MB, 223.03 MB, 224.11 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 818.422ms - TotalBytesReceived: 224.23 MB (235118392) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s712ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s352ms, % non-child: 0.25%) - ConvertRowBatchTime: 707.120ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575682) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.05 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.05 MB, 235.92 MB, 599.81 MB, 1020.45 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s151ms - TotalBytesReceived: 2.66 GB (2855410359) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s769ms - NumBatchesAccepted: 113.88K (113882) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce18000001cf (host=foo.232.27:22000):(Total: 10m35s, non-child: 4s656ms, % non-child: 0.73%) MemoryUsage(16s000ms): 131.82 MB, 284.82 MB, 289.37 MB, 289.37 MB, 289.37 MB, 384.23 MB, 536.90 MB, 537.04 MB, 536.99 MB, 537.08 MB, 536.96 MB, 536.63 MB, 536.76 MB, 536.68 MB, 536.57 MB, 536.89 MB, 536.32 MB, 536.65 MB, 536.74 MB, 536.64 MB, 536.42 MB, 536.63 MB, 536.81 MB, 536.84 MB, 536.73 MB, 536.59 MB, 536.54 MB, 536.72 MB, 536.80 MB, 536.81 MB, 536.50 MB, 536.79 MB, 536.75 MB, 536.64 MB, 536.52 MB, 536.66 MB, 536.55 MB, 537.02 MB, 536.28 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.13 MB (572653602) - PerHostPeakMemUsage: 1.34 GB (1442870921) - RowsProduced: 1.43M (1434633) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 441.119ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7857) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s265ms - TotalThreadsUserTime: 20s972ms - TotalThreadsVoluntaryContextSwitches: 122.85K (122847) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 40.363ms - ExecTreePrepareTime: 500.183us DataStreamSender (dst_id=23):(Total: 3s612ms, non-child: 3s612ms, % non-child: 100.00%) - BytesSent: 253.94 MB (266277042) - OverallThroughput: 70.30 MB/sec - PeakMemoryUsage: 6.21 MB (6513024) - RowsReturned: 1.43M (1434633) - SerializeBatchTime: 3s607ms - UncompressedRowBatchSize: 253.94 MB (266277042) CodeGen:(Total: 470.465ms, non-child: 470.465ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 308.186ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.247ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 285.366ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 607.995us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493751) - ProbeRows: 1.43M (1434633) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 273.283ms - RowsReturned: 1.43M (1434633) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53.204us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 357.368us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.465us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 601.117ms, non-child: 18.482us, % non-child: 0.00%) - ConvertRowBatchTime: 7.264us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 455.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 601.103ms - DataArrivalTimer: 601.100ms SenderSide: - DeserializeRowBatchTimer: 149.756us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s374ms, % non-child: 1.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504604) - BuildTime: 4s832ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546655650) - ProbeRows: 19.57M (19569945) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s990ms - RowsReturned: 1.43M (1434633) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s205ms - BuildRowsPartitioned: 9.50M (9504604) - GetNewBlockTime: 1.682ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.03K (50029) - HashTablesBuildTime: 614.252ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 382.966ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.133ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504604) - RowsReturnedRate: 111.86 K/sec RecvrSide: BytesReceived(16s000ms): 61.48 MB, 168.19 MB, 209.28 MB, 219.63 MB, 223.17 MB, 224.20 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB - FirstBatchArrivalWaitTime: 707.260ms - TotalBytesReceived: 224.31 MB (235204279) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s512ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s389ms, % non-child: 0.25%) - ConvertRowBatchTime: 724.941ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569945) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.26 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.76 MB, 242.71 MB, 607.63 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s052ms - TotalBytesReceived: 2.66 GB (2854307982) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s291ms - NumBatchesAccepted: 113.85K (113846) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce180000020f (host=foo.232.23:22000):(Total: 10m35s, non-child: 4s517ms, % non-child: 0.71%) MemoryUsage(16s000ms): 131.85 MB, 284.82 MB, 289.37 MB, 289.36 MB, 289.36 MB, 367.95 MB, 537.03 MB, 536.99 MB, 536.84 MB, 536.76 MB, 536.81 MB, 536.93 MB, 536.72 MB, 536.64 MB, 536.55 MB, 536.92 MB, 536.85 MB, 536.59 MB, 536.56 MB, 536.66 MB, 536.49 MB, 536.63 MB, 536.76 MB, 536.76 MB, 536.85 MB, 536.89 MB, 536.81 MB, 536.85 MB, 536.60 MB, 536.79 MB, 536.51 MB, 536.65 MB, 536.56 MB, 536.64 MB, 536.55 MB, 536.53 MB, 536.63 MB, 537.00 MB, 536.51 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.15 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 548.79 MB (575448817) - PerHostPeakMemUsage: 1.38 GB (1486259692) - RowsProduced: 1.44M (1435882) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 564.872ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.23K (7234) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s190ms - TotalThreadsUserTime: 19s830ms - TotalThreadsVoluntaryContextSwitches: 122.68K (122683) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m31s - PrepareTime: 37.217ms - ExecTreePrepareTime: 526.694us DataStreamSender (dst_id=23):(Total: 3s613ms, non-child: 3s613ms, % non-child: 100.00%) - BytesSent: 254.09 MB (266437537) - OverallThroughput: 70.32 MB/sec - PeakMemoryUsage: 6.27 MB (6570368) - RowsReturned: 1.44M (1435882) - SerializeBatchTime: 3s609ms - UncompressedRowBatchSize: 254.09 MB (266437537) CodeGen:(Total: 426.290ms, non-child: 426.290ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.165ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 268.920ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.504ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 248.507ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 720.511us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490000) - ProbeRows: 1.44M (1435882) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 236.886ms - RowsReturned: 1.44M (1435882) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 68.470us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 375.378us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.123us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 751.105ms, non-child: 23.051us, % non-child: 0.00%) - ConvertRowBatchTime: 10.935us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 364.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 751.086ms - DataArrivalTimer: 751.083ms SenderSide: - DeserializeRowBatchTimer: 108.753us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 7s636ms, % non-child: 1.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501164) - BuildTime: 4s778ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660321) - ProbeRows: 19.58M (19580791) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s225ms - RowsReturned: 1.44M (1435882) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s202ms - BuildRowsPartitioned: 9.50M (9501164) - GetNewBlockTime: 1.377ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.12K (50116) - HashTablesBuildTime: 561.695ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m26s, non-child: 362.606ms, % non-child: 0.42%) - ConvertRowBatchTime: 262.912ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501164) - RowsReturnedRate: 110.17 K/sec RecvrSide: BytesReceived(16s000ms): 61.51 MB, 168.13 MB, 209.19 MB, 219.55 MB, 223.09 MB, 224.12 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 881.022ms - TotalBytesReceived: 224.23 MB (235123469) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s381ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s334ms, % non-child: 0.24%) - ConvertRowBatchTime: 703.677ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580791) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.26 MB, 10.00 MB, 10.00 MB, 10.00 MB, 22.60 MB, 242.66 MB, 607.94 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s204ms - TotalBytesReceived: 2.66 GB (2855704822) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s325ms - NumBatchesAccepted: 113.92K (113915) - NumBatchesRejected: 101 (101) Instance 5f429df048b5534b:41bcce18000001b9 (host=foo.221.35:22000):(Total: 10m35s, non-child: 4s215ms, % non-child: 0.66%) MemoryUsage(16s000ms): 122.88 MB, 284.00 MB, 289.39 MB, 289.39 MB, 289.39 MB, 371.69 MB, 536.80 MB, 536.72 MB, 537.17 MB, 536.75 MB, 536.82 MB, 536.63 MB, 536.93 MB, 536.65 MB, 536.79 MB, 536.84 MB, 536.69 MB, 536.71 MB, 536.56 MB, 536.68 MB, 536.82 MB, 536.61 MB, 536.76 MB, 536.93 MB, 536.81 MB, 536.81 MB, 536.86 MB, 536.61 MB, 536.68 MB, 536.81 MB, 536.57 MB, 536.79 MB, 536.83 MB, 536.48 MB, 536.68 MB, 536.76 MB, 536.92 MB, 536.15 MB, 536.89 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.33 MB (572870804) - PerHostPeakMemUsage: 1.34 GB (1442599544) - RowsProduced: 1.43M (1434154) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 137.171ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.71K (7714) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s283ms - TotalThreadsUserTime: 20s975ms - TotalThreadsVoluntaryContextSwitches: 122.50K (122496) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 55.434ms - ExecTreePrepareTime: 537.768us DataStreamSender (dst_id=23):(Total: 3s608ms, non-child: 3s608ms, % non-child: 100.00%) - BytesSent: 253.81 MB (266138689) - OverallThroughput: 70.34 MB/sec - PeakMemoryUsage: 6.16 MB (6455680) - RowsReturned: 1.43M (1434154) - SerializeBatchTime: 3s604ms - UncompressedRowBatchSize: 253.81 MB (266138689) CodeGen:(Total: 484.588ms, non-child: 484.588ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 158.530ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.618ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 42.346ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 279.180ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 660.570us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4484140) - ProbeRows: 1.43M (1434154) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.171ms - RowsReturned: 1.43M (1434154) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 49.096us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 408.350us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.979us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s018ms, non-child: 18.363us, % non-child: 0.00%) - ConvertRowBatchTime: 7.838us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 268.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s018ms - DataArrivalTimer: 1s018ms SenderSide: - DeserializeRowBatchTimer: 82.049us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s321ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503627) - BuildTime: 5s018ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661701) - ProbeRows: 19.58M (19580299) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s850ms - RowsReturned: 1.43M (1434154) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s357ms - BuildRowsPartitioned: 9.50M (9503627) - GetNewBlockTime: 1.259ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.99K (49990) - HashTablesBuildTime: 648.083ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 384.520ms, % non-child: 0.45%) - ConvertRowBatchTime: 274.208ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503627) - RowsReturnedRate: 111.50 K/sec RecvrSide: BytesReceived(16s000ms): 55.66 MB, 164.64 MB, 208.30 MB, 219.35 MB, 223.05 MB, 224.17 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 1s153ms - TotalBytesReceived: 224.29 MB (235182490) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s642ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s358ms, % non-child: 0.25%) - ConvertRowBatchTime: 709.751ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580299) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.77 MB, 10.02 MB, 10.02 MB, 10.02 MB, 18.97 MB, 227.29 MB, 589.60 MB, 1009.41 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s485ms - TotalBytesReceived: 2.66 GB (2855722886) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s205ms - NumBatchesAccepted: 113.91K (113906) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce180000019d (host=foo.232.28:22000):(Total: 10m34s, non-child: 5s557ms, % non-child: 0.88%) MemoryUsage(16s000ms): 131.52 MB, 284.63 MB, 289.37 MB, 289.37 MB, 289.37 MB, 387.58 MB, 536.77 MB, 536.92 MB, 537.17 MB, 536.89 MB, 536.94 MB, 536.93 MB, 536.76 MB, 536.63 MB, 536.89 MB, 536.81 MB, 536.70 MB, 536.41 MB, 536.61 MB, 536.72 MB, 536.78 MB, 536.80 MB, 536.70 MB, 536.67 MB, 536.50 MB, 536.69 MB, 536.89 MB, 536.72 MB, 536.82 MB, 536.69 MB, 536.76 MB, 536.41 MB, 536.95 MB, 537.01 MB, 536.31 MB, 536.42 MB, 536.51 MB, 536.81 MB, 536.66 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.44 MB (572980305) - PerHostPeakMemUsage: 1.43 GB (1534517528) - RowsProduced: 1.43M (1431390) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 1s050ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7859) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s315ms - TotalThreadsUserTime: 21s443ms - TotalThreadsVoluntaryContextSwitches: 121.96K (121957) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 31.290ms - ExecTreePrepareTime: 470.755us DataStreamSender (dst_id=23):(Total: 3s640ms, non-child: 3s640ms, % non-child: 100.00%) - BytesSent: 253.34 MB (265646626) - OverallThroughput: 69.59 MB/sec - PeakMemoryUsage: 5.88 MB (6160768) - RowsReturned: 1.43M (1431390) - SerializeBatchTime: 3s635ms - UncompressedRowBatchSize: 253.34 MB (265646626) CodeGen:(Total: 470.483ms, non-child: 470.483ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 308.307ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.409ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 283.967ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 730.612us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493500) - ProbeRows: 1.43M (1431390) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 271.630ms - RowsReturned: 1.43M (1431390) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 55.959us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 391.882us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.270us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 455.855ms, non-child: 20.014us, % non-child: 0.00%) - ConvertRowBatchTime: 8.007us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 601.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 455.840ms - DataArrivalTimer: 455.836ms SenderSide: - DeserializeRowBatchTimer: 177.070us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s564ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500865) - BuildTime: 4s891ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661454) - ProbeRows: 19.57M (19572815) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s093ms - RowsReturned: 1.43M (1431390) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s176ms - BuildRowsPartitioned: 9.50M (9500865) - GetNewBlockTime: 1.968ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.99K (49986) - HashTablesBuildTime: 700.883ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 388.529ms, % non-child: 0.46%) - ConvertRowBatchTime: 271.256ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500865) - RowsReturnedRate: 112.58 K/sec RecvrSide: BytesReceived(16s000ms): 60.10 MB, 167.31 MB, 208.97 MB, 219.53 MB, 223.08 MB, 224.12 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 587.142ms - TotalBytesReceived: 224.23 MB (235120085) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s759ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s408ms, % non-child: 0.26%) - ConvertRowBatchTime: 735.500ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572815) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.14 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.03 MB, 239.24 MB, 603.42 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s909ms - TotalBytesReceived: 2.66 GB (2854671242) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s717ms - NumBatchesAccepted: 113.86K (113862) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce1800000197 (host=foo.221.39:22000):(Total: 10m34s, non-child: 5s233ms, % non-child: 0.82%) MemoryUsage(16s000ms): 123.35 MB, 284.38 MB, 289.38 MB, 289.38 MB, 289.38 MB, 384.68 MB, 536.80 MB, 536.80 MB, 536.93 MB, 537.10 MB, 536.63 MB, 536.93 MB, 536.93 MB, 536.85 MB, 536.57 MB, 536.64 MB, 536.44 MB, 536.37 MB, 536.73 MB, 536.66 MB, 536.94 MB, 536.80 MB, 536.74 MB, 536.66 MB, 536.85 MB, 536.68 MB, 536.61 MB, 536.74 MB, 536.69 MB, 536.80 MB, 536.74 MB, 536.61 MB, 536.70 MB, 536.75 MB, 536.82 MB, 536.50 MB, 536.45 MB, 537.24 MB, 536.95 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.22 MB (572757718) - PerHostPeakMemUsage: 1.37 GB (1474043505) - RowsProduced: 1.43M (1431760) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 794.195ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.75K (7752) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s343ms - TotalThreadsUserTime: 21s503ms - TotalThreadsVoluntaryContextSwitches: 122.27K (122272) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 39.355ms - ExecTreePrepareTime: 389.717us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.35 MB (265655375) - OverallThroughput: 69.58 MB/sec - PeakMemoryUsage: 6.45 MB (6758784) - RowsReturned: 1.43M (1431760) - SerializeBatchTime: 3s636ms - UncompressedRowBatchSize: 253.35 MB (265655375) CodeGen:(Total: 450.921ms, non-child: 450.921ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 279.420ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 30.286ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 293.775ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 624.775us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490122) - ProbeRows: 1.43M (1431760) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 281.877ms - RowsReturned: 1.43M (1431760) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.683us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 367.969us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.617us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s009ms, non-child: 26.080us, % non-child: 0.00%) - ConvertRowBatchTime: 7.680us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 271.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s009ms - DataArrivalTimer: 1s009ms SenderSide: - DeserializeRowBatchTimer: 125.716us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s505ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500328) - BuildTime: 5s199ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661826) - ProbeRows: 19.57M (19569972) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s042ms - RowsReturned: 1.43M (1431760) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s544ms - BuildRowsPartitioned: 9.50M (9500328) - GetNewBlockTime: 1.988ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.27K (50271) - HashTablesBuildTime: 638.920ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 396.038ms, % non-child: 0.47%) - ConvertRowBatchTime: 277.500ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500328) - RowsReturnedRate: 112.36 K/sec RecvrSide: BytesReceived(16s000ms): 58.14 MB, 166.04 MB, 208.60 MB, 219.37 MB, 223.00 MB, 224.08 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 1s133ms - TotalBytesReceived: 224.20 MB (235087505) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s666ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s367ms, % non-child: 0.25%) - ConvertRowBatchTime: 727.660ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569972) - RowsReturnedRate: 35.66 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.99 MB, 10.01 MB, 10.01 MB, 10.01 MB, 20.65 MB, 233.76 MB, 597.05 MB, 1017.69 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s494ms - TotalBytesReceived: 2.66 GB (2854282039) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s481ms - NumBatchesAccepted: 113.84K (113839) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce18000001f0 (host=foo.232.35:22000):(Total: 10m34s, non-child: 4s500ms, % non-child: 0.71%) MemoryUsage(16s000ms): 131.89 MB, 284.88 MB, 289.39 MB, 289.39 MB, 289.39 MB, 368.97 MB, 536.98 MB, 536.58 MB, 536.99 MB, 536.88 MB, 536.73 MB, 536.73 MB, 536.85 MB, 536.68 MB, 536.70 MB, 536.74 MB, 536.91 MB, 536.52 MB, 536.65 MB, 536.85 MB, 536.85 MB, 536.80 MB, 536.87 MB, 536.76 MB, 536.54 MB, 536.89 MB, 536.55 MB, 536.74 MB, 536.61 MB, 536.72 MB, 536.73 MB, 536.67 MB, 536.49 MB, 536.77 MB, 536.87 MB, 536.61 MB, 536.68 MB, 536.68 MB, 537.46 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.64 MB (573191798) - PerHostPeakMemUsage: 1.30 GB (1400725701) - RowsProduced: 1.43M (1431993) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 260.493ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.59K (7588) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s242ms - TotalThreadsUserTime: 20s648ms - TotalThreadsVoluntaryContextSwitches: 122.06K (122060) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.616ms - ExecTreePrepareTime: 335.407us DataStreamSender (dst_id=23):(Total: 3s614ms, non-child: 3s614ms, % non-child: 100.00%) - BytesSent: 253.41 MB (265720729) - OverallThroughput: 70.10 MB/sec - PeakMemoryUsage: 6.22 MB (6521216) - RowsReturned: 1.43M (1431993) - SerializeBatchTime: 3s611ms - UncompressedRowBatchSize: 253.41 MB (265720729) CodeGen:(Total: 441.178ms, non-child: 441.178ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.238ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 267.932ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.448ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 281.068ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 372.282us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490812) - ProbeRows: 1.43M (1431993) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 269.388ms - RowsReturned: 1.43M (1431993) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 31.502us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 194.378us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.786us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 465.433ms, non-child: 20.425us, % non-child: 0.00%) - ConvertRowBatchTime: 9.070us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 588.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 465.417ms - DataArrivalTimer: 465.413ms SenderSide: - DeserializeRowBatchTimer: 45.712us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s209ms, % non-child: 1.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499583) - BuildTime: 5s009ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657515) - ProbeRows: 19.57M (19572681) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s794ms - RowsReturned: 1.43M (1431993) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s360ms - BuildRowsPartitioned: 9.50M (9499583) - GetNewBlockTime: 1.476ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.74K (49741) - HashTablesBuildTime: 633.284ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 389.695ms, % non-child: 0.45%) - ConvertRowBatchTime: 274.236ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499583) - RowsReturnedRate: 110.81 K/sec RecvrSide: BytesReceived(16s000ms): 61.76 MB, 168.22 MB, 209.19 MB, 219.51 MB, 223.05 MB, 224.08 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB - FirstBatchArrivalWaitTime: 583.448ms - TotalBytesReceived: 224.18 MB (235073060) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s627ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s343ms, % non-child: 0.25%) - ConvertRowBatchTime: 692.703ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572681) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.29 MB, 10.02 MB, 10.02 MB, 10.02 MB, 22.84 MB, 243.45 MB, 608.89 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s925ms - TotalBytesReceived: 2.66 GB (2854606087) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 15s855ms - NumBatchesAccepted: 113.86K (113864) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001c2 (host=foo.232.52:22000):(Total: 10m34s, non-child: 5s673ms, % non-child: 0.89%) MemoryUsage(16s000ms): 141.12 MB, 285.39 MB, 289.37 MB, 289.36 MB, 289.36 MB, 392.81 MB, 536.96 MB, 536.89 MB, 536.89 MB, 537.12 MB, 536.66 MB, 537.01 MB, 536.78 MB, 536.89 MB, 536.80 MB, 536.61 MB, 536.82 MB, 537.22 MB, 536.86 MB, 536.65 MB, 536.89 MB, 536.91 MB, 536.65 MB, 536.68 MB, 536.69 MB, 536.81 MB, 536.67 MB, 536.70 MB, 536.99 MB, 536.64 MB, 536.96 MB, 536.58 MB, 536.64 MB, 536.68 MB, 536.82 MB, 536.44 MB, 536.58 MB, 537.27 MB, 536.28 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.59 MB (573136931) - PerHostPeakMemUsage: 1.41 GB (1515314840) - RowsProduced: 1.43M (1432715) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 1s350ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7860) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s393ms - TotalThreadsUserTime: 21s409ms - TotalThreadsVoluntaryContextSwitches: 122.65K (122648) Fragment Instance Lifecycle Timings: - ExecTime: 9m5s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 35.217ms - ExecTreePrepareTime: 211.710us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.47 MB (265780344) - OverallThroughput: 69.60 MB/sec - PeakMemoryUsage: 6.20 MB (6496640) - RowsReturned: 1.43M (1432715) - SerializeBatchTime: 3s637ms - UncompressedRowBatchSize: 253.47 MB (265780344) CodeGen:(Total: 477.139ms, non-child: 477.139ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 156.814ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 293.679ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.183ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 298.011ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 545.478us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4486270) - ProbeRows: 1.43M (1432715) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.133ms - RowsReturned: 1.43M (1432715) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.582us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 282.135us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 120.767us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.874us, non-child: 14.874us, % non-child: 100.00%) - ConvertRowBatchTime: 7.898us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.42 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.823us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 86.072us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s476ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501603) - BuildTime: 4s981ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660436) - ProbeRows: 19.57M (19574738) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s063ms - RowsReturned: 1.43M (1432715) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s347ms - BuildRowsPartitioned: 9.50M (9501603) - GetNewBlockTime: 1.324ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.48K (50479) - HashTablesBuildTime: 619.699ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 385.052ms, % non-child: 0.46%) - ConvertRowBatchTime: 271.213ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501603) - RowsReturnedRate: 113.17 K/sec RecvrSide: BytesReceived(16s000ms): 65.91 MB, 170.61 MB, 209.86 MB, 219.73 MB, 223.16 MB, 224.14 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.23 MB (235122360) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s696ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s402ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.040ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574738) - RowsReturnedRate: 35.74 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.60 MB, 10.00 MB, 10.00 MB, 10.00 MB, 25.92 MB, 253.88 MB, 621.18 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s179ms - TotalBytesReceived: 2.66 GB (2854955476) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 17s100ms - NumBatchesAccepted: 113.87K (113873) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce18000001ee (host=foo.232.30:22000):(Total: 10m34s, non-child: 4s453ms, % non-child: 0.70%) MemoryUsage(16s000ms): 131.89 MB, 284.86 MB, 289.39 MB, 289.38 MB, 289.39 MB, 367.88 MB, 536.79 MB, 536.87 MB, 536.92 MB, 536.69 MB, 536.55 MB, 536.97 MB, 536.57 MB, 536.84 MB, 536.73 MB, 536.92 MB, 536.60 MB, 536.23 MB, 536.76 MB, 536.60 MB, 536.55 MB, 536.77 MB, 536.67 MB, 536.80 MB, 536.64 MB, 536.66 MB, 536.86 MB, 536.74 MB, 536.69 MB, 536.55 MB, 536.81 MB, 537.00 MB, 536.58 MB, 536.95 MB, 536.57 MB, 536.59 MB, 536.66 MB, 535.92 MB, 536.90 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572774750) - PerHostPeakMemUsage: 1.40 GB (1502874196) - RowsProduced: 1.43M (1434114) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 331.884ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.03K (8030) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s249ms - TotalThreadsUserTime: 21s063ms - TotalThreadsVoluntaryContextSwitches: 122.05K (122045) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 40.874ms - ExecTreePrepareTime: 540.215us DataStreamSender (dst_id=23):(Total: 3s591ms, non-child: 3s591ms, % non-child: 100.00%) - BytesSent: 253.73 MB (266051427) - OverallThroughput: 70.65 MB/sec - PeakMemoryUsage: 6.20 MB (6504832) - RowsReturned: 1.43M (1434114) - SerializeBatchTime: 3s587ms - UncompressedRowBatchSize: 253.73 MB (266051427) CodeGen:(Total: 494.269ms, non-child: 494.269ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 123.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 338.594ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 31.225ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 286.900ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 628.954us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488454) - ProbeRows: 1.43M (1434114) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 274.729ms - RowsReturned: 1.43M (1434114) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.878us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 326.078us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.634us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 406.490ms, non-child: 18.089us, % non-child: 0.00%) - ConvertRowBatchTime: 8.430us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 674.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 406.476ms - DataArrivalTimer: 406.473ms SenderSide: - DeserializeRowBatchTimer: 138.384us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s457ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503742) - BuildTime: 4s965ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663375) - ProbeRows: 19.57M (19568406) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s981ms - RowsReturned: 1.43M (1434114) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s286ms - BuildRowsPartitioned: 9.50M (9503742) - GetNewBlockTime: 2.360ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.33K (50329) - HashTablesBuildTime: 663.490ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 377.897ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.078ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503742) - RowsReturnedRate: 110.81 K/sec RecvrSide: BytesReceived(16s000ms): 61.66 MB, 168.24 MB, 209.24 MB, 219.61 MB, 223.15 MB, 224.18 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 536.274ms - TotalBytesReceived: 224.28 MB (235177666) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s481ms - NumBatchesAccepted: 16.91K (16914) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s349ms, % non-child: 0.25%) - ConvertRowBatchTime: 717.002ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568406) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.28 MB, 10.02 MB, 10.02 MB, 10.02 MB, 22.74 MB, 242.96 MB, 608.21 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s879ms - TotalBytesReceived: 2.66 GB (2854053205) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s100ms - NumBatchesAccepted: 113.83K (113830) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce18000001c1 (host=foo.232.34:22000):(Total: 10m34s, non-child: 4s932ms, % non-child: 0.78%) MemoryUsage(16s000ms): 131.89 MB, 284.82 MB, 289.39 MB, 289.39 MB, 289.39 MB, 383.99 MB, 536.85 MB, 536.91 MB, 536.90 MB, 536.85 MB, 536.63 MB, 536.64 MB, 536.62 MB, 536.77 MB, 536.85 MB, 536.72 MB, 536.98 MB, 536.51 MB, 536.82 MB, 536.49 MB, 536.78 MB, 536.81 MB, 536.85 MB, 536.74 MB, 536.80 MB, 536.64 MB, 536.49 MB, 536.77 MB, 536.44 MB, 536.71 MB, 536.41 MB, 536.65 MB, 536.74 MB, 536.86 MB, 536.29 MB, 536.56 MB, 536.90 MB, 536.56 MB, 536.37 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.34 MB (572880247) - PerHostPeakMemUsage: 1.42 GB (1529787983) - RowsProduced: 1.43M (1430805) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 634.168ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.06K (8060) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s300ms - TotalThreadsUserTime: 21s544ms - TotalThreadsVoluntaryContextSwitches: 122.64K (122639) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 40.486ms - ExecTreePrepareTime: 636.655us DataStreamSender (dst_id=23):(Total: 3s652ms, non-child: 3s652ms, % non-child: 100.00%) - BytesSent: 253.20 MB (265500108) - OverallThroughput: 69.33 MB/sec - PeakMemoryUsage: 6.50 MB (6816128) - RowsReturned: 1.43M (1430805) - SerializeBatchTime: 3s648ms - UncompressedRowBatchSize: 253.20 MB (265500108) CodeGen:(Total: 477.639ms, non-child: 477.639ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 160.532ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 286.977ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.527ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 291.052ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.601ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.45 MB (4665361) - ProbeRows: 1.43M (1430805) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 279.154ms - RowsReturned: 1.43M (1430805) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 60.172us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.256ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 97.152us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 380.675ms, non-child: 24.759us, % non-child: 0.01%) - ConvertRowBatchTime: 12.950us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 719.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 380.655ms - DataArrivalTimer: 380.651ms SenderSide: - DeserializeRowBatchTimer: 116.486us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s441ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.49M (9494235) - BuildTime: 4s997ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661965) - ProbeRows: 19.57M (19574382) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s037ms - RowsReturned: 1.43M (1430805) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s328ms - BuildRowsPartitioned: 9.49M (9494235) - GetNewBlockTime: 3.445ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.24K (50241) - HashTablesBuildTime: 651.153ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 387.183ms, % non-child: 0.46%) - ConvertRowBatchTime: 272.438ms - PeakMemoryUsage: 0 - RowsReturned: 9.49M (9494235) - RowsReturnedRate: 112.22 K/sec RecvrSide: BytesReceived(16s000ms): 61.19 MB, 167.89 MB, 209.00 MB, 219.39 MB, 222.92 MB, 223.95 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB, 224.06 MB - FirstBatchArrivalWaitTime: 487.414ms - TotalBytesReceived: 224.06 MB (234942293) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s730ms - NumBatchesAccepted: 16.90K (16900) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s401ms, % non-child: 0.26%) - ConvertRowBatchTime: 727.812ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574382) - RowsReturnedRate: 35.69 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.26 MB, 10.02 MB, 10.02 MB, 10.02 MB, 22.66 MB, 241.94 MB, 606.73 MB, 1.00 GB, 1.40 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s823ms - TotalBytesReceived: 2.66 GB (2854752123) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s826ms - NumBatchesAccepted: 113.87K (113869) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001a6 (host=foo.221.23:22000):(Total: 10m34s, non-child: 4s315ms, % non-child: 0.68%) MemoryUsage(16s000ms): 122.96 MB, 284.04 MB, 289.40 MB, 289.40 MB, 289.40 MB, 378.84 MB, 537.10 MB, 537.02 MB, 536.92 MB, 536.57 MB, 536.68 MB, 536.78 MB, 536.49 MB, 536.99 MB, 536.75 MB, 536.54 MB, 536.79 MB, 537.26 MB, 536.54 MB, 536.68 MB, 536.57 MB, 536.83 MB, 536.92 MB, 536.79 MB, 536.63 MB, 536.83 MB, 536.86 MB, 536.79 MB, 536.53 MB, 536.74 MB, 536.54 MB, 536.61 MB, 536.76 MB, 536.51 MB, 536.78 MB, 536.60 MB, 536.51 MB, 536.40 MB, 537.07 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.30 MB (572835980) - PerHostPeakMemUsage: 1.32 GB (1417043785) - RowsProduced: 1.44M (1435044) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 77.442ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.99K (7990) - TotalThreadsTotalWallClockTime: 12m6s - TotalThreadsSysTime: 2s300ms - TotalThreadsUserTime: 21s185ms - TotalThreadsVoluntaryContextSwitches: 123.23K (123232) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 39.177ms - ExecTreePrepareTime: 423.499us DataStreamSender (dst_id=23):(Total: 3s646ms, non-child: 3s646ms, % non-child: 100.00%) - BytesSent: 253.94 MB (266274430) - OverallThroughput: 69.64 MB/sec - PeakMemoryUsage: 6.06 MB (6357376) - RowsReturned: 1.44M (1435044) - SerializeBatchTime: 3s642ms - UncompressedRowBatchSize: 253.94 MB (266274430) CodeGen:(Total: 443.385ms, non-child: 443.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.070ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 282.507ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.295ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 289.444ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 780.826us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492468) - ProbeRows: 1.44M (1435044) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 277.218ms - RowsReturned: 1.44M (1435044) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.354us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 439.582us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.153us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s250ms, non-child: 24.143us, % non-child: 0.00%) - ConvertRowBatchTime: 12.051us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 219.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s250ms - DataArrivalTimer: 1s250ms SenderSide: - DeserializeRowBatchTimer: 198.712us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s477ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503553) - BuildTime: 4s915ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660055) - ProbeRows: 19.58M (19581090) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s996ms - RowsReturned: 1.44M (1435044) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s230ms - BuildRowsPartitioned: 9.50M (9503553) - GetNewBlockTime: 1.219ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.35K (50351) - HashTablesBuildTime: 671.688ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 381.836ms, % non-child: 0.45%) - ConvertRowBatchTime: 269.044ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503553) - RowsReturnedRate: 111.61 K/sec RecvrSide: BytesReceived(16s000ms): 55.77 MB, 164.67 MB, 208.28 MB, 219.34 MB, 223.04 MB, 224.16 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 1s378ms - TotalBytesReceived: 224.28 MB (235172975) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s630ms - NumBatchesAccepted: 16.91K (16914) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s373ms, % non-child: 0.25%) - ConvertRowBatchTime: 723.109ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19581090) - RowsReturnedRate: 35.63 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.79 MB, 10.02 MB, 10.02 MB, 10.02 MB, 19.17 MB, 227.63 MB, 589.67 MB, 1009.71 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s703ms - TotalBytesReceived: 2.66 GB (2855682840) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 16s267ms - NumBatchesAccepted: 113.91K (113911) - NumBatchesRejected: 87 (87) Instance 5f429df048b5534b:41bcce18000001bf (host=foo.221.50:22000):(Total: 10m34s, non-child: 4s498ms, % non-child: 0.71%) MemoryUsage(16s000ms): 123.35 MB, 284.21 MB, 289.38 MB, 289.38 MB, 289.38 MB, 374.61 MB, 536.91 MB, 537.20 MB, 537.14 MB, 536.71 MB, 537.00 MB, 536.76 MB, 536.92 MB, 536.93 MB, 536.55 MB, 536.66 MB, 536.28 MB, 536.58 MB, 536.93 MB, 536.72 MB, 536.96 MB, 536.95 MB, 536.53 MB, 536.61 MB, 536.66 MB, 536.90 MB, 536.78 MB, 536.58 MB, 536.63 MB, 536.78 MB, 536.67 MB, 536.83 MB, 536.70 MB, 537.00 MB, 536.56 MB, 536.76 MB, 536.67 MB, 536.07 MB, 537.16 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.17 MB (572703452) - PerHostPeakMemUsage: 1.35 GB (1445681303) - RowsProduced: 1.43M (1430009) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 124.542ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.54K (7538) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s364ms - TotalThreadsUserTime: 21s657ms - TotalThreadsVoluntaryContextSwitches: 122.15K (122151) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 43.513ms - ExecTreePrepareTime: 530.078us DataStreamSender (dst_id=23):(Total: 3s650ms, non-child: 3s650ms, % non-child: 100.00%) - BytesSent: 253.03 MB (265317662) - OverallThroughput: 69.31 MB/sec - PeakMemoryUsage: 6.24 MB (6545792) - RowsReturned: 1.43M (1430009) - SerializeBatchTime: 3s646ms - UncompressedRowBatchSize: 253.03 MB (265317662) CodeGen:(Total: 461.593ms, non-child: 461.593ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 129.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 297.911ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.162ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 297.335ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 700.905us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4484564) - ProbeRows: 1.43M (1430009) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 284.782ms - RowsReturned: 1.43M (1430009) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 46.233us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 296.465us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.828us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 855.953ms, non-child: 18.443us, % non-child: 0.00%) - ConvertRowBatchTime: 8.316us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 320.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 855.938ms - DataArrivalTimer: 855.936ms SenderSide: - DeserializeRowBatchTimer: 199.369us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s797ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501206) - BuildTime: 5s175ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662059) - ProbeRows: 19.57M (19570611) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s219ms - RowsReturned: 1.43M (1430009) - RowsReturnedRate: 2.28 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s508ms - BuildRowsPartitioned: 9.50M (9501206) - GetNewBlockTime: 2.665ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.14K (50142) - HashTablesBuildTime: 655.299ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 391.685ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.306ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501206) - RowsReturnedRate: 111.88 K/sec RecvrSide: BytesReceived(16s000ms): 56.99 MB, 165.39 MB, 208.46 MB, 219.37 MB, 223.02 MB, 224.12 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 990.029ms - TotalBytesReceived: 224.23 MB (235124628) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s716ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s389ms, % non-child: 0.25%) - ConvertRowBatchTime: 733.816ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19570611) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.89 MB, 10.01 MB, 10.01 MB, 10.01 MB, 19.86 MB, 230.76 MB, 593.31 MB, 1013.45 MB, 1.38 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s369ms - TotalBytesReceived: 2.66 GB (2854509359) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s528ms - NumBatchesAccepted: 113.84K (113840) - NumBatchesRejected: 92 (92) Instance 5f429df048b5534b:41bcce18000001f7 (host=foo.234.50:22000):(Total: 10m34s, non-child: 5s099ms, % non-child: 0.80%) MemoryUsage(16s000ms): 148.29 MB, 285.48 MB, 289.36 MB, 289.36 MB, 289.36 MB, 377.89 MB, 536.79 MB, 537.14 MB, 536.65 MB, 537.03 MB, 536.91 MB, 536.73 MB, 536.83 MB, 536.84 MB, 536.40 MB, 536.73 MB, 537.05 MB, 536.61 MB, 536.41 MB, 536.72 MB, 536.45 MB, 536.49 MB, 536.68 MB, 536.70 MB, 536.77 MB, 536.66 MB, 536.65 MB, 536.63 MB, 536.54 MB, 536.73 MB, 536.65 MB, 536.80 MB, 536.59 MB, 536.76 MB, 536.76 MB, 536.80 MB, 536.67 MB, 536.39 MB, 536.88 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572787798) - PerHostPeakMemUsage: 1.28 GB (1371316406) - RowsProduced: 1.43M (1434275) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 290.610ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.15K (8150) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s281ms - TotalThreadsUserTime: 21s751ms - TotalThreadsVoluntaryContextSwitches: 122.13K (122127) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 33.782ms - ExecTreePrepareTime: 439.016us DataStreamSender (dst_id=23):(Total: 3s662ms, non-child: 3s662ms, % non-child: 100.00%) - BytesSent: 253.84 MB (266173393) - OverallThroughput: 69.31 MB/sec - PeakMemoryUsage: 6.59 MB (6906240) - RowsReturned: 1.43M (1434275) - SerializeBatchTime: 3s657ms - UncompressedRowBatchSize: 253.84 MB (266173393) CodeGen:(Total: 430.104ms, non-child: 430.104ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 264.351ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.283ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 311.319ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 644.961us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492725) - ProbeRows: 1.43M (1434275) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 298.149ms - RowsReturned: 1.43M (1434275) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.321us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 353.623us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.113us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.234us, non-child: 16.234us, % non-child: 100.00%) - ConvertRowBatchTime: 8.296us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.88 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.619us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 113.289us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s833ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498199) - BuildTime: 5s073ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658859) - ProbeRows: 19.57M (19572848) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s372ms - RowsReturned: 1.43M (1434275) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s482ms - BuildRowsPartitioned: 9.50M (9498199) - GetNewBlockTime: 1.771ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.73K (49731) - HashTablesBuildTime: 579.065ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 386.537ms, % non-child: 0.45%) - ConvertRowBatchTime: 274.229ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498199) - RowsReturnedRate: 111.66 K/sec RecvrSide: BytesReceived(16s000ms): 66.71 MB, 171.00 MB, 209.88 MB, 219.70 MB, 223.12 MB, 224.08 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 35.256ms - TotalBytesReceived: 224.17 MB (235057879) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s579ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s405ms, % non-child: 0.26%) - ConvertRowBatchTime: 746.216ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572848) - RowsReturnedRate: 35.79 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.65 MB, 10.00 MB, 10.00 MB, 10.00 MB, 26.32 MB, 256.08 MB, 623.91 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s389ms - TotalBytesReceived: 2.66 GB (2854792199) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s571ms - NumBatchesAccepted: 113.86K (113861) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001b2 (host=foo.221.51:22000):(Total: 10m34s, non-child: 4s483ms, % non-child: 0.71%) MemoryUsage(16s000ms): 131.35 MB, 284.65 MB, 289.40 MB, 289.40 MB, 289.40 MB, 381.10 MB, 536.67 MB, 537.23 MB, 536.67 MB, 536.82 MB, 536.98 MB, 536.54 MB, 536.99 MB, 536.98 MB, 536.45 MB, 536.73 MB, 536.92 MB, 536.95 MB, 536.81 MB, 536.90 MB, 536.63 MB, 536.68 MB, 536.85 MB, 536.82 MB, 536.79 MB, 536.66 MB, 536.46 MB, 536.93 MB, 536.48 MB, 536.65 MB, 536.60 MB, 536.84 MB, 536.47 MB, 536.59 MB, 536.77 MB, 536.74 MB, 536.59 MB, 536.89 MB, 536.38 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.49 MB (573040966) - PerHostPeakMemUsage: 1.34 GB (1434765277) - RowsProduced: 1.43M (1433593) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 78.931ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.78K (7781) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s345ms - TotalThreadsUserTime: 21s431ms - TotalThreadsVoluntaryContextSwitches: 122.28K (122279) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 41.727ms - ExecTreePrepareTime: 830.245us DataStreamSender (dst_id=23):(Total: 3s678ms, non-child: 3s678ms, % non-child: 100.00%) - BytesSent: 253.64 MB (265957344) - OverallThroughput: 68.94 MB/sec - PeakMemoryUsage: 6.43 MB (6742400) - RowsReturned: 1.43M (1433593) - SerializeBatchTime: 3s674ms - UncompressedRowBatchSize: 253.64 MB (265957344) CodeGen:(Total: 459.831ms, non-child: 459.831ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 288.744ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 30.977ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 308.589ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 494.927us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4486803) - ProbeRows: 1.43M (1433593) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.979ms - RowsReturned: 1.43M (1433593) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.080us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 310.552us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.384us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 858.354ms, non-child: 18.397us, % non-child: 0.00%) - ConvertRowBatchTime: 7.728us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 319.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 858.339ms - DataArrivalTimer: 858.336ms SenderSide: - DeserializeRowBatchTimer: 49.350us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s711ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502112) - BuildTime: 4s977ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546667860) - ProbeRows: 19.57M (19568234) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s222ms - RowsReturned: 1.43M (1433593) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s315ms - BuildRowsPartitioned: 9.50M (9502112) - GetNewBlockTime: 1.295ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.08K (50078) - HashTablesBuildTime: 650.085ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 380.496ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.288ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502112) - RowsReturnedRate: 111.66 K/sec RecvrSide: BytesReceived(16s000ms): 60.03 MB, 167.29 MB, 208.97 MB, 219.53 MB, 223.10 MB, 224.14 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 980.579ms - TotalBytesReceived: 224.25 MB (235144331) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s642ms - NumBatchesAccepted: 16.91K (16914) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s390ms, % non-child: 0.25%) - ConvertRowBatchTime: 734.618ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568234) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.15 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.86 MB, 239.40 MB, 603.61 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s310ms - TotalBytesReceived: 2.66 GB (2853826363) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s654ms - NumBatchesAccepted: 113.83K (113825) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce18000001f9 (host=foo.232.48:22000):(Total: 10m34s, non-child: 4s896ms, % non-child: 0.77%) MemoryUsage(16s000ms): 140.32 MB, 285.39 MB, 289.40 MB, 289.40 MB, 289.40 MB, 375.22 MB, 536.85 MB, 537.03 MB, 536.76 MB, 537.12 MB, 537.12 MB, 536.77 MB, 536.92 MB, 536.90 MB, 536.57 MB, 536.69 MB, 536.60 MB, 536.57 MB, 536.68 MB, 536.63 MB, 536.92 MB, 536.68 MB, 536.84 MB, 536.56 MB, 536.55 MB, 536.67 MB, 536.54 MB, 536.62 MB, 536.95 MB, 536.71 MB, 536.88 MB, 536.64 MB, 536.47 MB, 536.86 MB, 537.00 MB, 536.73 MB, 536.41 MB, 536.73 MB, 536.20 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.31 MB (572845126) - PerHostPeakMemUsage: 1.35 GB (1451278507) - RowsProduced: 1.43M (1432481) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 86.633ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.22K (8224) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s376ms - TotalThreadsUserTime: 21s970ms - TotalThreadsVoluntaryContextSwitches: 122.41K (122414) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m54s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.351ms - ExecTreePrepareTime: 574.210us DataStreamSender (dst_id=23):(Total: 3s658ms, non-child: 3s658ms, % non-child: 100.00%) - BytesSent: 253.57 MB (265890079) - OverallThroughput: 69.30 MB/sec - PeakMemoryUsage: 6.29 MB (6594944) - RowsReturned: 1.43M (1432481) - SerializeBatchTime: 3s654ms - UncompressedRowBatchSize: 253.57 MB (265890079) CodeGen:(Total: 430.853ms, non-child: 430.853ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 145.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 263.131ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.911ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 302.469ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 410.893us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491289) - ProbeRows: 1.43M (1432481) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 289.353ms - RowsReturned: 1.43M (1432481) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.188us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 227.829us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.018us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.362us, non-child: 15.362us, % non-child: 100.00%) - ConvertRowBatchTime: 7.754us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.84 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.777us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 68.796us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s947ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504049) - BuildTime: 5s217ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662269) - ProbeRows: 19.58M (19579224) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s322ms - RowsReturned: 1.43M (1432481) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s491ms - BuildRowsPartitioned: 9.50M (9504049) - GetNewBlockTime: 1.239ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.10K (50098) - HashTablesBuildTime: 713.097ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 386.046ms, % non-child: 0.45%) - ConvertRowBatchTime: 275.171ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504049) - RowsReturnedRate: 111.31 K/sec RecvrSide: BytesReceived(16s000ms): 65.70 MB, 170.53 MB, 209.86 MB, 219.79 MB, 223.23 MB, 224.21 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB, 224.31 MB - FirstBatchArrivalWaitTime: 342.458ms - TotalBytesReceived: 224.31 MB (235200899) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s593ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s441ms, % non-child: 0.26%) - ConvertRowBatchTime: 751.562ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19579224) - RowsReturnedRate: 35.80 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.60 MB, 10.02 MB, 10.02 MB, 10.02 MB, 25.56 MB, 253.57 MB, 620.73 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s664ms - TotalBytesReceived: 2.66 GB (2855578692) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s993ms - NumBatchesAccepted: 113.89K (113893) - NumBatchesRejected: 110 (110) Instance 5f429df048b5534b:41bcce18000001a7 (host=foo.221.48:22000):(Total: 10m34s, non-child: 4s234ms, % non-child: 0.67%) MemoryUsage(16s000ms): 131.35 MB, 284.53 MB, 289.40 MB, 289.40 MB, 289.40 MB, 386.21 MB, 536.79 MB, 536.73 MB, 536.82 MB, 536.74 MB, 536.99 MB, 536.93 MB, 536.71 MB, 536.94 MB, 536.57 MB, 536.78 MB, 536.39 MB, 537.24 MB, 536.49 MB, 536.79 MB, 536.81 MB, 536.72 MB, 536.65 MB, 536.71 MB, 536.58 MB, 536.78 MB, 536.76 MB, 536.77 MB, 536.62 MB, 536.74 MB, 536.54 MB, 536.51 MB, 536.52 MB, 536.67 MB, 536.70 MB, 536.81 MB, 536.77 MB, 537.23 MB, 535.79 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.42 MB (572963370) - PerHostPeakMemUsage: 1.32 GB (1419969646) - RowsProduced: 1.44M (1435724) - TotalNetworkReceiveTime: 10m34s - TotalNetworkSendTime: 144.241ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.04K (8043) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s301ms - TotalThreadsUserTime: 20s728ms - TotalThreadsVoluntaryContextSwitches: 122.48K (122476) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 33.221ms - ExecTreePrepareTime: 500.791us DataStreamSender (dst_id=23):(Total: 3s624ms, non-child: 3s624ms, % non-child: 100.00%) - BytesSent: 254.02 MB (266356575) - OverallThroughput: 70.09 MB/sec - PeakMemoryUsage: 6.61 MB (6930816) - RowsReturned: 1.44M (1435724) - SerializeBatchTime: 3s619ms - UncompressedRowBatchSize: 254.02 MB (266356575) CodeGen:(Total: 450.356ms, non-child: 450.356ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 137.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.091ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.765ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 287.851ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 716.235us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489690) - ProbeRows: 1.44M (1435724) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 275.928ms - RowsReturned: 1.44M (1435724) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.176us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 394.674us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.022us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 912.580ms, non-child: 19.195us, % non-child: 0.00%) - ConvertRowBatchTime: 8.125us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 300.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 912.565ms - DataArrivalTimer: 912.562ms SenderSide: - DeserializeRowBatchTimer: 59.948us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m26s, non-child: 8s295ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9508815) - BuildTime: 4s807ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660359) - ProbeRows: 19.57M (19573321) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s886ms - RowsReturned: 1.44M (1435724) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s103ms - BuildRowsPartitioned: 9.51M (9508815) - GetNewBlockTime: 1.084ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.02K (50017) - HashTablesBuildTime: 689.640ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 385.370ms, % non-child: 0.45%) - ConvertRowBatchTime: 268.512ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9508815) - RowsReturnedRate: 111.96 K/sec RecvrSide: BytesReceived(16s000ms): 59.46 MB, 167.07 MB, 209.06 MB, 219.67 MB, 223.25 MB, 224.31 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB, 224.41 MB - FirstBatchArrivalWaitTime: 1s030ms - TotalBytesReceived: 224.41 MB (235315483) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s673ms - NumBatchesAccepted: 16.92K (16923) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m9s, non-child: 1s375ms, % non-child: 0.25%) - ConvertRowBatchTime: 720.020ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573321) - RowsReturnedRate: 35.62 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.09 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.42 MB, 237.13 MB, 600.84 MB, 1021.98 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s369ms - TotalBytesReceived: 2.66 GB (2854783508) - TotalGetBatchTime: 9m8s - DataArrivalTimer: 9m8s SenderSide: - DeserializeRowBatchTimer: 15s944ms - NumBatchesAccepted: 113.86K (113859) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce18000001e4 (host=foo.232.44:22000):(Total: 10m34s, non-child: 4s843ms, % non-child: 0.76%) MemoryUsage(16s000ms): 140.11 MB, 285.19 MB, 289.38 MB, 289.38 MB, 289.38 MB, 372.22 MB, 536.99 MB, 537.02 MB, 536.94 MB, 536.81 MB, 536.91 MB, 536.69 MB, 536.62 MB, 536.83 MB, 536.63 MB, 536.60 MB, 536.46 MB, 536.37 MB, 536.63 MB, 536.82 MB, 536.56 MB, 536.68 MB, 536.62 MB, 536.76 MB, 536.86 MB, 536.66 MB, 536.70 MB, 536.80 MB, 536.70 MB, 536.75 MB, 536.59 MB, 536.74 MB, 536.60 MB, 536.71 MB, 536.62 MB, 536.69 MB, 536.69 MB, 536.92 MB, 536.81 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 548.33 MB (574964182) - PerHostPeakMemUsage: 1.36 GB (1459149788) - RowsProduced: 1.43M (1430763) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 642.311ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.14K (8136) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s259ms - TotalThreadsUserTime: 21s644ms - TotalThreadsVoluntaryContextSwitches: 122.64K (122636) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 36.211ms - ExecTreePrepareTime: 405.520us DataStreamSender (dst_id=23):(Total: 3s615ms, non-child: 3s615ms, % non-child: 100.00%) - BytesSent: 253.17 MB (265471712) - OverallThroughput: 70.03 MB/sec - PeakMemoryUsage: 6.29 MB (6594944) - RowsReturned: 1.43M (1430763) - SerializeBatchTime: 3s610ms - UncompressedRowBatchSize: 253.17 MB (265471712) CodeGen:(Total: 475.099ms, non-child: 475.099ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.963ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 301.031ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.577ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 290.050ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 628.592us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489192) - ProbeRows: 1.43M (1430763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.439ms - RowsReturned: 1.43M (1430763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 37.787us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 334.378us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.261us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 235.284ms, non-child: 26.624us, % non-child: 0.01%) - ConvertRowBatchTime: 16.201us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 235.261ms - DataArrivalTimer: 235.258ms SenderSide: - DeserializeRowBatchTimer: 152.425us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s716ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498414) - BuildTime: 5s281ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660919) - ProbeRows: 19.57M (19567476) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s102ms - RowsReturned: 1.43M (1430763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s573ms - BuildRowsPartitioned: 9.50M (9498414) - GetNewBlockTime: 1.792ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.76K (49755) - HashTablesBuildTime: 695.166ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 387.488ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.513ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498414) - RowsReturnedRate: 111.48 K/sec RecvrSide: BytesReceived(16s000ms): 64.12 MB, 169.57 MB, 209.51 MB, 219.59 MB, 223.08 MB, 224.07 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 282.101ms - TotalBytesReceived: 224.17 MB (235057866) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s709ms - NumBatchesAccepted: 16.91K (16905) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s401ms, % non-child: 0.26%) - ConvertRowBatchTime: 723.654ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19567476) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.48 MB, 10.01 MB, 10.01 MB, 10.01 MB, 24.63 MB, 249.59 MB, 616.00 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s605ms - TotalBytesReceived: 2.66 GB (2853827728) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s500ms - NumBatchesAccepted: 113.83K (113833) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001d6 (host=foo.232.45:22000):(Total: 10m34s, non-child: 4s892ms, % non-child: 0.77%) MemoryUsage(16s000ms): 139.89 MB, 285.01 MB, 289.38 MB, 289.37 MB, 289.38 MB, 384.40 MB, 536.90 MB, 537.08 MB, 536.95 MB, 536.71 MB, 536.71 MB, 536.83 MB, 536.76 MB, 536.95 MB, 536.45 MB, 536.97 MB, 536.83 MB, 536.43 MB, 536.46 MB, 536.82 MB, 536.71 MB, 536.82 MB, 536.60 MB, 536.72 MB, 536.61 MB, 536.98 MB, 536.73 MB, 536.72 MB, 536.47 MB, 536.85 MB, 536.67 MB, 536.97 MB, 536.77 MB, 536.68 MB, 536.71 MB, 536.82 MB, 536.45 MB, 536.60 MB, 536.85 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.39 MB (572932634) - PerHostPeakMemUsage: 1.33 GB (1424343503) - RowsProduced: 1.43M (1434992) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 400.867ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.18K (8179) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s367ms - TotalThreadsUserTime: 21s623ms - TotalThreadsVoluntaryContextSwitches: 122.59K (122589) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 34.201ms - ExecTreePrepareTime: 472.164us DataStreamSender (dst_id=23):(Total: 3s643ms, non-child: 3s643ms, % non-child: 100.00%) - BytesSent: 253.84 MB (266169183) - OverallThroughput: 69.67 MB/sec - PeakMemoryUsage: 6.59 MB (6906240) - RowsReturned: 1.43M (1434992) - SerializeBatchTime: 3s639ms - UncompressedRowBatchSize: 253.84 MB (266169183) CodeGen:(Total: 465.536ms, non-child: 465.536ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 138.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 301.642ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.289ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 299.106ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.435ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494328) - ProbeRows: 1.43M (1434992) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.836ms - RowsReturned: 1.43M (1434992) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.384us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.062ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.809us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 173.942ms, non-child: 18.303us, % non-child: 0.01%) - ConvertRowBatchTime: 8.055us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.57 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 173.927ms - DataArrivalTimer: 173.924ms SenderSide: - DeserializeRowBatchTimer: 153.897us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s832ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498160) - BuildTime: 5s126ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546664669) - ProbeRows: 19.58M (19576255) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s170ms - RowsReturned: 1.43M (1434992) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s428ms - BuildRowsPartitioned: 9.50M (9498160) - GetNewBlockTime: 1.397ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.76K (49764) - HashTablesBuildTime: 685.300ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 387.993ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.734ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498160) - RowsReturnedRate: 112.39 K/sec RecvrSide: BytesReceived(16s000ms): 63.02 MB, 168.97 MB, 209.33 MB, 219.53 MB, 223.04 MB, 224.06 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 308.228ms - TotalBytesReceived: 224.16 MB (235045737) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s593ms - NumBatchesAccepted: 16.90K (16899) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s421ms, % non-child: 0.26%) - ConvertRowBatchTime: 735.715ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576255) - RowsReturnedRate: 35.73 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.38 MB, 10.01 MB, 10.01 MB, 10.01 MB, 23.88 MB, 246.93 MB, 612.89 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s651ms - TotalBytesReceived: 2.66 GB (2855216208) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s824ms - NumBatchesAccepted: 113.88K (113876) - NumBatchesRejected: 98 (98) Instance 5f429df048b5534b:41bcce18000001e0 (host=foo.232.37:22000):(Total: 10m34s, non-child: 4s631ms, % non-child: 0.73%) MemoryUsage(16s000ms): 140.29 MB, 285.36 MB, 289.38 MB, 289.37 MB, 289.37 MB, 375.73 MB, 536.84 MB, 536.60 MB, 536.84 MB, 536.78 MB, 537.05 MB, 536.67 MB, 536.83 MB, 536.93 MB, 536.59 MB, 536.81 MB, 536.57 MB, 537.39 MB, 536.86 MB, 536.66 MB, 536.72 MB, 536.96 MB, 536.64 MB, 536.82 MB, 536.62 MB, 536.80 MB, 536.74 MB, 536.69 MB, 537.01 MB, 536.70 MB, 536.64 MB, 536.65 MB, 537.00 MB, 536.34 MB, 536.47 MB, 536.50 MB, 536.72 MB, 536.45 MB, 537.03 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.08 MB (572610995) - PerHostPeakMemUsage: 1.34 GB (1437776842) - RowsProduced: 1.43M (1433064) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 362.455ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7862) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s337ms - TotalThreadsUserTime: 21s791ms - TotalThreadsVoluntaryContextSwitches: 122.06K (122058) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 40.659ms - ExecTreePrepareTime: 941.191us DataStreamSender (dst_id=23):(Total: 3s668ms, non-child: 3s668ms, % non-child: 100.00%) - BytesSent: 253.55 MB (265864564) - OverallThroughput: 69.11 MB/sec - PeakMemoryUsage: 6.11 MB (6406528) - RowsReturned: 1.43M (1433064) - SerializeBatchTime: 3s663ms - UncompressedRowBatchSize: 253.55 MB (265864564) CodeGen:(Total: 453.101ms, non-child: 453.101ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.882ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.623ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 301.042ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 497.624us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4657200) - ProbeRows: 1.43M (1433064) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 287.628ms - RowsReturned: 1.43M (1433064) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 62.547us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 215.332us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 104.893us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 187.170ms, non-child: 19.991us, % non-child: 0.01%) - ConvertRowBatchTime: 8.102us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.46 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 187.154ms - DataArrivalTimer: 187.151ms SenderSide: - DeserializeRowBatchTimer: 290.737us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s679ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502694) - BuildTime: 5s267ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546659350) - ProbeRows: 19.57M (19570122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s146ms - RowsReturned: 1.43M (1433064) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s555ms - BuildRowsPartitioned: 9.50M (9502694) - GetNewBlockTime: 1.594ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.91K (49906) - HashTablesBuildTime: 697.069ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 388.270ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.995ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502694) - RowsReturnedRate: 111.50 K/sec RecvrSide: BytesReceived(16s000ms): 65.47 MB, 170.45 MB, 209.84 MB, 219.75 MB, 223.20 MB, 224.17 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB - FirstBatchArrivalWaitTime: 309.913ms - TotalBytesReceived: 224.27 MB (235163003) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s770ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s414ms, % non-child: 0.26%) - ConvertRowBatchTime: 741.079ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19570122) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.58 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.39 MB, 252.75 MB, 619.70 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s646ms - TotalBytesReceived: 2.66 GB (2854370213) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s644ms - NumBatchesAccepted: 113.84K (113843) - NumBatchesRejected: 98 (98) Instance 5f429df048b5534b:41bcce18000001ba (host=foo.232.22:22000):(Total: 10m34s, non-child: 4s475ms, % non-child: 0.71%) MemoryUsage(16s000ms): 131.42 MB, 284.47 MB, 289.38 MB, 289.38 MB, 289.38 MB, 378.43 MB, 536.76 MB, 536.76 MB, 537.05 MB, 537.04 MB, 536.82 MB, 536.87 MB, 536.82 MB, 536.67 MB, 537.00 MB, 536.89 MB, 536.46 MB, 536.63 MB, 536.79 MB, 536.85 MB, 537.04 MB, 537.05 MB, 536.71 MB, 536.55 MB, 536.65 MB, 536.79 MB, 536.51 MB, 536.77 MB, 536.64 MB, 536.74 MB, 536.77 MB, 536.60 MB, 536.72 MB, 536.70 MB, 536.78 MB, 536.74 MB, 536.74 MB, 536.10 MB, 536.52 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.26 MB (572790786) - PerHostPeakMemUsage: 1.42 GB (1527033436) - RowsProduced: 1.43M (1432207) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 65.789ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.99K (7994) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s319ms - TotalThreadsUserTime: 21s348ms - TotalThreadsVoluntaryContextSwitches: 123.41K (123414) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 31.354ms - ExecTreePrepareTime: 481.253us DataStreamSender (dst_id=23):(Total: 3s633ms, non-child: 3s633ms, % non-child: 100.00%) - BytesSent: 253.41 MB (265718888) - OverallThroughput: 69.75 MB/sec - PeakMemoryUsage: 6.32 MB (6627712) - RowsReturned: 1.43M (1432207) - SerializeBatchTime: 3s629ms - UncompressedRowBatchSize: 253.41 MB (265718888) CodeGen:(Total: 480.097ms, non-child: 480.097ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 156.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 301.081ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.069ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 317.472ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 475.295us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490642) - ProbeRows: 1.43M (1432207) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 305.396ms - RowsReturned: 1.43M (1432207) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.439us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 222.199us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.684us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 561.471ms, non-child: 29.038us, % non-child: 0.01%) - ConvertRowBatchTime: 14.327us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 488.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 561.446ms - DataArrivalTimer: 561.443ms SenderSide: - DeserializeRowBatchTimer: 61.241us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s666ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500331) - BuildTime: 4s804ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659940) - ProbeRows: 19.58M (19575734) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s211ms - RowsReturned: 1.43M (1432207) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s090ms - BuildRowsPartitioned: 9.50M (9500331) - GetNewBlockTime: 2.848ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.75K (49751) - HashTablesBuildTime: 698.275ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 370.802ms, % non-child: 0.44%) - ConvertRowBatchTime: 263.982ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500331) - RowsReturnedRate: 111.52 K/sec RecvrSide: BytesReceived(16s000ms): 59.07 MB, 166.65 MB, 208.78 MB, 219.45 MB, 223.05 MB, 224.11 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB, 224.22 MB - FirstBatchArrivalWaitTime: 846.921ms - TotalBytesReceived: 224.22 MB (235113083) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s748ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s407ms, % non-child: 0.26%) - ConvertRowBatchTime: 733.715ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575734) - RowsReturnedRate: 35.69 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.05 MB, 10.02 MB, 10.02 MB, 10.02 MB, 21.16 MB, 236.46 MB, 600.15 MB, 1021.23 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s177ms - TotalBytesReceived: 2.66 GB (2855057431) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s798ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 93 (93) Instance 5f429df048b5534b:41bcce18000001db (host=foo.232.36:22000):(Total: 10m34s, non-child: 4s423ms, % non-child: 0.70%) MemoryUsage(16s000ms): 140.32 MB, 285.40 MB, 289.36 MB, 289.36 MB, 289.37 MB, 382.82 MB, 536.85 MB, 537.14 MB, 536.92 MB, 537.03 MB, 536.70 MB, 536.53 MB, 536.73 MB, 536.63 MB, 536.36 MB, 536.43 MB, 536.72 MB, 536.52 MB, 536.61 MB, 536.87 MB, 536.71 MB, 536.77 MB, 536.82 MB, 536.83 MB, 536.90 MB, 536.41 MB, 536.81 MB, 536.61 MB, 536.64 MB, 536.74 MB, 536.54 MB, 536.78 MB, 536.54 MB, 536.51 MB, 536.68 MB, 537.07 MB, 536.74 MB, 537.11 MB, 536.49 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572776651) - PerHostPeakMemUsage: 1.26 GB (1351808176) - RowsProduced: 1.43M (1430702) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 366.586ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.82K (7820) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s318ms - TotalThreadsUserTime: 20s695ms - TotalThreadsVoluntaryContextSwitches: 122.63K (122634) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 34.006ms - ExecTreePrepareTime: 404.062us DataStreamSender (dst_id=23):(Total: 3s619ms, non-child: 3s619ms, % non-child: 100.00%) - BytesSent: 253.19 MB (265488671) - OverallThroughput: 69.96 MB/sec - PeakMemoryUsage: 6.55 MB (6865280) - RowsReturned: 1.43M (1430702) - SerializeBatchTime: 3s615ms - UncompressedRowBatchSize: 253.19 MB (265488671) CodeGen:(Total: 447.798ms, non-child: 447.798ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 133.464ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.635ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.990ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 283.870ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 403.554us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4495525) - ProbeRows: 1.43M (1430702) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 271.994ms - RowsReturned: 1.43M (1430702) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 32.656us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 114.136us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.777us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 20.871us, non-child: 20.871us, % non-child: 100.00%) - ConvertRowBatchTime: 11.426us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 13.13 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.473us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 65.099us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s307ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497302) - BuildTime: 4s901ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546654537) - ProbeRows: 19.56M (19559656) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s852ms - RowsReturned: 1.43M (1430702) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s242ms - BuildRowsPartitioned: 9.50M (9497302) - GetNewBlockTime: 1.768ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.98K (49982) - HashTablesBuildTime: 644.160ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 380.745ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.371ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497302) - RowsReturnedRate: 111.53 K/sec RecvrSide: BytesReceived(16s000ms): 65.89 MB, 170.47 MB, 209.74 MB, 219.65 MB, 223.07 MB, 224.05 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB - FirstBatchArrivalWaitTime: 298.283ms - TotalBytesReceived: 224.14 MB (235028429) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s416ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s355ms, % non-child: 0.25%) - ConvertRowBatchTime: 704.988ms - PeakMemoryUsage: 0 - RowsReturned: 19.56M (19559656) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.61 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.76 MB, 254.01 MB, 620.99 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s649ms - TotalBytesReceived: 2.66 GB (2852778745) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s307ms - NumBatchesAccepted: 113.79K (113788) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce180000019f (host=foo.232.26:22000):(Total: 10m34s, non-child: 5s132ms, % non-child: 0.81%) MemoryUsage(16s000ms): 131.82 MB, 284.74 MB, 289.37 MB, 289.37 MB, 289.37 MB, 389.18 MB, 536.78 MB, 536.93 MB, 536.81 MB, 536.81 MB, 536.84 MB, 536.89 MB, 536.61 MB, 536.53 MB, 536.74 MB, 537.00 MB, 536.40 MB, 536.46 MB, 536.78 MB, 536.81 MB, 536.40 MB, 536.71 MB, 536.70 MB, 536.83 MB, 536.68 MB, 536.96 MB, 536.72 MB, 536.43 MB, 536.78 MB, 536.64 MB, 536.72 MB, 536.50 MB, 536.91 MB, 536.97 MB, 536.65 MB, 536.39 MB, 536.44 MB, 536.14 MB, 536.88 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.30 MB (572840271) - PerHostPeakMemUsage: 1.35 GB (1451386358) - RowsProduced: 1.43M (1433955) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 513.590ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.70K (7700) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s355ms - TotalThreadsUserTime: 21s201ms - TotalThreadsVoluntaryContextSwitches: 123.34K (123336) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 38.897ms - ExecTreePrepareTime: 893.713us DataStreamSender (dst_id=23):(Total: 3s669ms, non-child: 3s669ms, % non-child: 100.00%) - BytesSent: 253.70 MB (266018653) - OverallThroughput: 69.13 MB/sec - PeakMemoryUsage: 6.20 MB (6504832) - RowsReturned: 1.43M (1433955) - SerializeBatchTime: 3s665ms - UncompressedRowBatchSize: 253.70 MB (266018653) CodeGen:(Total: 450.845ms, non-child: 450.845ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 144.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 277.207ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.847ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 295.947ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 652.934us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4501325) - ProbeRows: 1.43M (1433955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.777ms - RowsReturned: 1.43M (1433955) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57.723us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 360.471us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 92.208us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 704.139ms, non-child: 18.839us, % non-child: 0.00%) - ConvertRowBatchTime: 7.687us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 389.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 704.125ms - DataArrivalTimer: 704.121ms SenderSide: - DeserializeRowBatchTimer: 231.893us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s537ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502389) - BuildTime: 4s966ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546656326) - ProbeRows: 19.57M (19574036) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s057ms - RowsReturned: 1.43M (1433955) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s270ms - BuildRowsPartitioned: 9.50M (9502389) - GetNewBlockTime: 1.736ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.08K (50083) - HashTablesBuildTime: 681.705ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 381.015ms, % non-child: 0.45%) - ConvertRowBatchTime: 268.694ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502389) - RowsReturnedRate: 112.39 K/sec RecvrSide: BytesReceived(16s000ms): 60.90 MB, 167.81 MB, 209.12 MB, 219.57 MB, 223.10 MB, 224.15 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 832.965ms - TotalBytesReceived: 224.25 MB (235144837) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s596ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s407ms, % non-child: 0.26%) - ConvertRowBatchTime: 726.888ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574036) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.21 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.56 MB, 241.30 MB, 605.92 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s171ms - TotalBytesReceived: 2.66 GB (2854708558) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s364ms - NumBatchesAccepted: 113.86K (113865) - NumBatchesRejected: 84 (84) Instance 5f429df048b5534b:41bcce1800000211 (host=foo.246.50:22000):(Total: 10m34s, non-child: 5s066ms, % non-child: 0.80%) MemoryUsage(16s000ms): 148.45 MB, 285.76 MB, 289.37 MB, 289.36 MB, 289.37 MB, 380.44 MB, 536.67 MB, 537.02 MB, 536.90 MB, 537.14 MB, 536.79 MB, 536.82 MB, 536.92 MB, 536.65 MB, 536.13 MB, 536.53 MB, 536.37 MB, 536.39 MB, 536.88 MB, 536.58 MB, 536.91 MB, 536.87 MB, 536.83 MB, 536.79 MB, 536.87 MB, 536.56 MB, 536.84 MB, 536.76 MB, 536.82 MB, 536.80 MB, 536.63 MB, 536.69 MB, 536.87 MB, 536.61 MB, 536.20 MB, 536.64 MB, 536.80 MB, 535.85 MB, 536.75 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.24 MB (572776820) - PerHostPeakMemUsage: 1.25 GB (1346091482) - RowsProduced: 1.43M (1433148) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 288.524ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.94K (7943) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s416ms - TotalThreadsUserTime: 21s739ms - TotalThreadsVoluntaryContextSwitches: 122.28K (122278) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 41.517ms - ExecTreePrepareTime: 756.651us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.69 MB (266008817) - OverallThroughput: 69.67 MB/sec - PeakMemoryUsage: 6.16 MB (6463872) - RowsReturned: 1.43M (1433148) - SerializeBatchTime: 3s636ms - UncompressedRowBatchSize: 253.69 MB (266008817) CodeGen:(Total: 481.035ms, non-child: 481.035ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.381ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 310.703ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 30.387ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 307.237ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 626.512us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4499276) - ProbeRows: 1.43M (1433148) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 294.510ms - RowsReturned: 1.43M (1433148) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.181us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 384.849us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.628us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.041us, non-child: 15.041us, % non-child: 100.00%) - ConvertRowBatchTime: 7.504us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.22 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.182us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 168.198us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s745ms, % non-child: 1.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497650) - BuildTime: 5s156ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661164) - ProbeRows: 19.57M (19574122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s235ms - RowsReturned: 1.43M (1433148) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s540ms - BuildRowsPartitioned: 9.50M (9497650) - GetNewBlockTime: 1.262ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.51K (50505) - HashTablesBuildTime: 602.553ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 391.469ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.622ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497650) - RowsReturnedRate: 112.18 K/sec RecvrSide: BytesReceived(16s000ms): 68.69 MB, 171.94 MB, 210.13 MB, 219.74 MB, 223.13 MB, 224.06 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB, 224.14 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.14 MB (235030002) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s646ms - NumBatchesAccepted: 16.90K (16900) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s406ms, % non-child: 0.26%) - ConvertRowBatchTime: 735.803ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574122) - RowsReturnedRate: 35.81 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.83 MB, 10.00 MB, 10.00 MB, 10.00 MB, 27.87 MB, 261.57 MB, 630.49 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 17s985ms - TotalBytesReceived: 2.66 GB (2855037143) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s881ms - NumBatchesAccepted: 113.87K (113870) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001a0 (host=foo.232.19:22000):(Total: 10m34s, non-child: 5s122ms, % non-child: 0.81%) MemoryUsage(16s000ms): 131.77 MB, 284.67 MB, 289.38 MB, 289.38 MB, 289.38 MB, 388.15 MB, 537.09 MB, 536.73 MB, 536.94 MB, 536.91 MB, 536.81 MB, 536.90 MB, 536.80 MB, 536.77 MB, 536.72 MB, 536.89 MB, 536.76 MB, 536.10 MB, 536.80 MB, 536.64 MB, 536.63 MB, 536.93 MB, 536.62 MB, 536.78 MB, 536.54 MB, 536.67 MB, 536.58 MB, 536.72 MB, 536.75 MB, 536.84 MB, 536.50 MB, 536.95 MB, 536.42 MB, 536.58 MB, 536.45 MB, 536.75 MB, 537.10 MB, 536.95 MB, 536.99 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.04 MB (572565940) - PerHostPeakMemUsage: 1.36 GB (1462073058) - RowsProduced: 1.43M (1433346) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 874.805ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.54K (7535) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s245ms - TotalThreadsUserTime: 21s169ms - TotalThreadsVoluntaryContextSwitches: 122.30K (122295) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 31.327ms - ExecTreePrepareTime: 205.397us DataStreamSender (dst_id=23):(Total: 3s645ms, non-child: 3s645ms, % non-child: 100.00%) - BytesSent: 253.58 MB (265900411) - OverallThroughput: 69.56 MB/sec - PeakMemoryUsage: 6.26 MB (6562176) - RowsReturned: 1.43M (1433346) - SerializeBatchTime: 3s641ms - UncompressedRowBatchSize: 253.58 MB (265900411) CodeGen:(Total: 430.449ms, non-child: 430.449ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 147.978ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 258.933ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.943ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 292.108ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 444.710us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494091) - ProbeRows: 1.43M (1433346) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 280.329ms - RowsReturned: 1.43M (1433346) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 57.940us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 168.173us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 88.287us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 469.016ms, non-child: 17.617us, % non-child: 0.00%) - ConvertRowBatchTime: 7.618us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 584.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 469.002ms - DataArrivalTimer: 468.999ms SenderSide: - DeserializeRowBatchTimer: 53.193us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s428ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504085) - BuildTime: 5s081ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658042) - ProbeRows: 19.58M (19575392) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s944ms - RowsReturned: 1.43M (1433346) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s413ms - BuildRowsPartitioned: 9.50M (9504085) - GetNewBlockTime: 4.139ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.85K (49847) - HashTablesBuildTime: 652.855ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 394.311ms, % non-child: 0.47%) - ConvertRowBatchTime: 276.944ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504085) - RowsReturnedRate: 112.92 K/sec RecvrSide: BytesReceived(16s000ms): 60.48 MB, 167.53 MB, 209.07 MB, 219.58 MB, 223.15 MB, 224.19 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB - FirstBatchArrivalWaitTime: 591.235ms - TotalBytesReceived: 224.30 MB (235194459) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s560ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s356ms, % non-child: 0.25%) - ConvertRowBatchTime: 707.425ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575392) - RowsReturnedRate: 35.69 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.17 MB, 10.01 MB, 10.01 MB, 10.01 MB, 22.22 MB, 240.10 MB, 604.50 MB, 1.00 GB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s911ms - TotalBytesReceived: 2.66 GB (2855087552) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s014ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 84 (84) Instance 5f429df048b5534b:41bcce18000001a3 (host=foo.221.38:22000):(Total: 10m34s, non-child: 4s445ms, % non-child: 0.70%) MemoryUsage(16s000ms): 123.42 MB, 284.32 MB, 289.38 MB, 289.38 MB, 289.38 MB, 383.96 MB, 536.96 MB, 537.21 MB, 536.91 MB, 536.61 MB, 536.71 MB, 536.64 MB, 536.77 MB, 536.90 MB, 536.57 MB, 536.66 MB, 536.87 MB, 536.72 MB, 536.68 MB, 536.69 MB, 536.84 MB, 536.67 MB, 536.74 MB, 536.75 MB, 536.66 MB, 536.71 MB, 536.84 MB, 536.68 MB, 536.94 MB, 536.72 MB, 536.64 MB, 536.41 MB, 536.91 MB, 536.79 MB, 537.27 MB, 536.63 MB, 536.40 MB, 536.66 MB, 536.14 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.27 MB (572803760) - PerHostPeakMemUsage: 1.31 GB (1403689644) - RowsProduced: 1.43M (1430739) - TotalNetworkReceiveTime: 10m33s - TotalNetworkSendTime: 81.191ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.86K (7863) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s310ms - TotalThreadsUserTime: 21s562ms - TotalThreadsVoluntaryContextSwitches: 122.24K (122241) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 30.628ms - ExecTreePrepareTime: 409.702us DataStreamSender (dst_id=23):(Total: 3s655ms, non-child: 3s655ms, % non-child: 100.00%) - BytesSent: 253.21 MB (265509945) - OverallThroughput: 69.26 MB/sec - PeakMemoryUsage: 6.13 MB (6431104) - RowsReturned: 1.43M (1430739) - SerializeBatchTime: 3s651ms - UncompressedRowBatchSize: 253.21 MB (265509945) CodeGen:(Total: 455.488ms, non-child: 455.488ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 161.319ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 272.717ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 20.862ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 293.781ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 668.695us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4658715) - ProbeRows: 1.43M (1430739) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 281.397ms - RowsReturned: 1.43M (1430739) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 68.287us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 344.200us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 106.596us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s006ms, non-child: 17.470us, % non-child: 0.00%) - ConvertRowBatchTime: 8.029us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 272.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s006ms - DataArrivalTimer: 1s006ms SenderSide: - DeserializeRowBatchTimer: 19.588us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s608ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498811) - BuildTime: 4s999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660487) - ProbeRows: 19.56M (19563679) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s163ms - RowsReturned: 1.43M (1430739) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s378ms - BuildRowsPartitioned: 9.50M (9498811) - GetNewBlockTime: 1.778ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.19K (50187) - HashTablesBuildTime: 604.561ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 384.891ms, % non-child: 0.45%) - ConvertRowBatchTime: 271.901ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498811) - RowsReturnedRate: 112.08 K/sec RecvrSide: BytesReceived(16s000ms): 57.63 MB, 165.77 MB, 208.49 MB, 219.34 MB, 222.97 MB, 224.05 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 1s128ms - TotalBytesReceived: 224.17 MB (235057857) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s619ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s425ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.014ms - PeakMemoryUsage: 0 - RowsReturned: 19.56M (19563679) - RowsReturnedRate: 35.64 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.95 MB, 10.01 MB, 10.01 MB, 10.01 MB, 20.29 MB, 232.63 MB, 595.68 MB, 1015.75 MB, 1.39 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.58 GB, 2.60 GB, 2.61 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s483ms - TotalBytesReceived: 2.66 GB (2853406502) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s781ms - NumBatchesAccepted: 113.81K (113809) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce18000001e2 (host=foo.232.42:22000):(Total: 10m34s, non-child: 4s228ms, % non-child: 0.67%) MemoryUsage(16s000ms): 139.90 MB, 285.09 MB, 289.37 MB, 289.37 MB, 289.37 MB, 371.15 MB, 536.71 MB, 536.94 MB, 536.78 MB, 536.92 MB, 537.00 MB, 536.61 MB, 536.75 MB, 536.74 MB, 536.85 MB, 536.68 MB, 536.59 MB, 536.51 MB, 536.87 MB, 536.70 MB, 536.71 MB, 536.69 MB, 536.59 MB, 536.71 MB, 536.55 MB, 536.56 MB, 536.65 MB, 536.56 MB, 536.92 MB, 536.48 MB, 536.79 MB, 536.41 MB, 536.92 MB, 536.71 MB, 536.60 MB, 536.34 MB, 536.31 MB, 536.39 MB, 536.56 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.01 MB (572534843) - PerHostPeakMemUsage: 1.22 GB (1314224634) - RowsProduced: 1.43M (1434269) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 122.747ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.05K (8051) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s259ms - TotalThreadsUserTime: 20s993ms - TotalThreadsVoluntaryContextSwitches: 122.46K (122459) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m31s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.980ms - ExecTreePrepareTime: 860.107us DataStreamSender (dst_id=23):(Total: 3s635ms, non-child: 3s635ms, % non-child: 100.00%) - BytesSent: 253.77 MB (266098790) - OverallThroughput: 69.80 MB/sec - PeakMemoryUsage: 6.30 MB (6603136) - RowsReturned: 1.43M (1434269) - SerializeBatchTime: 3s631ms - UncompressedRowBatchSize: 253.77 MB (266098790) CodeGen:(Total: 457.078ms, non-child: 457.078ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 137.949ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 290.324ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.265ms HASH_JOIN_NODE (id=11):(Total: 10m26s, non-child: 280.737ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 674.647us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492482) - ProbeRows: 1.43M (1434269) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 268.740ms - RowsReturned: 1.43M (1434269) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.557us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 349.610us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 177.750us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 17.036us, non-child: 17.036us, % non-child: 100.00%) - ConvertRowBatchTime: 7.534us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.08 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.964us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 25.084us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s331ms, % non-child: 1.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503428) - BuildTime: 4s818ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659546) - ProbeRows: 19.57M (19568835) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s850ms - RowsReturned: 1.43M (1434269) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s120ms - BuildRowsPartitioned: 9.50M (9503428) - GetNewBlockTime: 1.033ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.94K (49936) - HashTablesBuildTime: 684.518ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 382.522ms, % non-child: 0.45%) - ConvertRowBatchTime: 269.791ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503428) - RowsReturnedRate: 110.93 K/sec RecvrSide: BytesReceived(16s000ms): 63.54 MB, 169.38 MB, 209.52 MB, 219.68 MB, 223.18 MB, 224.18 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 298.357ms - TotalBytesReceived: 224.28 MB (235172357) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m25s SenderSide: - DeserializeRowBatchTimer: 1s685ms - NumBatchesAccepted: 16.91K (16909) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s383ms, % non-child: 0.25%) - ConvertRowBatchTime: 710.905ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568835) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.42 MB, 10.01 MB, 10.01 MB, 10.01 MB, 24.15 MB, 248.23 MB, 614.13 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s632ms - TotalBytesReceived: 2.66 GB (2853846954) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s291ms - NumBatchesAccepted: 113.84K (113840) - NumBatchesRejected: 100 (100) Instance 5f429df048b5534b:41bcce1800000199 (host=foo.232.40:22000):(Total: 10m34s, non-child: 5s391ms, % non-child: 0.85%) MemoryUsage(16s000ms): 139.89 MB, 284.99 MB, 289.37 MB, 289.37 MB, 289.37 MB, 393.40 MB, 536.93 MB, 536.92 MB, 537.09 MB, 537.07 MB, 536.98 MB, 536.49 MB, 536.76 MB, 536.68 MB, 536.37 MB, 536.49 MB, 536.63 MB, 537.27 MB, 536.84 MB, 536.69 MB, 536.60 MB, 536.66 MB, 536.85 MB, 536.64 MB, 536.52 MB, 536.74 MB, 536.96 MB, 536.76 MB, 536.59 MB, 536.67 MB, 536.59 MB, 536.79 MB, 536.35 MB, 536.61 MB, 537.06 MB, 536.65 MB, 536.65 MB, 536.92 MB, 536.81 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.59 MB (573137367) - PerHostPeakMemUsage: 1.36 GB (1459154958) - RowsProduced: 1.43M (1430763) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 1s051ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.50K (7502) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s357ms - TotalThreadsUserTime: 21s486ms - TotalThreadsVoluntaryContextSwitches: 122.29K (122293) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 37.336ms - ExecTreePrepareTime: 441.008us DataStreamSender (dst_id=23):(Total: 3s672ms, non-child: 3s672ms, % non-child: 100.00%) - BytesSent: 253.16 MB (265453440) - OverallThroughput: 68.93 MB/sec - PeakMemoryUsage: 6.33 MB (6635904) - RowsReturned: 1.43M (1430763) - SerializeBatchTime: 3s668ms - UncompressedRowBatchSize: 253.16 MB (265453440) CodeGen:(Total: 490.048ms, non-child: 490.048ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 157.963ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 305.341ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.220ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 295.055ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.167ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4659435) - ProbeRows: 1.43M (1430763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.037ms - RowsReturned: 1.43M (1430763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.398us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 813.892us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 95.003us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 64.924ms, non-child: 21.030us, % non-child: 0.03%) - ConvertRowBatchTime: 7.768us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 4.22 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 64.907ms - DataArrivalTimer: 64.903ms SenderSide: - DeserializeRowBatchTimer: 98.290us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s628ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498095) - BuildTime: 5s122ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546656969) - ProbeRows: 19.57M (19567370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s132ms - RowsReturned: 1.43M (1430763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s402ms - BuildRowsPartitioned: 9.50M (9498095) - GetNewBlockTime: 3.449ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.22K (50224) - HashTablesBuildTime: 704.695ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 390.867ms, % non-child: 0.47%) - ConvertRowBatchTime: 274.681ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498095) - RowsReturnedRate: 113.33 K/sec RecvrSide: BytesReceived(16s000ms): 62.88 MB, 168.81 MB, 209.33 MB, 219.56 MB, 223.05 MB, 224.06 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB, 224.16 MB - FirstBatchArrivalWaitTime: 239.219ms - TotalBytesReceived: 224.16 MB (235046816) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s712ms - NumBatchesAccepted: 16.90K (16904) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s386ms, % non-child: 0.25%) - ConvertRowBatchTime: 722.081ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19567370) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.36 MB, 10.01 MB, 10.01 MB, 10.01 MB, 23.89 MB, 246.67 MB, 612.54 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s585ms - TotalBytesReceived: 2.66 GB (2853843990) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s839ms - NumBatchesAccepted: 113.83K (113828) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce180000020c (host=foo.234.52:22000):(Total: 10m34s, non-child: 4s739ms, % non-child: 0.75%) MemoryUsage(16s000ms): 148.36 MB, 285.50 MB, 289.39 MB, 289.39 MB, 289.39 MB, 377.44 MB, 536.82 MB, 537.30 MB, 536.97 MB, 536.82 MB, 536.77 MB, 536.81 MB, 536.78 MB, 536.70 MB, 536.73 MB, 536.68 MB, 536.79 MB, 536.97 MB, 536.85 MB, 536.61 MB, 536.96 MB, 536.82 MB, 536.78 MB, 536.68 MB, 536.73 MB, 536.82 MB, 536.80 MB, 536.40 MB, 536.73 MB, 536.57 MB, 536.92 MB, 536.42 MB, 536.80 MB, 536.85 MB, 536.47 MB, 536.82 MB, 536.58 MB, 536.65 MB, 536.08 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.23 MB (572764741) - PerHostPeakMemUsage: 1.22 GB (1314367736) - RowsProduced: 1.43M (1432536) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 86.384ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.18K (8182) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s436ms - TotalThreadsUserTime: 22s018ms - TotalThreadsVoluntaryContextSwitches: 122.31K (122312) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 36.468ms - ExecTreePrepareTime: 415.769us DataStreamSender (dst_id=23):(Total: 3s683ms, non-child: 3s683ms, % non-child: 100.00%) - BytesSent: 253.42 MB (265725824) - OverallThroughput: 68.79 MB/sec - PeakMemoryUsage: 6.01 MB (6300032) - RowsReturned: 1.43M (1432536) - SerializeBatchTime: 3s679ms - UncompressedRowBatchSize: 253.42 MB (265725824) CodeGen:(Total: 482.589ms, non-child: 482.589ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 164.350ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 291.256ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.435ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 313.457ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 479.903us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489354) - ProbeRows: 1.43M (1432536) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 300.135ms - RowsReturned: 1.43M (1432536) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 18.880us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 171.173us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 227.902us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.010us, non-child: 14.010us, % non-child: 100.00%) - ConvertRowBatchTime: 7.532us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 19.56 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.341us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 94.355us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s999ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501528) - BuildTime: 5s101ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661457) - ProbeRows: 19.57M (19574553) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s452ms - RowsReturned: 1.43M (1432536) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s457ms - BuildRowsPartitioned: 9.50M (9501528) - GetNewBlockTime: 1.605ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.89K (49886) - HashTablesBuildTime: 631.110ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 387.981ms, % non-child: 0.46%) - ConvertRowBatchTime: 275.001ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501528) - RowsReturnedRate: 111.72 K/sec RecvrSide: BytesReceived(16s000ms): 66.66 MB, 170.98 MB, 209.94 MB, 219.74 MB, 223.17 MB, 224.14 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.23 MB (235123563) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s706ms - NumBatchesAccepted: 16.91K (16912) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s427ms, % non-child: 0.26%) - ConvertRowBatchTime: 753.337ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574553) - RowsReturnedRate: 35.81 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.66 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.37 MB, 256.34 MB, 624.34 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s300ms - TotalBytesReceived: 2.66 GB (2854935108) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 17s264ms - NumBatchesAccepted: 113.87K (113868) - NumBatchesRejected: 108 (108) Instance 5f429df048b5534b:41bcce18000001d1 (host=foo.234.51:22000):(Total: 10m34s, non-child: 4s869ms, % non-child: 0.77%) MemoryUsage(16s000ms): 148.55 MB, 285.71 MB, 289.36 MB, 289.36 MB, 289.36 MB, 397.34 MB, 536.78 MB, 537.20 MB, 536.90 MB, 536.79 MB, 536.84 MB, 536.88 MB, 536.63 MB, 536.94 MB, 536.92 MB, 536.75 MB, 536.59 MB, 536.22 MB, 536.67 MB, 536.63 MB, 536.52 MB, 536.46 MB, 536.84 MB, 536.69 MB, 536.64 MB, 536.58 MB, 536.55 MB, 536.77 MB, 536.59 MB, 536.67 MB, 536.58 MB, 536.69 MB, 536.92 MB, 536.49 MB, 536.64 MB, 537.11 MB, 536.44 MB, 536.30 MB, 536.99 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.19 MB (572724644) - PerHostPeakMemUsage: 1.28 GB (1377587880) - RowsProduced: 1.43M (1431955) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 490.917ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.08K (8080) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s426ms - TotalThreadsUserTime: 21s979ms - TotalThreadsVoluntaryContextSwitches: 122.11K (122108) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 38.546ms - ExecTreePrepareTime: 696.981us DataStreamSender (dst_id=23):(Total: 3s701ms, non-child: 3s701ms, % non-child: 100.00%) - BytesSent: 253.39 MB (265697472) - OverallThroughput: 68.46 MB/sec - PeakMemoryUsage: 6.46 MB (6775168) - RowsReturned: 1.43M (1431955) - SerializeBatchTime: 3s697ms - UncompressedRowBatchSize: 253.39 MB (265697472) CodeGen:(Total: 447.997ms, non-child: 447.997ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 142.396ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 276.807ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.165ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 314.689ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.323ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4658768) - ProbeRows: 1.43M (1431955) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 301.546ms - RowsReturned: 1.43M (1431955) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.268us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.021ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 95.859us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 22.712us, non-child: 22.712us, % non-child: 100.00%) - ConvertRowBatchTime: 9.966us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 12.06 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.632us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 147.459us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s977ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9495671) - BuildTime: 5s172ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663328) - ProbeRows: 19.58M (19576102) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s489ms - RowsReturned: 1.43M (1431955) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s571ms - BuildRowsPartitioned: 9.50M (9495671) - GetNewBlockTime: 6.053ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.18K (50179) - HashTablesBuildTime: 586.319ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 393.981ms, % non-child: 0.47%) - ConvertRowBatchTime: 278.038ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9495671) - RowsReturnedRate: 113.25 K/sec RecvrSide: BytesReceived(16s000ms): 68.36 MB, 171.76 MB, 210.03 MB, 219.70 MB, 223.08 MB, 224.01 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB, 224.10 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.10 MB (234982548) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s731ms - NumBatchesAccepted: 16.91K (16905) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s415ms, % non-child: 0.26%) - ConvertRowBatchTime: 747.681ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576102) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.79 MB, 10.00 MB, 10.00 MB, 10.00 MB, 27.74 MB, 260.39 MB, 629.12 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s300ms - TotalBytesReceived: 2.66 GB (2855080059) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s966ms - NumBatchesAccepted: 113.88K (113876) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce1800000212 (host=foo.246.36:22000):(Total: 10m34s, non-child: 4s814ms, % non-child: 0.76%) MemoryUsage(16s000ms): 148.36 MB, 285.53 MB, 289.38 MB, 289.38 MB, 289.38 MB, 377.87 MB, 536.67 MB, 536.83 MB, 536.94 MB, 536.82 MB, 536.86 MB, 536.70 MB, 536.87 MB, 536.76 MB, 536.68 MB, 536.59 MB, 536.72 MB, 537.36 MB, 536.64 MB, 536.68 MB, 536.67 MB, 536.60 MB, 536.93 MB, 536.77 MB, 536.70 MB, 536.71 MB, 536.60 MB, 536.75 MB, 536.63 MB, 536.88 MB, 536.61 MB, 536.55 MB, 536.69 MB, 536.64 MB, 536.83 MB, 536.58 MB, 536.64 MB, 537.21 MB, 535.91 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.31 MB (572847819) - PerHostPeakMemUsage: 1.28 GB (1373964388) - RowsProduced: 1.43M (1433668) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 290.480ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.17K (8170) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s405ms - TotalThreadsUserTime: 22s061ms - TotalThreadsVoluntaryContextSwitches: 122.02K (122017) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 40.439ms - ExecTreePrepareTime: 393.369us DataStreamSender (dst_id=23):(Total: 3s720ms, non-child: 3s720ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265979962) - OverallThroughput: 68.18 MB/sec - PeakMemoryUsage: 6.10 MB (6398336) - RowsReturned: 1.43M (1433668) - SerializeBatchTime: 3s716ms - UncompressedRowBatchSize: 253.66 MB (265979962) CodeGen:(Total: 484.188ms, non-child: 484.188ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 151.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 305.622ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.031ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 322.533ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.807ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492208) - ProbeRows: 1.43M (1433668) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 309.396ms - RowsReturned: 1.43M (1433668) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 68.488us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.467ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.141us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 17.274us, non-child: 17.274us, % non-child: 100.00%) - ConvertRowBatchTime: 7.617us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.86 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 4.139us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 70.760us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 9s013ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500600) - BuildTime: 4s939ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659646) - ProbeRows: 19.57M (19572226) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s540ms - RowsReturned: 1.43M (1433668) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s307ms - BuildRowsPartitioned: 9.50M (9500600) - GetNewBlockTime: 2.390ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.57K (49571) - HashTablesBuildTime: 617.914ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 387.785ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.599ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500600) - RowsReturnedRate: 111.64 K/sec RecvrSide: BytesReceived(16s000ms): 67.01 MB, 171.19 MB, 209.99 MB, 219.76 MB, 223.17 MB, 224.14 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB, 224.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.23 MB (235120351) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s696ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s440ms, % non-child: 0.26%) - ConvertRowBatchTime: 758.893ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572226) - RowsReturnedRate: 35.83 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.69 MB, 10.01 MB, 10.01 MB, 10.01 MB, 26.64 MB, 257.34 MB, 625.13 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s192ms - TotalBytesReceived: 2.66 GB (2854522462) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m4s SenderSide: - DeserializeRowBatchTimer: 17s341ms - NumBatchesAccepted: 113.85K (113853) - NumBatchesRejected: 103 (103) Instance 5f429df048b5534b:41bcce180000020b (host=foo.246.35:22000):(Total: 10m34s, non-child: 4s634ms, % non-child: 0.73%) MemoryUsage(16s000ms): 148.36 MB, 285.48 MB, 289.39 MB, 289.38 MB, 289.39 MB, 377.21 MB, 537.01 MB, 536.72 MB, 537.19 MB, 536.90 MB, 536.96 MB, 536.92 MB, 536.72 MB, 536.68 MB, 536.62 MB, 536.65 MB, 536.62 MB, 536.39 MB, 536.71 MB, 536.66 MB, 536.95 MB, 536.69 MB, 536.57 MB, 536.61 MB, 536.76 MB, 536.61 MB, 536.66 MB, 536.71 MB, 536.63 MB, 536.79 MB, 536.69 MB, 536.52 MB, 536.66 MB, 536.69 MB, 536.54 MB, 536.73 MB, 536.71 MB, 537.44 MB, 536.12 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.49 MB (573033826) - PerHostPeakMemUsage: 1.32 GB (1421035445) - RowsProduced: 1.43M (1433763) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 86.701ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.01K (8012) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s316ms - TotalThreadsUserTime: 22s078ms - TotalThreadsVoluntaryContextSwitches: 122.38K (122375) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 36.740ms - ExecTreePrepareTime: 377.890us DataStreamSender (dst_id=23):(Total: 3s674ms, non-child: 3s674ms, % non-child: 100.00%) - BytesSent: 253.59 MB (265908347) - OverallThroughput: 69.02 MB/sec - PeakMemoryUsage: 6.21 MB (6513024) - RowsReturned: 1.43M (1433763) - SerializeBatchTime: 3s669ms - UncompressedRowBatchSize: 253.59 MB (265908347) CodeGen:(Total: 492.832ms, non-child: 492.832ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 142.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 325.351ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.517ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 319.946ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 735.098us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489882) - ProbeRows: 1.43M (1433763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 306.943ms - RowsReturned: 1.43M (1433763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 24.219us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 382.307us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 192.250us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.902us, non-child: 16.902us, % non-child: 100.00%) - ConvertRowBatchTime: 8.463us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.21 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.020us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 90.418us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 9s069ms, % non-child: 1.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499839) - BuildTime: 5s436ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546659314) - ProbeRows: 19.57M (19574840) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s375ms - RowsReturned: 1.43M (1433763) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s684ms - BuildRowsPartitioned: 9.50M (9499839) - GetNewBlockTime: 5.592ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.20K (50203) - HashTablesBuildTime: 738.013ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 385.887ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.178ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499839) - RowsReturnedRate: 112.17 K/sec RecvrSide: BytesReceived(16s000ms): 66.72 MB, 170.93 MB, 209.92 MB, 219.71 MB, 223.15 MB, 224.10 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.20 MB (235086459) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s802ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s383ms, % non-child: 0.25%) - ConvertRowBatchTime: 737.558ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574840) - RowsReturnedRate: 35.82 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.66 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.23 MB, 255.76 MB, 623.17 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s180ms - TotalBytesReceived: 2.66 GB (2854882711) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s822ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 122 (122) Instance 5f429df048b5534b:41bcce18000001f2 (host=foo.232.51:22000):(Total: 10m34s, non-child: 4s740ms, % non-child: 0.75%) MemoryUsage(16s000ms): 148.33 MB, 285.70 MB, 289.38 MB, 289.38 MB, 289.38 MB, 379.37 MB, 536.85 MB, 536.68 MB, 536.98 MB, 536.83 MB, 536.79 MB, 536.84 MB, 537.18 MB, 536.72 MB, 536.78 MB, 537.04 MB, 536.80 MB, 537.26 MB, 536.76 MB, 536.76 MB, 536.73 MB, 536.78 MB, 536.81 MB, 536.61 MB, 536.64 MB, 536.54 MB, 536.83 MB, 536.77 MB, 536.69 MB, 536.60 MB, 536.59 MB, 536.69 MB, 536.85 MB, 536.38 MB, 536.27 MB, 536.66 MB, 536.94 MB, 536.69 MB, 537.05 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.09 MB (572612760) - PerHostPeakMemUsage: 1.36 GB (1456006718) - RowsProduced: 1.43M (1434220) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 238.993ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.84K (7840) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s330ms - TotalThreadsUserTime: 21s770ms - TotalThreadsVoluntaryContextSwitches: 122.41K (122411) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 44.002ms - ExecTreePrepareTime: 455.167us DataStreamSender (dst_id=23):(Total: 3s669ms, non-child: 3s669ms, % non-child: 100.00%) - BytesSent: 253.88 MB (266208917) - OverallThroughput: 69.18 MB/sec - PeakMemoryUsage: 6.27 MB (6570368) - RowsReturned: 1.43M (1434220) - SerializeBatchTime: 3s665ms - UncompressedRowBatchSize: 253.88 MB (266208917) CodeGen:(Total: 470.817ms, non-child: 470.817ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 151.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 285.250ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.554ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 298.698ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 684.450us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490575) - ProbeRows: 1.43M (1434220) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 285.944ms - RowsReturned: 1.43M (1434220) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.068us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 363.566us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.478us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 17.541us, non-child: 17.541us, % non-child: 100.00%) - ConvertRowBatchTime: 8.540us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.62 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.587us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 63.501us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s810ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506054) - BuildTime: 5s190ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546665315) - ProbeRows: 19.57M (19568103) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s192ms - RowsReturned: 1.43M (1434220) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s451ms - BuildRowsPartitioned: 9.51M (9506054) - GetNewBlockTime: 1.894ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.03K (50026) - HashTablesBuildTime: 725.440ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 397.452ms, % non-child: 0.47%) - ConvertRowBatchTime: 279.732ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506054) - RowsReturnedRate: 111.88 K/sec RecvrSide: BytesReceived(16s000ms): 68.35 MB, 171.91 MB, 210.31 MB, 219.94 MB, 223.33 MB, 224.26 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.35 MB (235245307) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s723ms - NumBatchesAccepted: 16.92K (16917) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s394ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.794ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19568103) - RowsReturnedRate: 35.79 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.79 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.66 MB, 260.32 MB, 628.94 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s249ms - TotalBytesReceived: 2.66 GB (2854105410) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s897ms - NumBatchesAccepted: 113.83K (113835) - NumBatchesRejected: 105 (105) Instance 5f429df048b5534b:41bcce18000001d3 (host=foo.246.44:22000):(Total: 10m34s, non-child: 5s191ms, % non-child: 0.82%) MemoryUsage(16s000ms): 148.37 MB, 285.67 MB, 289.38 MB, 289.38 MB, 289.38 MB, 396.58 MB, 537.09 MB, 536.72 MB, 536.86 MB, 536.81 MB, 536.87 MB, 536.48 MB, 536.96 MB, 536.57 MB, 537.00 MB, 536.83 MB, 536.52 MB, 536.56 MB, 536.91 MB, 536.61 MB, 536.93 MB, 536.74 MB, 536.67 MB, 536.62 MB, 536.74 MB, 536.80 MB, 536.71 MB, 536.83 MB, 536.40 MB, 536.69 MB, 536.50 MB, 536.75 MB, 536.77 MB, 536.97 MB, 536.25 MB, 536.66 MB, 536.96 MB, 537.38 MB, 536.83 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.28 MB (572819163) - PerHostPeakMemUsage: 1.31 GB (1403306148) - RowsProduced: 1.43M (1433568) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 608.296ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.87K (7872) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s330ms - TotalThreadsUserTime: 21s669ms - TotalThreadsVoluntaryContextSwitches: 122.35K (122351) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 38.301ms - ExecTreePrepareTime: 712.213us DataStreamSender (dst_id=23):(Total: 3s670ms, non-child: 3s670ms, % non-child: 100.00%) - BytesSent: 253.70 MB (266019948) - OverallThroughput: 69.11 MB/sec - PeakMemoryUsage: 6.63 MB (6947200) - RowsReturned: 1.43M (1433568) - SerializeBatchTime: 3s665ms - UncompressedRowBatchSize: 253.70 MB (266019948) CodeGen:(Total: 451.525ms, non-child: 451.525ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 152.744ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 270.523ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.747ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 321.393ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 887.964us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4486669) - ProbeRows: 1.43M (1433568) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 308.748ms - RowsReturned: 1.43M (1433568) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.149us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 425.699us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 266.842us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 12.862us, non-child: 12.862us, % non-child: 100.00%) - ConvertRowBatchTime: 6.308us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 21.30 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.901us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 153.477us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s925ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504056) - BuildTime: 4s991ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661090) - ProbeRows: 19.57M (19573951) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s464ms - RowsReturned: 1.43M (1433568) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s381ms - BuildRowsPartitioned: 9.50M (9504056) - GetNewBlockTime: 1.717ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.00K (49996) - HashTablesBuildTime: 595.526ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 382.592ms, % non-child: 0.46%) - ConvertRowBatchTime: 270.482ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504056) - RowsReturnedRate: 113.39 K/sec RecvrSide: BytesReceived(16s000ms): 68.01 MB, 171.75 MB, 210.20 MB, 219.87 MB, 223.26 MB, 224.20 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.29 MB (235187966) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s724ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s369ms, % non-child: 0.25%) - ConvertRowBatchTime: 730.318ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573951) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.78 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.46 MB, 259.54 MB, 628.01 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s105ms - TotalBytesReceived: 2.66 GB (2855065278) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s576ms - NumBatchesAccepted: 113.87K (113871) - NumBatchesRejected: 93 (93) Instance 5f429df048b5534b:41bcce18000001e7 (host=foo.234.42:22000):(Total: 10m34s, non-child: 4s458ms, % non-child: 0.70%) MemoryUsage(16s000ms): 140.36 MB, 285.36 MB, 289.39 MB, 289.39 MB, 289.38 MB, 376.21 MB, 536.74 MB, 537.00 MB, 536.83 MB, 537.02 MB, 536.76 MB, 536.75 MB, 536.79 MB, 536.84 MB, 536.63 MB, 536.88 MB, 536.56 MB, 536.39 MB, 536.74 MB, 536.65 MB, 537.03 MB, 536.88 MB, 536.72 MB, 536.67 MB, 536.53 MB, 536.64 MB, 536.72 MB, 536.68 MB, 536.85 MB, 536.90 MB, 536.72 MB, 536.77 MB, 536.49 MB, 536.78 MB, 536.62 MB, 536.65 MB, 536.53 MB, 537.21 MB, 535.66 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.49 MB (573041339) - PerHostPeakMemUsage: 1.31 GB (1403897182) - RowsProduced: 1.43M (1434723) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 137.240ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.95K (7954) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s261ms - TotalThreadsUserTime: 21s667ms - TotalThreadsVoluntaryContextSwitches: 122.70K (122701) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 47.412ms - ExecTreePrepareTime: 575.886us DataStreamSender (dst_id=23):(Total: 3s679ms, non-child: 3s679ms, % non-child: 100.00%) - BytesSent: 253.87 MB (266201214) - OverallThroughput: 69.00 MB/sec - PeakMemoryUsage: 6.81 MB (7143808) - RowsReturned: 1.43M (1434723) - SerializeBatchTime: 3s674ms - UncompressedRowBatchSize: 253.87 MB (266201214) CodeGen:(Total: 463.548ms, non-child: 463.548ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.961ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 285.890ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 36.927ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 314.463ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 768.523us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4660719) - ProbeRows: 1.43M (1434723) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 301.617ms - RowsReturned: 1.43M (1434723) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.355us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 389.495us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.140us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 18.934us, non-child: 18.934us, % non-child: 100.00%) - ConvertRowBatchTime: 11.316us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.47 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.844us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 59.276us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s856ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9507046) - BuildTime: 4s883ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657647) - ProbeRows: 19.58M (19576523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s477ms - RowsReturned: 1.43M (1434723) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s285ms - BuildRowsPartitioned: 9.51M (9507046) - GetNewBlockTime: 1.378ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.93K (49934) - HashTablesBuildTime: 586.719ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 377.881ms, % non-child: 0.44%) - ConvertRowBatchTime: 267.215ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9507046) - RowsReturnedRate: 111.42 K/sec RecvrSide: BytesReceived(16s000ms): 65.48 MB, 170.45 MB, 209.88 MB, 219.83 MB, 223.29 MB, 224.27 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB, 224.37 MB - FirstBatchArrivalWaitTime: 110.575ms - TotalBytesReceived: 224.37 MB (235265673) - TotalGetBatchTime: 1m25s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s570ms - NumBatchesAccepted: 16.92K (16923) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s382ms, % non-child: 0.25%) - ConvertRowBatchTime: 724.021ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576523) - RowsReturnedRate: 35.80 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.59 MB, 10.02 MB, 10.02 MB, 10.02 MB, 25.36 MB, 252.82 MB, 620.07 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s459ms - TotalBytesReceived: 2.66 GB (2855003833) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s735ms - NumBatchesAccepted: 113.88K (113881) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001f3 (host=foo.246.38:22000):(Total: 10m34s, non-child: 4s627ms, % non-child: 0.73%) MemoryUsage(16s000ms): 147.11 MB, 285.47 MB, 289.39 MB, 289.39 MB, 289.39 MB, 377.10 MB, 536.78 MB, 536.55 MB, 537.13 MB, 536.83 MB, 537.05 MB, 536.76 MB, 536.90 MB, 536.77 MB, 537.02 MB, 537.00 MB, 536.72 MB, 536.88 MB, 537.00 MB, 536.60 MB, 536.62 MB, 536.92 MB, 536.54 MB, 536.77 MB, 536.63 MB, 536.72 MB, 536.63 MB, 536.91 MB, 536.78 MB, 536.68 MB, 536.75 MB, 536.77 MB, 536.61 MB, 536.68 MB, 536.54 MB, 536.35 MB, 536.53 MB, 536.48 MB, 536.94 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.28 MB (572819231) - PerHostPeakMemUsage: 1.31 GB (1401697212) - RowsProduced: 1.43M (1431841) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 128.568ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.20K (8204) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s378ms - TotalThreadsUserTime: 21s964ms - TotalThreadsVoluntaryContextSwitches: 122.35K (122353) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 38.317ms - ExecTreePrepareTime: 427.022us DataStreamSender (dst_id=23):(Total: 3s673ms, non-child: 3s673ms, % non-child: 100.00%) - BytesSent: 253.35 MB (265658716) - OverallThroughput: 68.98 MB/sec - PeakMemoryUsage: 6.22 MB (6521216) - RowsReturned: 1.43M (1431841) - SerializeBatchTime: 3s668ms - UncompressedRowBatchSize: 253.35 MB (265658716) CodeGen:(Total: 505.926ms, non-child: 505.926ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 336.705ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.961ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 315.161ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 661.119us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4495619) - ProbeRows: 1.43M (1431841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 302.388ms - RowsReturned: 1.43M (1431841) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.331us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 299.975us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 242.648us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.610us, non-child: 15.610us, % non-child: 100.00%) - ConvertRowBatchTime: 7.443us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.55 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.218us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 33.428us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s959ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500287) - BuildTime: 5s264ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663567) - ProbeRows: 19.58M (19576013) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s327ms - RowsReturned: 1.43M (1431841) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s551ms - BuildRowsPartitioned: 9.50M (9500287) - GetNewBlockTime: 1.432ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.13K (50126) - HashTablesBuildTime: 699.178ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 394.349ms, % non-child: 0.46%) - ConvertRowBatchTime: 275.915ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500287) - RowsReturnedRate: 112.01 K/sec RecvrSide: BytesReceived(16s000ms): 66.48 MB, 170.81 MB, 209.88 MB, 219.72 MB, 223.15 MB, 224.12 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.21 MB (235097108) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s652ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s406ms, % non-child: 0.26%) - ConvertRowBatchTime: 739.152ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576013) - RowsReturnedRate: 35.81 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.65 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.14 MB, 254.96 MB, 622.76 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s186ms - TotalBytesReceived: 2.66 GB (2855092478) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s490ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 102 (102) Instance 5f429df048b5534b:41bcce18000001d7 (host=foo.234.37:22000):(Total: 10m34s, non-child: 4s401ms, % non-child: 0.69%) MemoryUsage(16s000ms): 147.79 MB, 285.45 MB, 289.38 MB, 289.38 MB, 289.38 MB, 384.05 MB, 536.86 MB, 536.96 MB, 537.02 MB, 537.25 MB, 536.85 MB, 536.71 MB, 536.92 MB, 536.61 MB, 536.73 MB, 536.82 MB, 536.51 MB, 536.79 MB, 536.92 MB, 536.59 MB, 536.92 MB, 536.80 MB, 536.82 MB, 536.78 MB, 536.66 MB, 536.74 MB, 536.83 MB, 536.68 MB, 536.66 MB, 536.71 MB, 536.70 MB, 537.05 MB, 536.60 MB, 536.67 MB, 536.90 MB, 536.73 MB, 536.50 MB, 536.62 MB, 536.84 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.41 MB (572949654) - PerHostPeakMemUsage: 1.30 GB (1398836132) - RowsProduced: 1.43M (1432373) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 160.008ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.97K (7968) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s356ms - TotalThreadsUserTime: 21s728ms - TotalThreadsVoluntaryContextSwitches: 122.57K (122568) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 39.362ms - ExecTreePrepareTime: 546.682us DataStreamSender (dst_id=23):(Total: 3s644ms, non-child: 3s644ms, % non-child: 100.00%) - BytesSent: 253.45 MB (265764095) - OverallThroughput: 69.54 MB/sec - PeakMemoryUsage: 6.23 MB (6537600) - RowsReturned: 1.43M (1432373) - SerializeBatchTime: 3s640ms - UncompressedRowBatchSize: 253.45 MB (265764095) CodeGen:(Total: 464.392ms, non-child: 464.392ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 145.665ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 288.929ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.213ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 315.854ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 560.350us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4494100) - ProbeRows: 1.43M (1432373) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 304.089ms - RowsReturned: 1.43M (1432373) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 30.590us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 331.450us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 82.946us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 2.695ms, non-child: 20.294us, % non-child: 0.75%) - ConvertRowBatchTime: 7.477us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 101.65 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.678ms - DataArrivalTimer: 2.675ms SenderSide: - DeserializeRowBatchTimer: 243.311us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s905ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501754) - BuildTime: 5s211ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659393) - ProbeRows: 19.58M (19579093) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s364ms - RowsReturned: 1.43M (1432373) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s610ms - BuildRowsPartitioned: 9.50M (9501754) - GetNewBlockTime: 1.441ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.24K (50242) - HashTablesBuildTime: 584.636ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 384.846ms, % non-child: 0.45%) - ConvertRowBatchTime: 273.703ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501754) - RowsReturnedRate: 112.32 K/sec RecvrSide: BytesReceived(16s000ms): 66.39 MB, 170.85 MB, 209.91 MB, 219.76 MB, 223.19 MB, 224.15 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 124.785ms - TotalBytesReceived: 224.24 MB (235133993) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s704ms - NumBatchesAccepted: 16.92K (16918) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s378ms, % non-child: 0.25%) - ConvertRowBatchTime: 729.193ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19579093) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.64 MB, 10.01 MB, 10.01 MB, 10.01 MB, 26.20 MB, 255.42 MB, 623.38 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s457ms - TotalBytesReceived: 2.66 GB (2855474374) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s380ms - NumBatchesAccepted: 113.90K (113897) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce18000001f6 (host=foo.234.44:22000):(Total: 10m34s, non-child: 4s535ms, % non-child: 0.72%) MemoryUsage(16s000ms): 148.37 MB, 285.76 MB, 289.39 MB, 289.39 MB, 289.39 MB, 380.43 MB, 536.99 MB, 537.27 MB, 536.76 MB, 537.06 MB, 536.66 MB, 536.65 MB, 536.65 MB, 536.96 MB, 536.61 MB, 536.50 MB, 536.51 MB, 537.49 MB, 536.83 MB, 536.80 MB, 536.60 MB, 536.40 MB, 536.98 MB, 536.69 MB, 536.67 MB, 536.81 MB, 536.69 MB, 536.88 MB, 536.51 MB, 536.82 MB, 536.57 MB, 537.03 MB, 536.47 MB, 536.48 MB, 536.69 MB, 536.80 MB, 536.92 MB, 536.75 MB, 537.77 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.44 MB (572981761) - PerHostPeakMemUsage: 1.21 GB (1304546732) - RowsProduced: 1.43M (1434049) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 291.654ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.61K (8608) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s350ms - TotalThreadsUserTime: 21s567ms - TotalThreadsVoluntaryContextSwitches: 121.59K (121588) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 32.255ms - ExecTreePrepareTime: 523.436us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.75 MB (266079238) - OverallThroughput: 69.44 MB/sec - PeakMemoryUsage: 6.38 MB (6685056) - RowsReturned: 1.43M (1434049) - SerializeBatchTime: 3s650ms - UncompressedRowBatchSize: 253.75 MB (266079238) CodeGen:(Total: 437.623ms, non-child: 437.623ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 131.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.402ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 22.600ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 293.780ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 567.236us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493130) - ProbeRows: 1.43M (1434049) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 281.015ms - RowsReturned: 1.43M (1434049) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.007us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 336.974us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.011us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 23.952us, non-child: 23.952us, % non-child: 100.00%) - ConvertRowBatchTime: 7.848us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 11.44 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 9.709us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 103.919us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s649ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504286) - BuildTime: 5s033ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658588) - ProbeRows: 19.58M (19578843) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s204ms - RowsReturned: 1.43M (1434049) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s354ms - BuildRowsPartitioned: 9.50M (9504286) - GetNewBlockTime: 1.427ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.13K (50132) - HashTablesBuildTime: 664.924ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m25s, non-child: 375.813ms, % non-child: 0.44%) - ConvertRowBatchTime: 269.566ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504286) - RowsReturnedRate: 111.81 K/sec RecvrSide: BytesReceived(16s000ms): 68.72 MB, 172.05 MB, 210.28 MB, 219.89 MB, 223.27 MB, 224.21 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.30 MB (235191124) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s514ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s433ms, % non-child: 0.26%) - ConvertRowBatchTime: 739.039ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19578843) - RowsReturnedRate: 35.80 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.83 MB, 10.02 MB, 10.02 MB, 10.02 MB, 27.88 MB, 261.53 MB, 630.11 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.95 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s171ms - TotalBytesReceived: 2.66 GB (2855532332) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s463ms - NumBatchesAccepted: 113.89K (113892) - NumBatchesRejected: 103 (103) Instance 5f429df048b5534b:41bcce18000001c5 (host=foo.234.41:22000):(Total: 10m34s, non-child: 4s439ms, % non-child: 0.70%) MemoryUsage(16s000ms): 148.29 MB, 285.50 MB, 289.39 MB, 289.39 MB, 289.39 MB, 393.43 MB, 537.03 MB, 537.01 MB, 536.61 MB, 536.80 MB, 536.77 MB, 536.73 MB, 536.94 MB, 536.71 MB, 536.56 MB, 536.58 MB, 536.89 MB, 536.96 MB, 536.86 MB, 536.90 MB, 536.93 MB, 536.71 MB, 536.45 MB, 536.71 MB, 536.59 MB, 536.79 MB, 536.76 MB, 536.56 MB, 536.75 MB, 536.58 MB, 536.89 MB, 536.55 MB, 536.67 MB, 536.93 MB, 536.67 MB, 536.88 MB, 536.58 MB, 535.93 MB, 536.45 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572784707) - PerHostPeakMemUsage: 1.23 GB (1315807494) - RowsProduced: 1.43M (1434229) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 186.104ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.03K (8025) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s316ms - TotalThreadsUserTime: 21s746ms - TotalThreadsVoluntaryContextSwitches: 122.04K (122042) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 42.229ms - ExecTreePrepareTime: 758.389us DataStreamSender (dst_id=23):(Total: 3s679ms, non-child: 3s679ms, % non-child: 100.00%) - BytesSent: 253.78 MB (266104318) - OverallThroughput: 68.98 MB/sec - PeakMemoryUsage: 6.08 MB (6373760) - RowsReturned: 1.43M (1434229) - SerializeBatchTime: 3s673ms - UncompressedRowBatchSize: 253.78 MB (266104318) CodeGen:(Total: 490.446ms, non-child: 490.446ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 170.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.360ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.858ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 304.130ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 2.319ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488340) - ProbeRows: 1.43M (1434229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 291.217ms - RowsReturned: 1.43M (1434229) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.125us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 1.710ms - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.837us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.475us, non-child: 15.475us, % non-child: 100.00%) - ConvertRowBatchTime: 8.219us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.71 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.690us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 145.673us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s897ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501572) - BuildTime: 5s143ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657658) - ProbeRows: 19.57M (19565800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s260ms - RowsReturned: 1.43M (1434229) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s411ms - BuildRowsPartitioned: 9.50M (9501572) - GetNewBlockTime: 1.621ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.04K (50041) - HashTablesBuildTime: 715.497ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 385.831ms, % non-child: 0.46%) - ConvertRowBatchTime: 274.691ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501572) - RowsReturnedRate: 112.98 K/sec RecvrSide: BytesReceived(16s000ms): 66.70 MB, 171.04 MB, 209.97 MB, 219.78 MB, 223.19 MB, 224.15 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 64.185ms - TotalBytesReceived: 224.24 MB (235131258) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s595ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s396ms, % non-child: 0.25%) - ConvertRowBatchTime: 734.359ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19565800) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.66 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.49 MB, 256.03 MB, 623.62 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s408ms - TotalBytesReceived: 2.66 GB (2853379087) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s827ms - NumBatchesAccepted: 113.82K (113819) - NumBatchesRejected: 92 (92) Instance 5f429df048b5534b:41bcce180000019e (host=foo.232.46:22000):(Total: 10m34s, non-child: 4s764ms, % non-child: 0.75%) MemoryUsage(16s000ms): 132.15 MB, 284.91 MB, 289.40 MB, 289.39 MB, 289.40 MB, 392.17 MB, 536.77 MB, 536.84 MB, 537.23 MB, 536.89 MB, 536.58 MB, 536.89 MB, 536.67 MB, 536.79 MB, 536.55 MB, 536.40 MB, 537.02 MB, 537.11 MB, 536.68 MB, 536.73 MB, 536.59 MB, 536.90 MB, 536.54 MB, 536.53 MB, 536.71 MB, 536.71 MB, 536.61 MB, 536.55 MB, 536.63 MB, 536.56 MB, 536.99 MB, 536.49 MB, 536.88 MB, 536.82 MB, 536.27 MB, 536.60 MB, 536.47 MB, 536.28 MB, 536.63 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.48 MB (573029119) - PerHostPeakMemUsage: 1.27 GB (1359098584) - RowsProduced: 1.44M (1435345) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 714.563ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.74K (7738) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s279ms - TotalThreadsUserTime: 21s109ms - TotalThreadsVoluntaryContextSwitches: 122.34K (122344) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 37.089ms - ExecTreePrepareTime: 383.360us DataStreamSender (dst_id=23):(Total: 3s645ms, non-child: 3s645ms, % non-child: 100.00%) - BytesSent: 254.03 MB (266371240) - OverallThroughput: 69.69 MB/sec - PeakMemoryUsage: 6.31 MB (6619520) - RowsReturned: 1.44M (1435345) - SerializeBatchTime: 3s641ms - UncompressedRowBatchSize: 254.03 MB (266371240) CodeGen:(Total: 476.870ms, non-child: 476.870ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 165.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 285.012ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.703ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 290.486ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 616.565us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4487903) - ProbeRows: 1.44M (1435345) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.379ms - RowsReturned: 1.44M (1435345) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 39.360us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 388.585us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.619us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 206.453ms, non-child: 19.268us, % non-child: 0.01%) - ConvertRowBatchTime: 7.651us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.33 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 206.438ms - DataArrivalTimer: 206.434ms SenderSide: - DeserializeRowBatchTimer: 70.396us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s455ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499689) - BuildTime: 5s145ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659939) - ProbeRows: 19.58M (19575134) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s947ms - RowsReturned: 1.44M (1435345) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s436ms - BuildRowsPartitioned: 9.50M (9499689) - GetNewBlockTime: 2.726ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.84K (49840) - HashTablesBuildTime: 692.527ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 393.246ms, % non-child: 0.47%) - ConvertRowBatchTime: 274.698ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499689) - RowsReturnedRate: 113.25 K/sec RecvrSide: BytesReceived(16s000ms): 61.93 MB, 168.34 MB, 209.23 MB, 219.57 MB, 223.07 MB, 224.09 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 338.273ms - TotalBytesReceived: 224.20 MB (235088876) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s754ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s385ms, % non-child: 0.25%) - ConvertRowBatchTime: 696.552ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19575134) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.32 MB, 10.02 MB, 10.02 MB, 10.02 MB, 23.20 MB, 243.97 MB, 609.54 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s658ms - TotalBytesReceived: 2.66 GB (2854776627) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 15s947ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce1800000195 (host=foo.221.28:22000):(Total: 10m34s, non-child: 4s515ms, % non-child: 0.71%) MemoryUsage(16s000ms): 122.96 MB, 283.94 MB, 289.37 MB, 289.37 MB, 289.37 MB, 377.77 MB, 536.96 MB, 537.38 MB, 536.83 MB, 537.07 MB, 536.68 MB, 536.84 MB, 536.58 MB, 536.67 MB, 536.64 MB, 536.73 MB, 536.49 MB, 536.54 MB, 536.56 MB, 536.65 MB, 536.56 MB, 536.71 MB, 536.76 MB, 536.85 MB, 536.66 MB, 536.84 MB, 536.70 MB, 536.52 MB, 536.83 MB, 536.66 MB, 536.76 MB, 536.63 MB, 536.72 MB, 536.84 MB, 536.65 MB, 536.43 MB, 536.67 MB, 536.29 MB, 536.87 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.29 MB (572826629) - PerHostPeakMemUsage: 1.38 GB (1485233861) - RowsProduced: 1.43M (1434048) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 71.849ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.91K (7913) - TotalThreadsTotalWallClockTime: 12m5s - TotalThreadsSysTime: 2s409ms - TotalThreadsUserTime: 21s845ms - TotalThreadsVoluntaryContextSwitches: 122.07K (122066) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m30s - PrepareTime: 34.705ms - ExecTreePrepareTime: 432.256us DataStreamSender (dst_id=23):(Total: 3s717ms, non-child: 3s717ms, % non-child: 100.00%) - BytesSent: 253.69 MB (266013711) - OverallThroughput: 68.25 MB/sec - PeakMemoryUsage: 6.36 MB (6668672) - RowsReturned: 1.43M (1434048) - SerializeBatchTime: 3s713ms - UncompressedRowBatchSize: 253.69 MB (266013711) CodeGen:(Total: 459.026ms, non-child: 459.026ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 157.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 275.823ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.374ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 304.212ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 397.229us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490304) - ProbeRows: 1.43M (1434048) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 291.820ms - RowsReturned: 1.43M (1434048) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 41.472us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 184.795us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.732us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s141ms, non-child: 21.139us, % non-child: 0.00%) - ConvertRowBatchTime: 7.544us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 240.00 /sec RecvrSide: BytesReceived(16s000ms): 3.21 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1s141ms - DataArrivalTimer: 1s141ms SenderSide: - DeserializeRowBatchTimer: 189.444us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s671ms, % non-child: 1.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506061) - BuildTime: 5s177ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663733) - ProbeRows: 19.58M (19576801) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s202ms - RowsReturned: 1.43M (1434048) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s482ms - BuildRowsPartitioned: 9.51M (9506061) - GetNewBlockTime: 1.643ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.70K (49697) - HashTablesBuildTime: 678.475ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 390.704ms, % non-child: 0.46%) - ConvertRowBatchTime: 277.286ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506061) - RowsReturnedRate: 112.17 K/sec RecvrSide: BytesReceived(16s000ms): 55.27 MB, 164.31 MB, 208.25 MB, 219.39 MB, 223.10 MB, 224.23 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB, 224.35 MB - FirstBatchArrivalWaitTime: 1s260ms - TotalBytesReceived: 224.35 MB (235250380) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s642ms - NumBatchesAccepted: 16.92K (16923) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s431ms, % non-child: 0.26%) - ConvertRowBatchTime: 745.998ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576801) - RowsReturnedRate: 35.70 K/sec RecvrSide: BytesReceived(16s000ms): 0, 6.73 MB, 10.01 MB, 10.01 MB, 10.01 MB, 18.75 MB, 225.83 MB, 587.80 MB, 1006.91 MB, 1.38 GB, 1.66 GB, 1.83 GB, 1.93 GB, 2.01 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.25 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s613ms - TotalBytesReceived: 2.66 GB (2855051871) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s447ms - NumBatchesAccepted: 113.88K (113883) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce18000001d4 (host=foo.246.40:22000):(Total: 10m34s, non-child: 4s689ms, % non-child: 0.74%) MemoryUsage(16s000ms): 139.94 MB, 285.39 MB, 289.38 MB, 289.38 MB, 289.38 MB, 392.72 MB, 537.07 MB, 537.01 MB, 536.75 MB, 537.00 MB, 536.82 MB, 536.68 MB, 536.63 MB, 536.67 MB, 536.71 MB, 536.48 MB, 537.02 MB, 537.45 MB, 536.61 MB, 536.59 MB, 536.63 MB, 536.69 MB, 536.77 MB, 536.82 MB, 536.79 MB, 536.50 MB, 536.59 MB, 536.64 MB, 536.75 MB, 536.66 MB, 536.74 MB, 536.60 MB, 536.58 MB, 536.86 MB, 536.46 MB, 536.66 MB, 536.73 MB, 536.29 MB, 537.26 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.23 MB (572765308) - PerHostPeakMemUsage: 1.28 GB (1376696014) - RowsProduced: 1.43M (1432992) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 159.448ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.27K (8274) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s428ms - TotalThreadsUserTime: 22s042ms - TotalThreadsVoluntaryContextSwitches: 121.98K (121981) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 44.714ms - ExecTreePrepareTime: 790.609us DataStreamSender (dst_id=23):(Total: 3s668ms, non-child: 3s668ms, % non-child: 100.00%) - BytesSent: 253.55 MB (265865773) - OverallThroughput: 69.12 MB/sec - PeakMemoryUsage: 5.93 MB (6218112) - RowsReturned: 1.43M (1432992) - SerializeBatchTime: 3s663ms - UncompressedRowBatchSize: 253.55 MB (265865773) CodeGen:(Total: 503.879ms, non-child: 503.879ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 156.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 313.320ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 33.410ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 320.264ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.638ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488102) - ProbeRows: 1.43M (1432992) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 306.571ms - RowsReturned: 1.43M (1432992) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.608us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 999.249us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 215.769us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 24.676us, non-child: 24.676us, % non-child: 100.00%) - ConvertRowBatchTime: 9.626us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 11.10 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.736us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 204.794us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 9s041ms, % non-child: 1.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501442) - BuildTime: 5s407ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658891) - ProbeRows: 19.57M (19572132) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s420ms - RowsReturned: 1.43M (1432992) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s679ms - BuildRowsPartitioned: 9.50M (9501442) - GetNewBlockTime: 2.398ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.25K (50253) - HashTablesBuildTime: 713.006ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 380.264ms, % non-child: 0.46%) - ConvertRowBatchTime: 269.502ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501442) - RowsReturnedRate: 113.74 K/sec RecvrSide: BytesReceived(16s000ms): 65.83 MB, 170.55 MB, 209.84 MB, 219.74 MB, 223.18 MB, 224.15 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.24 MB (235129119) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s712ms - NumBatchesAccepted: 16.91K (16908) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s397ms, % non-child: 0.26%) - ConvertRowBatchTime: 735.722ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572132) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.60 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.84 MB, 254.19 MB, 621.48 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s106ms - TotalBytesReceived: 2.66 GB (2854644544) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s791ms - NumBatchesAccepted: 113.86K (113855) - NumBatchesRejected: 93 (93) Instance 5f429df048b5534b:41bcce18000001c8 (host=foo.246.39:22000):(Total: 10m34s, non-child: 4s586ms, % non-child: 0.72%) MemoryUsage(16s000ms): 148.11 MB, 285.46 MB, 289.39 MB, 289.39 MB, 289.39 MB, 393.41 MB, 537.06 MB, 537.10 MB, 536.95 MB, 537.05 MB, 536.68 MB, 536.80 MB, 536.99 MB, 536.67 MB, 536.88 MB, 536.85 MB, 536.72 MB, 536.44 MB, 536.76 MB, 536.73 MB, 536.81 MB, 536.70 MB, 536.71 MB, 536.75 MB, 536.71 MB, 536.54 MB, 536.68 MB, 537.01 MB, 536.40 MB, 536.77 MB, 536.52 MB, 536.68 MB, 536.84 MB, 536.13 MB, 536.62 MB, 536.81 MB, 536.70 MB, 537.21 MB, 536.55 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.43 MB (572975248) - PerHostPeakMemUsage: 1.27 GB (1362652558) - RowsProduced: 1.44M (1435791) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 265.145ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.11K (8106) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s349ms - TotalThreadsUserTime: 21s636ms - TotalThreadsVoluntaryContextSwitches: 122.98K (122985) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 33.340ms - ExecTreePrepareTime: 208.445us DataStreamSender (dst_id=23):(Total: 3s638ms, non-child: 3s638ms, % non-child: 100.00%) - BytesSent: 254.02 MB (266357919) - OverallThroughput: 69.82 MB/sec - PeakMemoryUsage: 6.00 MB (6291840) - RowsReturned: 1.44M (1435791) - SerializeBatchTime: 3s633ms - UncompressedRowBatchSize: 254.02 MB (266357919) CodeGen:(Total: 462.858ms, non-child: 462.858ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 148.890ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 289.183ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.320ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 303.648ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.277ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490839) - ProbeRows: 1.44M (1435791) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 291.903ms - RowsReturned: 1.44M (1435791) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.240us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 791.967us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.160us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 18.512us, non-child: 18.512us, % non-child: 100.00%) - ConvertRowBatchTime: 10.695us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.80 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.905us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 98.957us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s799ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9505450) - BuildTime: 5s007ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546663040) - ProbeRows: 19.57M (19573747) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s243ms - RowsReturned: 1.44M (1435791) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s406ms - BuildRowsPartitioned: 9.51M (9505450) - GetNewBlockTime: 2.027ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.43K (50431) - HashTablesBuildTime: 587.586ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 379.026ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.677ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9505450) - RowsReturnedRate: 113.28 K/sec RecvrSide: BytesReceived(16s000ms): 66.37 MB, 170.87 MB, 209.99 MB, 219.84 MB, 223.27 MB, 224.23 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.32 MB (235218916) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s705ms - NumBatchesAccepted: 16.92K (16921) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s398ms, % non-child: 0.26%) - ConvertRowBatchTime: 727.698ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573747) - RowsReturnedRate: 35.73 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.65 MB, 10.02 MB, 10.02 MB, 10.02 MB, 26.33 MB, 255.27 MB, 622.74 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s210ms - TotalBytesReceived: 2.66 GB (2854551835) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s902ms - NumBatchesAccepted: 113.86K (113862) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce18000001df (host=foo.246.48:22000):(Total: 10m33s, non-child: 4s604ms, % non-child: 0.73%) MemoryUsage(16s000ms): 149.44 MB, 285.95 MB, 289.39 MB, 289.39 MB, 289.39 MB, 384.83 MB, 537.17 MB, 536.76 MB, 537.01 MB, 536.81 MB, 536.78 MB, 536.73 MB, 536.83 MB, 536.80 MB, 537.18 MB, 536.79 MB, 536.67 MB, 536.74 MB, 536.87 MB, 536.74 MB, 536.67 MB, 536.79 MB, 536.94 MB, 536.93 MB, 536.76 MB, 536.60 MB, 536.64 MB, 536.65 MB, 537.01 MB, 536.58 MB, 536.78 MB, 536.53 MB, 536.68 MB, 536.59 MB, 536.63 MB, 536.99 MB, 536.39 MB, 536.15 MB, 537.19 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.52 MB (573070058) - PerHostPeakMemUsage: 1.20 GB (1291562661) - RowsProduced: 1.43M (1429989) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 145.249ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.25K (8252) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s257ms - TotalThreadsUserTime: 20s742ms - TotalThreadsVoluntaryContextSwitches: 122.64K (122638) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 44.898ms - ExecTreePrepareTime: 396.182us DataStreamSender (dst_id=23):(Total: 3s561ms, non-child: 3s561ms, % non-child: 100.00%) - BytesSent: 253.06 MB (265355368) - OverallThroughput: 71.05 MB/sec - PeakMemoryUsage: 6.25 MB (6553984) - RowsReturned: 1.43M (1429989) - SerializeBatchTime: 3s558ms - UncompressedRowBatchSize: 253.06 MB (265355368) CodeGen:(Total: 531.387ms, non-child: 531.387ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 190.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 305.172ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 35.358ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 271.677ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 693.174us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489864) - ProbeRows: 1.43M (1429989) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 260.094ms - RowsReturned: 1.43M (1429989) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 42.358us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 396.480us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 102.002us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 28.782us, non-child: 28.782us, % non-child: 100.00%) - ConvertRowBatchTime: 20.254us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 9.52 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.583us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 73.576us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s244ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9497863) - BuildTime: 4s835ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658350) - ProbeRows: 19.57M (19571833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s770ms - RowsReturned: 1.43M (1429989) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s125ms - BuildRowsPartitioned: 9.50M (9497863) - GetNewBlockTime: 1.433ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.87K (49872) - HashTablesBuildTime: 695.447ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 365.711ms, % non-child: 0.43%) - ConvertRowBatchTime: 261.688ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9497863) - RowsReturnedRate: 111.79 K/sec RecvrSide: BytesReceived(16s000ms): 70.02 MB, 172.64 MB, 210.32 MB, 219.81 MB, 223.15 MB, 224.07 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB, 224.15 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.15 MB (235040552) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s613ms - NumBatchesAccepted: 16.91K (16906) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s362ms, % non-child: 0.25%) - ConvertRowBatchTime: 708.427ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571833) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.94 MB, 10.02 MB, 10.02 MB, 10.02 MB, 28.72 MB, 264.40 MB, 633.98 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 17s972ms - TotalBytesReceived: 2.66 GB (2854499224) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s103ms - NumBatchesAccepted: 113.86K (113859) - NumBatchesRejected: 104 (104) Instance 5f429df048b5534b:41bcce18000001b8 (host=foo.234.43:22000):(Total: 10m33s, non-child: 4s432ms, % non-child: 0.70%) MemoryUsage(16s000ms): 139.82 MB, 285.02 MB, 289.38 MB, 289.37 MB, 289.37 MB, 386.73 MB, 536.89 MB, 536.71 MB, 536.89 MB, 536.89 MB, 536.97 MB, 536.71 MB, 536.57 MB, 536.87 MB, 537.13 MB, 536.96 MB, 536.73 MB, 536.39 MB, 536.74 MB, 536.68 MB, 536.92 MB, 536.86 MB, 536.44 MB, 536.64 MB, 536.75 MB, 536.87 MB, 536.74 MB, 536.79 MB, 536.68 MB, 536.74 MB, 536.81 MB, 536.72 MB, 536.45 MB, 536.41 MB, 536.30 MB, 536.93 MB, 536.51 MB, 536.78 MB, 536.91 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.50 MB (573044451) - PerHostPeakMemUsage: 1.31 GB (1402606304) - RowsProduced: 1.43M (1433362) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 123.456ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.96K (7956) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s372ms - TotalThreadsUserTime: 21s987ms - TotalThreadsVoluntaryContextSwitches: 121.99K (121992) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 51.025ms - ExecTreePrepareTime: 537.318us DataStreamSender (dst_id=23):(Total: 3s700ms, non-child: 3s700ms, % non-child: 100.00%) - BytesSent: 253.66 MB (265979236) - OverallThroughput: 68.55 MB/sec - PeakMemoryUsage: 6.48 MB (6799744) - RowsReturned: 1.43M (1433362) - SerializeBatchTime: 3s695ms - UncompressedRowBatchSize: 253.66 MB (265979236) CodeGen:(Total: 464.006ms, non-child: 464.006ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 147.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 275.504ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 40.331ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 316.255ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 602.391us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493045) - ProbeRows: 1.43M (1433362) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 303.559ms - RowsReturned: 1.43M (1433362) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.631us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 401.730us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.765us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.135ms, non-child: 16.570us, % non-child: 0.12%) - ConvertRowBatchTime: 7.524us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 19.38 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 14.121ms - DataArrivalTimer: 14.119ms SenderSide: - DeserializeRowBatchTimer: 80.401us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 9s011ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9507666) - BuildTime: 5s303ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546656115) - ProbeRows: 19.57M (19574629) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s426ms - RowsReturned: 1.43M (1433362) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s573ms - BuildRowsPartitioned: 9.51M (9507666) - GetNewBlockTime: 1.586ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.83K (49834) - HashTablesBuildTime: 716.328ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 382.308ms, % non-child: 0.46%) - ConvertRowBatchTime: 271.569ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9507666) - RowsReturnedRate: 113.19 K/sec RecvrSide: BytesReceived(16s000ms): 63.22 MB, 169.27 MB, 209.59 MB, 219.77 MB, 223.28 MB, 224.28 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB, 224.39 MB - FirstBatchArrivalWaitTime: 133.963ms - TotalBytesReceived: 224.39 MB (235286330) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s668ms - NumBatchesAccepted: 16.93K (16925) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s396ms, % non-child: 0.26%) - ConvertRowBatchTime: 742.038ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574629) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.37 MB, 10.01 MB, 10.01 MB, 10.01 MB, 24.01 MB, 247.33 MB, 613.21 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s486ms - TotalBytesReceived: 2.66 GB (2854805006) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s330ms - NumBatchesAccepted: 113.88K (113877) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001a8 (host=foo.234.40:22000):(Total: 10m33s, non-child: 4s636ms, % non-child: 0.73%) MemoryUsage(16s000ms): 140.36 MB, 285.40 MB, 289.40 MB, 289.40 MB, 289.40 MB, 398.38 MB, 536.84 MB, 536.76 MB, 536.77 MB, 536.85 MB, 536.84 MB, 536.59 MB, 536.80 MB, 536.54 MB, 536.80 MB, 536.93 MB, 536.81 MB, 536.69 MB, 536.67 MB, 536.91 MB, 536.91 MB, 536.57 MB, 536.73 MB, 536.57 MB, 536.84 MB, 536.89 MB, 536.79 MB, 536.66 MB, 536.84 MB, 536.65 MB, 536.87 MB, 536.81 MB, 536.43 MB, 536.44 MB, 537.06 MB, 537.09 MB, 536.60 MB, 536.19 MB, 536.76 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.26 MB (572795937) - PerHostPeakMemUsage: 1.30 GB (1393390360) - RowsProduced: 1.43M (1431205) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 331.430ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.15K (8154) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s408ms - TotalThreadsUserTime: 21s778ms - TotalThreadsVoluntaryContextSwitches: 122.27K (122273) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 36.070ms - ExecTreePrepareTime: 464.636us DataStreamSender (dst_id=23):(Total: 3s676ms, non-child: 3s676ms, % non-child: 100.00%) - BytesSent: 253.23 MB (265534546) - OverallThroughput: 68.88 MB/sec - PeakMemoryUsage: 5.91 MB (6201728) - RowsReturned: 1.43M (1431205) - SerializeBatchTime: 3s672ms - UncompressedRowBatchSize: 253.23 MB (265534546) CodeGen:(Total: 500.166ms, non-child: 500.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 171.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 301.439ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.510ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 316.105ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 393.620us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491706) - ProbeRows: 1.43M (1431205) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 303.165ms - RowsReturned: 1.43M (1431205) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.882us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 205.481us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.208us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.683us, non-child: 15.683us, % non-child: 100.00%) - ConvertRowBatchTime: 7.951us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.47 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.052us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 70.095us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s953ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9501497) - BuildTime: 5s244ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662557) - ProbeRows: 19.56M (19563784) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s330ms - RowsReturned: 1.43M (1431205) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s491ms - BuildRowsPartitioned: 9.50M (9501497) - GetNewBlockTime: 1.931ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.24K (50245) - HashTablesBuildTime: 739.323ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 383.932ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.164ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9501497) - RowsReturnedRate: 113.66 K/sec RecvrSide: BytesReceived(16s000ms): 65.64 MB, 170.47 MB, 209.80 MB, 219.72 MB, 223.17 MB, 224.15 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB, 224.24 MB - FirstBatchArrivalWaitTime: 83.470ms - TotalBytesReceived: 224.24 MB (235131192) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s563ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s371ms, % non-child: 0.25%) - ConvertRowBatchTime: 732.319ms - PeakMemoryUsage: 0 - RowsReturned: 19.56M (19563784) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.61 MB, 10.02 MB, 10.02 MB, 10.02 MB, 25.75 MB, 253.49 MB, 620.72 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s412ms - TotalBytesReceived: 2.66 GB (2853318671) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s627ms - NumBatchesAccepted: 113.80K (113798) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce18000001a5 (host=foo.232.50:22000):(Total: 10m33s, non-child: 4s869ms, % non-child: 0.77%) MemoryUsage(16s000ms): 148.36 MB, 285.52 MB, 289.37 MB, 289.37 MB, 289.37 MB, 401.08 MB, 536.96 MB, 537.01 MB, 537.19 MB, 536.86 MB, 536.90 MB, 536.80 MB, 536.85 MB, 536.69 MB, 536.81 MB, 536.64 MB, 536.84 MB, 536.91 MB, 536.94 MB, 536.77 MB, 536.82 MB, 536.75 MB, 536.49 MB, 536.63 MB, 536.84 MB, 536.58 MB, 536.93 MB, 536.61 MB, 537.02 MB, 536.65 MB, 536.73 MB, 536.73 MB, 536.77 MB, 536.67 MB, 536.35 MB, 536.45 MB, 536.94 MB, 536.25 MB, 537.27 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.07 MB (572591556) - PerHostPeakMemUsage: 1.33 GB (1430724863) - RowsProduced: 1.43M (1432113) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 389.699ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.82K (7816) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s388ms - TotalThreadsUserTime: 21s568ms - TotalThreadsVoluntaryContextSwitches: 122.47K (122470) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 36.886ms - ExecTreePrepareTime: 478.369us DataStreamSender (dst_id=23):(Total: 3s642ms, non-child: 3s642ms, % non-child: 100.00%) - BytesSent: 253.37 MB (265674424) - OverallThroughput: 69.56 MB/sec - PeakMemoryUsage: 6.27 MB (6570368) - RowsReturned: 1.43M (1432113) - SerializeBatchTime: 3s638ms - UncompressedRowBatchSize: 253.37 MB (265674424) CodeGen:(Total: 456.959ms, non-child: 456.959ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 161.198ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 268.027ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.051ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 300.031ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 541.774us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4490853) - ProbeRows: 1.43M (1432113) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 286.916ms - RowsReturned: 1.43M (1432113) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 10.717us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 209.795us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 201.627us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 9.646us, non-child: 9.646us, % non-child: 100.00%) - ConvertRowBatchTime: 4.405us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 28.41 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.062us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 93.348us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s613ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499506) - BuildTime: 5s144ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660576) - ProbeRows: 19.58M (19579527) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s126ms - RowsReturned: 1.43M (1432113) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s432ms - BuildRowsPartitioned: 9.50M (9499506) - GetNewBlockTime: 1.510ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.74K (50738) - HashTablesBuildTime: 699.727ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 392.112ms, % non-child: 0.47%) - ConvertRowBatchTime: 276.465ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499506) - RowsReturnedRate: 113.75 K/sec RecvrSide: BytesReceived(16s000ms): 67.11 MB, 171.25 MB, 209.99 MB, 219.75 MB, 223.15 MB, 224.11 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB, 224.20 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.20 MB (235089494) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s698ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s434ms, % non-child: 0.26%) - ConvertRowBatchTime: 746.224ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19579527) - RowsReturnedRate: 35.74 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.68 MB, 10.00 MB, 10.00 MB, 10.00 MB, 26.84 MB, 257.62 MB, 625.60 MB, 1.02 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s297ms - TotalBytesReceived: 2.66 GB (2855736988) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s682ms - NumBatchesAccepted: 113.91K (113905) - NumBatchesRejected: 83 (83) Instance 5f429df048b5534b:41bcce18000001b1 (host=foo.234.36:22000):(Total: 10m33s, non-child: 4s302ms, % non-child: 0.68%) MemoryUsage(16s000ms): 139.82 MB, 285.05 MB, 289.38 MB, 289.38 MB, 289.38 MB, 388.06 MB, 536.68 MB, 536.85 MB, 537.09 MB, 537.15 MB, 536.93 MB, 536.86 MB, 536.72 MB, 536.68 MB, 536.51 MB, 536.67 MB, 536.80 MB, 537.09 MB, 536.80 MB, 536.65 MB, 536.70 MB, 536.70 MB, 536.86 MB, 536.61 MB, 536.78 MB, 536.81 MB, 536.63 MB, 536.48 MB, 536.88 MB, 536.78 MB, 536.60 MB, 536.63 MB, 536.66 MB, 536.78 MB, 536.88 MB, 537.01 MB, 536.49 MB, 536.28 MB, 536.40 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.26 MB (572791066) - PerHostPeakMemUsage: 1.21 GB (1300992377) - RowsProduced: 1.43M (1432875) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 78.218ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.07K (8072) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s263ms - TotalThreadsUserTime: 21s024ms - TotalThreadsVoluntaryContextSwitches: 122.03K (122026) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 32.403ms - ExecTreePrepareTime: 387.222us DataStreamSender (dst_id=23):(Total: 3s650ms, non-child: 3s650ms, % non-child: 100.00%) - BytesSent: 253.54 MB (265858606) - OverallThroughput: 69.45 MB/sec - PeakMemoryUsage: 6.52 MB (6832512) - RowsReturned: 1.43M (1432875) - SerializeBatchTime: 3s646ms - UncompressedRowBatchSize: 253.54 MB (265858606) CodeGen:(Total: 460.372ms, non-child: 460.372ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 139.372ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 296.770ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.691ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 278.533ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 647.217us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493598) - ProbeRows: 1.43M (1432875) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 266.599ms - RowsReturned: 1.43M (1432875) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.730us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 347.927us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.150us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.903us, non-child: 16.903us, % non-child: 100.00%) - ConvertRowBatchTime: 7.487us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.21 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.860us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 87.622us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s189ms, % non-child: 1.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9505059) - BuildTime: 4s749ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662912) - ProbeRows: 19.58M (19576090) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s813ms - RowsReturned: 1.43M (1432875) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s166ms - BuildRowsPartitioned: 9.51M (9505059) - GetNewBlockTime: 1.166ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.30K (50299) - HashTablesBuildTime: 570.516ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 376.071ms, % non-child: 0.45%) - ConvertRowBatchTime: 266.108ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9505059) - RowsReturnedRate: 112.64 K/sec RecvrSide: BytesReceived(16s000ms): 63.24 MB, 169.22 MB, 209.54 MB, 219.71 MB, 223.22 MB, 224.22 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB, 224.32 MB - FirstBatchArrivalWaitTime: 123.740ms - TotalBytesReceived: 224.32 MB (235219206) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s638ms - NumBatchesAccepted: 16.92K (16917) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s419ms, % non-child: 0.26%) - ConvertRowBatchTime: 730.607ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19576090) - RowsReturnedRate: 35.69 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.40 MB, 10.01 MB, 10.01 MB, 10.01 MB, 24.05 MB, 247.49 MB, 613.43 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s464ms - TotalBytesReceived: 2.66 GB (2855218732) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s930ms - NumBatchesAccepted: 113.88K (113879) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce18000001bb (host=foo.234.47:22000):(Total: 10m33s, non-child: 4s428ms, % non-child: 0.70%) MemoryUsage(16s000ms): 140.37 MB, 285.30 MB, 289.37 MB, 289.37 MB, 289.37 MB, 391.04 MB, 537.00 MB, 537.11 MB, 537.13 MB, 537.01 MB, 536.82 MB, 537.05 MB, 536.72 MB, 536.96 MB, 536.74 MB, 536.77 MB, 536.52 MB, 536.49 MB, 536.84 MB, 536.74 MB, 536.91 MB, 536.77 MB, 536.55 MB, 536.98 MB, 536.63 MB, 536.74 MB, 536.52 MB, 536.99 MB, 536.56 MB, 536.71 MB, 536.66 MB, 536.88 MB, 536.54 MB, 536.79 MB, 536.94 MB, 536.75 MB, 536.78 MB, 536.24 MB, 536.94 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.26 MB (572797746) - PerHostPeakMemUsage: 1.31 GB (1401445567) - RowsProduced: 1.43M (1430986) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 122.567ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.17K (8172) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s357ms - TotalThreadsUserTime: 21s713ms - TotalThreadsVoluntaryContextSwitches: 122.53K (122527) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 46.609ms - ExecTreePrepareTime: 480.450us DataStreamSender (dst_id=23):(Total: 3s607ms, non-child: 3s607ms, % non-child: 100.00%) - BytesSent: 253.22 MB (265517850) - OverallThroughput: 70.20 MB/sec - PeakMemoryUsage: 5.95 MB (6234496) - RowsReturned: 1.43M (1430986) - SerializeBatchTime: 3s603ms - UncompressedRowBatchSize: 253.22 MB (265517850) CodeGen:(Total: 485.221ms, non-child: 485.221ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 308.111ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.634ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 311.177ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 505.898us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488798) - ProbeRows: 1.43M (1430986) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 298.568ms - RowsReturned: 1.43M (1430986) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 12.319us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 191.573us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 134.909us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 10.091us, non-child: 10.091us, % non-child: 100.00%) - ConvertRowBatchTime: 4.564us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 27.15 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.406us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 75.672us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s967ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500540) - BuildTime: 5s222ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662890) - ProbeRows: 19.57M (19572849) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s372ms - RowsReturned: 1.43M (1430986) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s501ms - BuildRowsPartitioned: 9.50M (9500540) - GetNewBlockTime: 1.169ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.94K (49939) - HashTablesBuildTime: 707.976ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 388.325ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.998ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500540) - RowsReturnedRate: 113.24 K/sec RecvrSide: BytesReceived(16s000ms): 65.15 MB, 170.21 MB, 209.73 MB, 219.70 MB, 223.14 MB, 224.12 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.21 MB (235106136) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s726ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s385ms, % non-child: 0.25%) - ConvertRowBatchTime: 728.954ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572849) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.55 MB, 10.00 MB, 10.00 MB, 10.00 MB, 25.34 MB, 252.10 MB, 619.14 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s291ms - TotalBytesReceived: 2.66 GB (2854758604) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s862ms - NumBatchesAccepted: 113.86K (113864) - NumBatchesRejected: 88 (88) Instance 5f429df048b5534b:41bcce18000001ae (host=foo.234.49:22000):(Total: 10m33s, non-child: 4s341ms, % non-child: 0.69%) MemoryUsage(16s000ms): 140.36 MB, 285.32 MB, 289.38 MB, 289.38 MB, 289.38 MB, 391.14 MB, 537.08 MB, 536.94 MB, 536.87 MB, 536.89 MB, 537.03 MB, 536.81 MB, 536.78 MB, 536.53 MB, 537.18 MB, 536.72 MB, 536.67 MB, 536.85 MB, 536.82 MB, 536.58 MB, 536.49 MB, 536.55 MB, 536.85 MB, 536.55 MB, 536.82 MB, 536.66 MB, 536.65 MB, 536.71 MB, 536.80 MB, 536.72 MB, 536.68 MB, 536.65 MB, 536.59 MB, 536.68 MB, 536.80 MB, 536.92 MB, 536.77 MB, 535.99 MB, 537.04 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572785703) - PerHostPeakMemUsage: 1.28 GB (1376628520) - RowsProduced: 1.43M (1433132) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 79.337ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.05K (8055) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s266ms - TotalThreadsUserTime: 21s583ms - TotalThreadsVoluntaryContextSwitches: 123.11K (123113) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 35.681ms - ExecTreePrepareTime: 505.667us DataStreamSender (dst_id=23):(Total: 3s639ms, non-child: 3s639ms, % non-child: 100.00%) - BytesSent: 253.62 MB (265938065) - OverallThroughput: 69.68 MB/sec - PeakMemoryUsage: 6.36 MB (6668672) - RowsReturned: 1.43M (1433132) - SerializeBatchTime: 3s635ms - UncompressedRowBatchSize: 253.62 MB (265938065) CodeGen:(Total: 496.629ms, non-child: 496.629ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 179.158ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 291.311ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.644ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 312.762ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 607.477us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4501692) - ProbeRows: 1.43M (1433132) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 300.177ms - RowsReturned: 1.43M (1433132) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.683us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 297.308us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 155.555us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.560us, non-child: 16.560us, % non-child: 100.00%) - ConvertRowBatchTime: 8.306us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.55 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.303us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 107.581us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s752ms, % non-child: 1.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503294) - BuildTime: 5s009ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662594) - ProbeRows: 19.57M (19574309) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s285ms - RowsReturned: 1.43M (1433132) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s291ms - BuildRowsPartitioned: 9.50M (9503294) - GetNewBlockTime: 1.482ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.46K (50459) - HashTablesBuildTime: 706.625ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 382.272ms, % non-child: 0.45%) - ConvertRowBatchTime: 269.742ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503294) - RowsReturnedRate: 113.00 K/sec RecvrSide: BytesReceived(16s000ms): 65.16 MB, 170.27 MB, 209.77 MB, 219.77 MB, 223.22 MB, 224.19 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.28 MB (235176726) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s610ms - NumBatchesAccepted: 16.92K (16917) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s362ms, % non-child: 0.25%) - ConvertRowBatchTime: 723.805ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574309) - RowsReturnedRate: 35.74 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.56 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.35 MB, 252.15 MB, 619.15 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s301ms - TotalBytesReceived: 2.66 GB (2854902157) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s569ms - NumBatchesAccepted: 113.87K (113871) - NumBatchesRejected: 93 (93) Instance 5f429df048b5534b:41bcce18000001d0 (host=foo.246.46:22000):(Total: 10m33s, non-child: 4s097ms, % non-child: 0.65%) MemoryUsage(16s000ms): 156.47 MB, 286.01 MB, 289.40 MB, 289.39 MB, 289.39 MB, 401.43 MB, 537.29 MB, 536.61 MB, 536.76 MB, 536.58 MB, 536.51 MB, 536.52 MB, 536.70 MB, 536.78 MB, 536.54 MB, 536.64 MB, 536.65 MB, 536.27 MB, 536.80 MB, 536.71 MB, 537.00 MB, 536.78 MB, 536.54 MB, 536.61 MB, 536.81 MB, 536.82 MB, 536.68 MB, 536.72 MB, 536.58 MB, 536.58 MB, 536.59 MB, 536.82 MB, 536.49 MB, 536.80 MB, 536.92 MB, 536.50 MB, 536.74 MB, 537.26 MB, 535.80 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.34 MB (572880455) - PerHostPeakMemUsage: 1.20 GB (1286662146) - RowsProduced: 1.43M (1432574) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 162.679ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.65K (7649) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s183ms - TotalThreadsUserTime: 20s345ms - TotalThreadsVoluntaryContextSwitches: 122.79K (122789) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 31.660ms - ExecTreePrepareTime: 440.017us DataStreamSender (dst_id=23):(Total: 3s590ms, non-child: 3s590ms, % non-child: 100.00%) - BytesSent: 253.43 MB (265742713) - OverallThroughput: 70.58 MB/sec - PeakMemoryUsage: 6.17 MB (6472064) - RowsReturned: 1.43M (1432574) - SerializeBatchTime: 3s586ms - UncompressedRowBatchSize: 253.43 MB (265742713) CodeGen:(Total: 456.274ms, non-child: 456.274ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 150.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.050ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 21.916ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 276.393ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 568.258us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4501690) - ProbeRows: 1.43M (1432574) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.600ms - RowsReturned: 1.43M (1432574) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.842us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 258.950us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 169.763us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.355us, non-child: 15.355us, % non-child: 100.00%) - ConvertRowBatchTime: 7.274us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.84 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.204us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 73.971us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s043ms, % non-child: 1.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9506645) - BuildTime: 4s771ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657879) - ProbeRows: 19.57M (19573032) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s658ms - RowsReturned: 1.43M (1432574) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s175ms - BuildRowsPartitioned: 9.51M (9506645) - GetNewBlockTime: 5.334ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.71K (49714) - HashTablesBuildTime: 584.072ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 373.711ms, % non-child: 0.44%) - ConvertRowBatchTime: 267.184ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9506645) - RowsReturnedRate: 113.19 K/sec RecvrSide: BytesReceived(16s000ms): 70.60 MB, 173.08 MB, 210.62 MB, 220.05 MB, 223.37 MB, 224.28 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB, 224.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.36 MB (235259314) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s706ms - NumBatchesAccepted: 16.93K (16925) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s346ms, % non-child: 0.25%) - ConvertRowBatchTime: 701.750ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573032) - RowsReturnedRate: 35.67 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.98 MB, 10.02 MB, 10.02 MB, 10.02 MB, 29.44 MB, 266.02 MB, 635.20 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s050ms - TotalBytesReceived: 2.66 GB (2854628964) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s014ms - NumBatchesAccepted: 113.86K (113861) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001c9 (host=foo.246.51:22000):(Total: 10m33s, non-child: 4s615ms, % non-child: 0.73%) MemoryUsage(16s000ms): 148.47 MB, 285.86 MB, 289.39 MB, 289.39 MB, 289.39 MB, 399.67 MB, 537.05 MB, 536.78 MB, 537.03 MB, 536.99 MB, 536.75 MB, 536.66 MB, 536.74 MB, 536.69 MB, 536.67 MB, 536.76 MB, 536.95 MB, 537.31 MB, 536.99 MB, 536.43 MB, 536.56 MB, 536.53 MB, 536.85 MB, 536.68 MB, 536.65 MB, 536.79 MB, 536.70 MB, 536.64 MB, 536.79 MB, 536.70 MB, 536.66 MB, 536.79 MB, 536.67 MB, 536.87 MB, 536.35 MB, 536.68 MB, 536.81 MB, 536.12 MB, 536.82 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.43 MB (572976491) - PerHostPeakMemUsage: 1.23 GB (1319248021) - RowsProduced: 1.44M (1435098) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 183.017ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.38K (8379) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s381ms - TotalThreadsUserTime: 21s624ms - TotalThreadsVoluntaryContextSwitches: 121.73K (121729) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 36.247ms - ExecTreePrepareTime: 478.761us DataStreamSender (dst_id=23):(Total: 3s720ms, non-child: 3s720ms, % non-child: 100.00%) - BytesSent: 253.97 MB (266305241) - OverallThroughput: 68.27 MB/sec - PeakMemoryUsage: 6.09 MB (6390144) - RowsReturned: 1.44M (1435098) - SerializeBatchTime: 3s716ms - UncompressedRowBatchSize: 253.97 MB (266305241) CodeGen:(Total: 501.746ms, non-child: 501.746ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 155.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 320.087ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.650ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 297.075ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 790.009us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4487105) - ProbeRows: 1.44M (1435098) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 284.599ms - RowsReturned: 1.44M (1435098) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.337us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 518.664us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 109.070us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.786us, non-child: 16.786us, % non-child: 100.00%) - ConvertRowBatchTime: 7.602us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.32 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.853us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 70.689us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s503ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499461) - BuildTime: 4s812ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661248) - ProbeRows: 19.57M (19572387) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s192ms - RowsReturned: 1.44M (1435098) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s219ms - BuildRowsPartitioned: 9.50M (9499461) - GetNewBlockTime: 1.257ms - HashBuckets: 16.78M (16777216) - HashCollisions: 49.96K (49961) - HashTablesBuildTime: 579.132ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 377.186ms, % non-child: 0.45%) - ConvertRowBatchTime: 266.345ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499461) - RowsReturnedRate: 113.23 K/sec RecvrSide: BytesReceived(16s000ms): 69.30 MB, 172.38 MB, 210.30 MB, 219.83 MB, 223.19 MB, 224.11 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.19 MB (235080947) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s650ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s483ms, % non-child: 0.27%) - ConvertRowBatchTime: 755.012ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572387) - RowsReturnedRate: 35.75 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.89 MB, 10.02 MB, 10.02 MB, 10.02 MB, 28.35 MB, 262.71 MB, 631.62 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s001ms - TotalBytesReceived: 2.66 GB (2854715828) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 17s150ms - NumBatchesAccepted: 113.85K (113851) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001d8 (host=foo.246.52:22000):(Total: 10m33s, non-child: 4s389ms, % non-child: 0.69%) MemoryUsage(16s000ms): 148.48 MB, 285.85 MB, 289.39 MB, 289.39 MB, 289.39 MB, 389.29 MB, 536.78 MB, 536.78 MB, 536.82 MB, 537.05 MB, 536.61 MB, 536.86 MB, 536.50 MB, 536.80 MB, 536.60 MB, 536.65 MB, 536.73 MB, 536.33 MB, 536.68 MB, 536.71 MB, 536.47 MB, 536.62 MB, 536.81 MB, 536.69 MB, 536.67 MB, 536.78 MB, 536.77 MB, 536.94 MB, 536.59 MB, 536.80 MB, 536.72 MB, 536.71 MB, 536.81 MB, 536.36 MB, 536.41 MB, 536.56 MB, 536.49 MB, 537.23 MB, 536.21 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.85 MB (573409979) - PerHostPeakMemUsage: 1.23 GB (1318272346) - RowsProduced: 1.43M (1433740) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 159.080ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.24K (8236) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s335ms - TotalThreadsUserTime: 21s742ms - TotalThreadsVoluntaryContextSwitches: 122.09K (122091) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 38.353ms - ExecTreePrepareTime: 377.991us DataStreamSender (dst_id=23):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) - BytesSent: 253.68 MB (266001592) - OverallThroughput: 69.41 MB/sec - PeakMemoryUsage: 6.46 MB (6775168) - RowsReturned: 1.43M (1433740) - SerializeBatchTime: 3s650ms - UncompressedRowBatchSize: 253.68 MB (266001592) CodeGen:(Total: 467.929ms, non-child: 467.929ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 147.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 290.898ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 28.628ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 310.393ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 654.729us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4493077) - ProbeRows: 1.43M (1433740) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 297.724ms - RowsReturned: 1.43M (1433740) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 26.809us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 339.807us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 170.977us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 31.583us, non-child: 31.583us, % non-child: 100.00%) - ConvertRowBatchTime: 8.429us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 8.68 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.368us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 112.750us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s733ms, % non-child: 1.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502984) - BuildTime: 5s124ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546655191) - ProbeRows: 19.58M (19580358) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s247ms - RowsReturned: 1.43M (1433740) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s520ms - BuildRowsPartitioned: 9.50M (9502984) - GetNewBlockTime: 1.570ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.28K (50285) - HashTablesBuildTime: 591.016ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 390.025ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.377ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502984) - RowsReturnedRate: 112.84 K/sec RecvrSide: BytesReceived(16s000ms): 69.44 MB, 172.49 MB, 210.37 MB, 219.90 MB, 223.25 MB, 224.17 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.25 MB (235145257) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s722ms - NumBatchesAccepted: 16.92K (16916) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s407ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.734ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580358) - RowsReturnedRate: 35.79 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.88 MB, 10.02 MB, 10.02 MB, 10.02 MB, 28.35 MB, 262.98 MB, 631.99 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s001ms - TotalBytesReceived: 2.66 GB (2855714631) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s584ms - NumBatchesAccepted: 113.90K (113903) - NumBatchesRejected: 98 (98) Instance 5f429df048b5534b:41bcce1800000194 (host=foo.232.24:22000):(Total: 10m33s, non-child: 4s244ms, % non-child: 0.67%) MemoryUsage(16s000ms): 131.85 MB, 284.78 MB, 289.38 MB, 289.38 MB, 289.38 MB, 391.13 MB, 536.82 MB, 536.72 MB, 536.77 MB, 536.65 MB, 536.72 MB, 536.83 MB, 536.59 MB, 536.60 MB, 536.48 MB, 536.49 MB, 536.94 MB, 536.51 MB, 536.91 MB, 536.76 MB, 536.65 MB, 536.60 MB, 536.31 MB, 536.64 MB, 536.85 MB, 536.76 MB, 536.76 MB, 536.64 MB, 536.63 MB, 536.91 MB, 536.54 MB, 536.81 MB, 536.64 MB, 536.54 MB, 536.66 MB, 536.42 MB, 536.78 MB, 536.96 MB, 536.62 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.67 MB (573224118) - PerHostPeakMemUsage: 1.32 GB (1416421510) - RowsProduced: 1.43M (1434490) - TotalNetworkReceiveTime: 10m32s - TotalNetworkSendTime: 74.187ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.79K (7789) - TotalThreadsTotalWallClockTime: 12m4s - TotalThreadsSysTime: 2s324ms - TotalThreadsUserTime: 21s109ms - TotalThreadsVoluntaryContextSwitches: 122.81K (122814) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m30s - ExecTreeOpenTime: 1m29s - PrepareTime: 35.432ms - ExecTreePrepareTime: 619.043us DataStreamSender (dst_id=23):(Total: 3s641ms, non-child: 3s641ms, % non-child: 100.00%) - BytesSent: 253.87 MB (266205882) - OverallThroughput: 69.72 MB/sec - PeakMemoryUsage: 6.24 MB (6545792) - RowsReturned: 1.43M (1434490) - SerializeBatchTime: 3s637ms - UncompressedRowBatchSize: 253.87 MB (266205882) CodeGen:(Total: 424.087ms, non-child: 424.087ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 129.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 269.149ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 24.737ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 283.511ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 574.846us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4488367) - ProbeRows: 1.43M (1434490) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 271.392ms - RowsReturned: 1.43M (1434490) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 40.571us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 106.030us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.995us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 771.963ms, non-child: 18.440us, % non-child: 0.00%) - ConvertRowBatchTime: 9.221us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 354.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 771.948ms - DataArrivalTimer: 771.945ms SenderSide: - DeserializeRowBatchTimer: 65.544us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m25s, non-child: 8s444ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503342) - BuildTime: 5s055ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661281) - ProbeRows: 19.57M (19571632) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s943ms - RowsReturned: 1.43M (1434490) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s377ms - BuildRowsPartitioned: 9.50M (9503342) - GetNewBlockTime: 1.459ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.10K (50105) - HashTablesBuildTime: 663.451ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 385.453ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.610ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503342) - RowsReturnedRate: 112.47 K/sec RecvrSide: BytesReceived(16s000ms): 61.19 MB, 167.97 MB, 209.17 MB, 219.58 MB, 223.13 MB, 224.17 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB - FirstBatchArrivalWaitTime: 896.780ms - TotalBytesReceived: 224.27 MB (235168646) - TotalGetBatchTime: 1m24s - DataArrivalTimer: 1m24s SenderSide: - DeserializeRowBatchTimer: 1s750ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s387ms, % non-child: 0.25%) - ConvertRowBatchTime: 721.205ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571632) - RowsReturnedRate: 35.68 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.24 MB, 10.02 MB, 10.02 MB, 10.02 MB, 22.69 MB, 241.78 MB, 606.44 MB, 1.00 GB, 1.40 GB, 1.67 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 19s229ms - TotalBytesReceived: 2.66 GB (2854397740) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m7s SenderSide: - DeserializeRowBatchTimer: 16s525ms - NumBatchesAccepted: 113.85K (113851) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce1800000193 (host=foo.232.41:22000):(Total: 10m33s, non-child: 4s927ms, % non-child: 0.78%) MemoryUsage(16s000ms): 139.57 MB, 284.97 MB, 289.40 MB, 289.40 MB, 289.40 MB, 393.29 MB, 537.05 MB, 537.13 MB, 537.10 MB, 536.97 MB, 536.75 MB, 536.69 MB, 536.50 MB, 536.64 MB, 536.84 MB, 536.94 MB, 536.64 MB, 536.46 MB, 536.54 MB, 536.68 MB, 536.88 MB, 536.88 MB, 536.76 MB, 536.71 MB, 536.70 MB, 536.60 MB, 536.78 MB, 536.60 MB, 536.76 MB, 536.68 MB, 536.62 MB, 536.90 MB, 536.60 MB, 536.80 MB, 536.65 MB, 536.45 MB, 536.92 MB, 536.94 MB, 537.05 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.34 MB (572878087) - PerHostPeakMemUsage: 1.24 GB (1330584364) - RowsProduced: 1.43M (1432940) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 443.157ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.82K (7824) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s332ms - TotalThreadsUserTime: 21s469ms - TotalThreadsVoluntaryContextSwitches: 123.43K (123428) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 41.508ms - ExecTreePrepareTime: 853.919us DataStreamSender (dst_id=23):(Total: 3s622ms, non-child: 3s622ms, % non-child: 100.00%) - BytesSent: 253.50 MB (265810341) - OverallThroughput: 69.98 MB/sec - PeakMemoryUsage: 6.20 MB (6496640) - RowsReturned: 1.43M (1432940) - SerializeBatchTime: 3s618ms - UncompressedRowBatchSize: 253.50 MB (265810341) CodeGen:(Total: 453.462ms, non-child: 453.462ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 135.502ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 287.537ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.822ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 295.886ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 485.226us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491979) - ProbeRows: 1.43M (1432940) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 283.175ms - RowsReturned: 1.43M (1432940) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35.853us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 252.012us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.851us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 137.574ms, non-child: 11.647us, % non-child: 0.01%) - ConvertRowBatchTime: 4.150us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 1.99 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 137.564ms - DataArrivalTimer: 137.562ms SenderSide: - DeserializeRowBatchTimer: 49.858us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s468ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503176) - BuildTime: 5s086ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661494) - ProbeRows: 19.57M (19565899) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s973ms - RowsReturned: 1.43M (1432940) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s386ms - BuildRowsPartitioned: 9.50M (9503176) - GetNewBlockTime: 1.076ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.33K (50326) - HashTablesBuildTime: 687.142ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 388.556ms, % non-child: 0.46%) - ConvertRowBatchTime: 271.187ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503176) - RowsReturnedRate: 113.36 K/sec RecvrSide: BytesReceived(16s000ms): 62.56 MB, 168.75 MB, 209.39 MB, 219.64 MB, 223.15 MB, 224.17 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB, 224.27 MB - FirstBatchArrivalWaitTime: 252.100ms - TotalBytesReceived: 224.27 MB (235165424) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s757ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s465ms, % non-child: 0.27%) - ConvertRowBatchTime: 721.531ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19565899) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.35 MB, 10.02 MB, 10.02 MB, 10.02 MB, 23.71 MB, 245.43 MB, 610.67 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s593ms - TotalBytesReceived: 2.66 GB (2853692512) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s351ms - NumBatchesAccepted: 113.82K (113823) - NumBatchesRejected: 92 (92) Instance 5f429df048b5534b:41bcce18000001b4 (host=foo.246.41:22000):(Total: 10m33s, non-child: 4s442ms, % non-child: 0.70%) MemoryUsage(16s000ms): 148.37 MB, 285.68 MB, 289.40 MB, 289.39 MB, 289.39 MB, 396.44 MB, 536.81 MB, 536.95 MB, 536.89 MB, 536.74 MB, 536.79 MB, 536.80 MB, 536.65 MB, 536.60 MB, 536.64 MB, 536.48 MB, 536.88 MB, 536.41 MB, 536.60 MB, 536.71 MB, 536.62 MB, 536.84 MB, 536.61 MB, 536.66 MB, 536.65 MB, 536.65 MB, 536.88 MB, 536.57 MB, 536.89 MB, 536.94 MB, 536.77 MB, 536.77 MB, 536.89 MB, 536.45 MB, 536.45 MB, 536.52 MB, 536.53 MB, 536.26 MB, 536.82 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.36 MB (572901434) - PerHostPeakMemUsage: 1.27 GB (1368878773) - RowsProduced: 1.43M (1431197) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 120.603ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.22K (8220) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s428ms - TotalThreadsUserTime: 21s840ms - TotalThreadsVoluntaryContextSwitches: 122.27K (122273) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 40.096ms - ExecTreePrepareTime: 424.500us DataStreamSender (dst_id=23):(Total: 3s662ms, non-child: 3s662ms, % non-child: 100.00%) - BytesSent: 253.18 MB (265482799) - OverallThroughput: 69.12 MB/sec - PeakMemoryUsage: 6.34 MB (6644096) - RowsReturned: 1.43M (1431197) - SerializeBatchTime: 3s658ms - UncompressedRowBatchSize: 253.18 MB (265482799) CodeGen:(Total: 450.947ms, non-child: 450.947ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 129.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 293.065ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.893ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 308.410ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 589.473us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4495078) - ProbeRows: 1.43M (1431197) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 296.164ms - RowsReturned: 1.43M (1431197) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 25.462us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 377.290us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.878us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 16.424us, non-child: 16.424us, % non-child: 100.00%) - ConvertRowBatchTime: 8.099us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 16.68 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.587us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 110.017us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s981ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503974) - BuildTime: 5s148ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659439) - ProbeRows: 19.57M (19573017) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s368ms - RowsReturned: 1.43M (1431197) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s441ms - BuildRowsPartitioned: 9.50M (9503974) - GetNewBlockTime: 1.252ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.00K (50000) - HashTablesBuildTime: 692.840ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 379.783ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.162ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503974) - RowsReturnedRate: 113.38 K/sec RecvrSide: BytesReceived(16s000ms): 68.17 MB, 171.82 MB, 210.22 MB, 219.88 MB, 223.27 MB, 224.21 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB, 224.29 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.29 MB (235189846) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s688ms - NumBatchesAccepted: 16.91K (16913) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s406ms, % non-child: 0.26%) - ConvertRowBatchTime: 736.254ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573017) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.78 MB, 10.02 MB, 10.02 MB, 10.02 MB, 27.63 MB, 259.88 MB, 628.34 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s173ms - TotalBytesReceived: 2.66 GB (2854562950) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 17s095ms - NumBatchesAccepted: 113.86K (113859) - NumBatchesRejected: 94 (94) Instance 5f429df048b5534b:41bcce18000001af (host=foo.246.37:22000):(Total: 10m33s, non-child: 4s368ms, % non-child: 0.69%) MemoryUsage(16s000ms): 148.36 MB, 285.52 MB, 289.37 MB, 289.37 MB, 289.37 MB, 394.95 MB, 537.06 MB, 536.98 MB, 536.70 MB, 536.85 MB, 536.95 MB, 536.73 MB, 536.55 MB, 536.81 MB, 536.43 MB, 536.53 MB, 536.68 MB, 537.39 MB, 536.79 MB, 536.78 MB, 536.90 MB, 536.91 MB, 536.66 MB, 536.79 MB, 536.65 MB, 536.66 MB, 536.73 MB, 536.81 MB, 536.71 MB, 536.67 MB, 536.68 MB, 536.65 MB, 536.86 MB, 536.49 MB, 536.67 MB, 536.88 MB, 536.80 MB, 537.22 MB, 536.89 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.18 MB (572706781) - PerHostPeakMemUsage: 1.30 GB (1395155466) - RowsProduced: 1.43M (1432416) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 74.807ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.11K (8114) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s357ms - TotalThreadsUserTime: 21s773ms - TotalThreadsVoluntaryContextSwitches: 122.47K (122468) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 37.829ms - ExecTreePrepareTime: 440.766us DataStreamSender (dst_id=23):(Total: 3s651ms, non-child: 3s651ms, % non-child: 100.00%) - BytesSent: 253.44 MB (265755812) - OverallThroughput: 69.41 MB/sec - PeakMemoryUsage: 6.51 MB (6824320) - RowsReturned: 1.43M (1432416) - SerializeBatchTime: 3s646ms - UncompressedRowBatchSize: 253.44 MB (265755812) CodeGen:(Total: 454.507ms, non-child: 454.507ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 134.788ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 292.088ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 27.028ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 315.995ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 845.391us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492117) - ProbeRows: 1.43M (1432416) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 303.113ms - RowsReturned: 1.43M (1432416) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.758us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 325.964us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 121.769us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.734us, non-child: 14.734us, % non-child: 100.00%) - ConvertRowBatchTime: 7.678us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.60 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.964us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 79.931us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s843ms, % non-child: 1.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502392) - BuildTime: 5s187ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659449) - ProbeRows: 19.57M (19571495) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s347ms - RowsReturned: 1.43M (1432416) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s573ms - BuildRowsPartitioned: 9.50M (9502392) - GetNewBlockTime: 1.421ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.27K (50269) - HashTablesBuildTime: 600.394ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 388.328ms, % non-child: 0.46%) - ConvertRowBatchTime: 276.273ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502392) - RowsReturnedRate: 113.51 K/sec RecvrSide: BytesReceived(16s000ms): 66.93 MB, 171.18 MB, 210.03 MB, 219.79 MB, 223.22 MB, 224.17 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB, 224.26 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.26 MB (235152540) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s747ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s394ms, % non-child: 0.25%) - ConvertRowBatchTime: 735.929ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19571495) - RowsReturnedRate: 35.74 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.68 MB, 10.01 MB, 10.01 MB, 10.01 MB, 26.66 MB, 256.81 MB, 624.89 MB, 1.02 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s205ms - TotalBytesReceived: 2.66 GB (2854458342) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s589ms - NumBatchesAccepted: 113.85K (113852) - NumBatchesRejected: 97 (97) Instance 5f429df048b5534b:41bcce18000001c0 (host=foo.246.47:22000):(Total: 10m33s, non-child: 4s603ms, % non-child: 0.73%) MemoryUsage(16s000ms): 148.37 MB, 285.70 MB, 289.39 MB, 289.39 MB, 289.39 MB, 396.01 MB, 537.06 MB, 536.67 MB, 537.02 MB, 536.89 MB, 536.71 MB, 536.42 MB, 536.63 MB, 536.89 MB, 536.47 MB, 536.37 MB, 537.02 MB, 537.08 MB, 536.72 MB, 536.70 MB, 536.60 MB, 536.87 MB, 536.62 MB, 536.82 MB, 536.74 MB, 536.57 MB, 536.78 MB, 536.37 MB, 536.76 MB, 536.55 MB, 536.84 MB, 536.80 MB, 536.56 MB, 536.53 MB, 536.46 MB, 536.82 MB, 536.64 MB, 536.22 MB, 536.79 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.81 MB (573375502) - PerHostPeakMemUsage: 1.27 GB (1359123751) - RowsProduced: 1.43M (1430179) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 200.802ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.46K (8461) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s370ms - TotalThreadsUserTime: 22s146ms - TotalThreadsVoluntaryContextSwitches: 122.17K (122172) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 33.141ms - ExecTreePrepareTime: 260.608us DataStreamSender (dst_id=23):(Total: 3s676ms, non-child: 3s676ms, % non-child: 100.00%) - BytesSent: 253.05 MB (265340597) - OverallThroughput: 68.83 MB/sec - PeakMemoryUsage: 6.64 MB (6963584) - RowsReturned: 1.43M (1430179) - SerializeBatchTime: 3s672ms - UncompressedRowBatchSize: 253.05 MB (265340597) CodeGen:(Total: 449.989ms, non-child: 449.989ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 142.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.647ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.444ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 318.926ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 650.649us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4500014) - ProbeRows: 1.43M (1430179) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 306.223ms - RowsReturned: 1.43M (1430179) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 18.714us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 316.864us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 233.436us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 14.712us, non-child: 14.712us, % non-child: 100.00%) - ConvertRowBatchTime: 7.741us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 18.62 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.484us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 69.304us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 9s105ms, % non-child: 1.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500545) - BuildTime: 5s098ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546660620) - ProbeRows: 19.57M (19573373) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s503ms - RowsReturned: 1.43M (1430179) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s384ms - BuildRowsPartitioned: 9.50M (9500545) - GetNewBlockTime: 1.616ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.07K (50067) - HashTablesBuildTime: 699.561ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 387.993ms, % non-child: 0.46%) - ConvertRowBatchTime: 273.164ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500545) - RowsReturnedRate: 113.41 K/sec RecvrSide: BytesReceived(16s000ms): 68.15 MB, 171.73 MB, 210.12 MB, 219.79 MB, 223.19 MB, 224.13 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.21 MB (235105609) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s606ms - NumBatchesAccepted: 16.91K (16907) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s443ms, % non-child: 0.26%) - ConvertRowBatchTime: 747.960ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573373) - RowsReturnedRate: 35.79 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.79 MB, 10.02 MB, 10.02 MB, 10.02 MB, 27.62 MB, 259.87 MB, 628.19 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s038ms - TotalBytesReceived: 2.66 GB (2854642795) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s889ms - NumBatchesAccepted: 113.86K (113862) - NumBatchesRejected: 96 (96) Instance 5f429df048b5534b:41bcce18000001be (host=foo.246.42:22000):(Total: 10m33s, non-child: 4s511ms, % non-child: 0.71%) MemoryUsage(16s000ms): 148.37 MB, 285.59 MB, 289.38 MB, 289.38 MB, 289.37 MB, 394.19 MB, 536.99 MB, 537.20 MB, 536.79 MB, 537.05 MB, 536.77 MB, 536.83 MB, 536.64 MB, 536.59 MB, 536.92 MB, 536.90 MB, 536.50 MB, 537.06 MB, 536.69 MB, 536.72 MB, 536.71 MB, 536.86 MB, 536.66 MB, 536.61 MB, 536.59 MB, 536.74 MB, 536.95 MB, 536.66 MB, 536.74 MB, 536.80 MB, 536.67 MB, 536.74 MB, 536.52 MB, 536.67 MB, 536.75 MB, 536.87 MB, 536.92 MB, 536.69 MB, 537.07 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.49 MB (573039359) - PerHostPeakMemUsage: 1.22 GB (1308016236) - RowsProduced: 1.43M (1431262) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 119.792ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.54K (8545) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s414ms - TotalThreadsUserTime: 21s762ms - TotalThreadsVoluntaryContextSwitches: 121.90K (121898) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 43.175ms - ExecTreePrepareTime: 753.540us DataStreamSender (dst_id=23):(Total: 3s620ms, non-child: 3s620ms, % non-child: 100.00%) - BytesSent: 253.26 MB (265566656) - OverallThroughput: 69.96 MB/sec - PeakMemoryUsage: 6.15 MB (6447488) - RowsReturned: 1.43M (1431262) - SerializeBatchTime: 3s615ms - UncompressedRowBatchSize: 253.26 MB (265566656) CodeGen:(Total: 455.457ms, non-child: 455.457ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 136.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 285.365ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.692ms HASH_JOIN_NODE (id=11):(Total: 10m25s, non-child: 302.005ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 986.389us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4489471) - ProbeRows: 1.43M (1431262) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.331ms - RowsReturned: 1.43M (1431262) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 34.513us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 336.043us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 465.590us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 20.306us, non-child: 20.306us, % non-child: 100.00%) - ConvertRowBatchTime: 11.246us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 13.49 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.507us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 37.272us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s909ms, % non-child: 1.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9502506) - BuildTime: 5s057ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662937) - ProbeRows: 19.57M (19569319) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s309ms - RowsReturned: 1.43M (1431262) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s319ms - BuildRowsPartitioned: 9.50M (9502506) - GetNewBlockTime: 1.597ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.04K (50042) - HashTablesBuildTime: 724.389ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 381.138ms, % non-child: 0.45%) - ConvertRowBatchTime: 270.640ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9502506) - RowsReturnedRate: 113.25 K/sec RecvrSide: BytesReceived(16s000ms): 67.45 MB, 171.42 MB, 210.09 MB, 219.81 MB, 223.21 MB, 224.16 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB, 224.25 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.25 MB (235144871) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s660ms - NumBatchesAccepted: 16.91K (16915) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s439ms, % non-child: 0.26%) - ConvertRowBatchTime: 752.564ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19569319) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.72 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.07 MB, 258.34 MB, 626.31 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s119ms - TotalBytesReceived: 2.66 GB (2854123592) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s524ms - NumBatchesAccepted: 113.84K (113838) - NumBatchesRejected: 95 (95) Instance 5f429df048b5534b:41bcce18000001a2 (host=foo.246.49:22000):(Total: 10m33s, non-child: 5s150ms, % non-child: 0.81%) MemoryUsage(16s000ms): 148.36 MB, 285.69 MB, 289.38 MB, 289.38 MB, 289.38 MB, 403.10 MB, 536.68 MB, 536.82 MB, 537.17 MB, 536.80 MB, 536.84 MB, 536.71 MB, 536.58 MB, 536.71 MB, 536.81 MB, 536.95 MB, 536.54 MB, 536.21 MB, 536.59 MB, 536.96 MB, 536.74 MB, 536.87 MB, 536.79 MB, 536.76 MB, 536.78 MB, 536.80 MB, 536.91 MB, 536.49 MB, 536.74 MB, 536.50 MB, 536.56 MB, 536.82 MB, 536.48 MB, 536.50 MB, 536.90 MB, 536.30 MB, 536.63 MB, 536.70 MB, 536.36 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.21 MB (572739744) - PerHostPeakMemUsage: 1.23 GB (1315483351) - RowsProduced: 1.43M (1431818) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 542.077ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.08K (8080) - TotalThreadsTotalWallClockTime: 12m1s - TotalThreadsSysTime: 2s292ms - TotalThreadsUserTime: 21s540ms - TotalThreadsVoluntaryContextSwitches: 122.01K (122014) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m28s - ExecTreeOpenTime: 1m28s - PrepareTime: 45.945ms - ExecTreePrepareTime: 563.150us DataStreamSender (dst_id=23):(Total: 3s637ms, non-child: 3s637ms, % non-child: 100.00%) - BytesSent: 253.41 MB (265720906) - OverallThroughput: 69.66 MB/sec - PeakMemoryUsage: 6.45 MB (6766976) - RowsReturned: 1.43M (1431818) - SerializeBatchTime: 3s633ms - UncompressedRowBatchSize: 253.41 MB (265720906) CodeGen:(Total: 474.951ms, non-child: 474.951ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 143.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 297.901ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.835ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 286.448ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 908.726us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4492524) - ProbeRows: 1.43M (1431818) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 274.534ms - RowsReturned: 1.43M (1431818) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.003us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 522.023us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 105.100us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 18.577us, non-child: 18.577us, % non-child: 100.00%) - ConvertRowBatchTime: 8.497us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 14.75 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 3.612us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 131.430us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m23s, non-child: 8s459ms, % non-child: 1.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.51M (9505676) - BuildTime: 4s990ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658004) - ProbeRows: 19.57M (19574843) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s074ms - RowsReturned: 1.43M (1431818) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s320ms - BuildRowsPartitioned: 9.51M (9505676) - GetNewBlockTime: 1.349ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.29K (50290) - HashTablesBuildTime: 656.440ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 373.342ms, % non-child: 0.45%) - ConvertRowBatchTime: 263.533ms - PeakMemoryUsage: 0 - RowsReturned: 9.51M (9505676) - RowsReturnedRate: 114.07 K/sec RecvrSide: BytesReceived(16s000ms): 68.16 MB, 171.90 MB, 210.31 MB, 219.94 MB, 223.32 MB, 224.25 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB, 224.34 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.34 MB (235236051) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m22s SenderSide: - DeserializeRowBatchTimer: 1s669ms - NumBatchesAccepted: 16.92K (16918) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s442ms, % non-child: 0.26%) - ConvertRowBatchTime: 738.547ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574843) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.78 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.65 MB, 259.88 MB, 628.43 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 17s988ms - TotalBytesReceived: 2.66 GB (2854914790) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s890ms - NumBatchesAccepted: 113.87K (113870) - NumBatchesRejected: 86 (86) Instance 5f429df048b5534b:41bcce1800000196 (host=foo.232.14:22000):(Total: 10m33s, non-child: 4s291ms, % non-child: 0.68%) MemoryUsage(16s000ms): 139.32 MB, 284.96 MB, 289.40 MB, 289.40 MB, 289.40 MB, 392.86 MB, 537.15 MB, 536.92 MB, 537.24 MB, 536.85 MB, 536.98 MB, 536.70 MB, 536.51 MB, 536.88 MB, 537.15 MB, 536.60 MB, 536.99 MB, 537.02 MB, 536.98 MB, 536.77 MB, 536.89 MB, 537.09 MB, 536.77 MB, 536.75 MB, 536.67 MB, 536.46 MB, 536.90 MB, 536.80 MB, 536.76 MB, 536.73 MB, 536.55 MB, 536.65 MB, 536.67 MB, 536.63 MB, 536.48 MB, 536.49 MB, 536.79 MB, 537.26 MB, 536.95 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.32 MB (572862282) - PerHostPeakMemUsage: 1.35 GB (1446295791) - RowsProduced: 1.43M (1431445) - TotalNetworkReceiveTime: 10m31s - TotalNetworkSendTime: 73.512ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.56K (7564) - TotalThreadsTotalWallClockTime: 12m3s - TotalThreadsSysTime: 2s375ms - TotalThreadsUserTime: 21s259ms - TotalThreadsVoluntaryContextSwitches: 123.05K (123046) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m29s - PrepareTime: 39.813ms - ExecTreePrepareTime: 582.290us DataStreamSender (dst_id=23):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) - BytesSent: 253.34 MB (265649293) - OverallThroughput: 68.72 MB/sec - PeakMemoryUsage: 6.04 MB (6332800) - RowsReturned: 1.43M (1431445) - SerializeBatchTime: 3s682ms - UncompressedRowBatchSize: 253.34 MB (265649293) CodeGen:(Total: 473.325ms, non-child: 473.325ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 151.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 291.601ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 29.431ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 294.795ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 397.620us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493733) - ProbeRows: 1.43M (1431445) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.050ms - RowsReturned: 1.43M (1431445) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.784us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 170.840us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.280us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 474.283ms, non-child: 15.492us, % non-child: 0.00%) - ConvertRowBatchTime: 7.487us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 577.00 /sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 474.270ms - DataArrivalTimer: 474.268ms SenderSide: - DeserializeRowBatchTimer: 162.863us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s572ms, % non-child: 1.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9498714) - BuildTime: 5s116ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661470) - ProbeRows: 19.57M (19572257) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s046ms - RowsReturned: 1.43M (1431445) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s444ms - BuildRowsPartitioned: 9.50M (9498714) - GetNewBlockTime: 3.887ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.47K (50474) - HashTablesBuildTime: 655.946ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 394.280ms, % non-child: 0.47%) - ConvertRowBatchTime: 275.896ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9498714) - RowsReturnedRate: 112.92 K/sec RecvrSide: BytesReceived(16s000ms): 62.47 MB, 168.57 MB, 209.27 MB, 219.55 MB, 223.05 MB, 224.07 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB, 224.17 MB - FirstBatchArrivalWaitTime: 598.547ms - TotalBytesReceived: 224.17 MB (235061309) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s805ms - NumBatchesAccepted: 16.91K (16910) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m8s, non-child: 1s407ms, % non-child: 0.26%) - ConvertRowBatchTime: 715.950ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19572257) - RowsReturnedRate: 35.71 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.35 MB, 10.02 MB, 10.02 MB, 10.02 MB, 23.65 MB, 245.25 MB, 610.65 MB, 1.01 GB, 1.40 GB, 1.68 GB, 1.84 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.31 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.55 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.61 GB, 2.63 GB, 2.63 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s927ms - TotalBytesReceived: 2.66 GB (2854496853) - TotalGetBatchTime: 9m7s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s413ms - NumBatchesAccepted: 113.85K (113853) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce180000019a (host=foo.234.39:22000):(Total: 10m33s, non-child: 4s648ms, % non-child: 0.73%) MemoryUsage(16s000ms): 140.37 MB, 285.31 MB, 289.38 MB, 289.38 MB, 289.38 MB, 397.17 MB, 536.83 MB, 536.85 MB, 536.76 MB, 537.15 MB, 536.73 MB, 536.85 MB, 536.86 MB, 536.65 MB, 536.46 MB, 536.68 MB, 536.41 MB, 536.52 MB, 536.75 MB, 536.60 MB, 536.83 MB, 536.62 MB, 536.90 MB, 536.71 MB, 536.74 MB, 536.71 MB, 536.68 MB, 536.54 MB, 536.81 MB, 536.52 MB, 536.96 MB, 536.63 MB, 536.85 MB, 537.03 MB, 536.54 MB, 536.66 MB, 536.61 MB, 536.01 MB, 536.89 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.36 MB (572899412) - PerHostPeakMemUsage: 1.30 GB (1392426219) - RowsProduced: 1.43M (1433979) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 285.930ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.77K (7773) - TotalThreadsTotalWallClockTime: 12m2s - TotalThreadsSysTime: 2s377ms - TotalThreadsUserTime: 21s828ms - TotalThreadsVoluntaryContextSwitches: 122.81K (122812) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 36.184ms - ExecTreePrepareTime: 1.023ms DataStreamSender (dst_id=23):(Total: 3s693ms, non-child: 3s693ms, % non-child: 100.00%) - BytesSent: 253.77 MB (266098957) - OverallThroughput: 68.72 MB/sec - PeakMemoryUsage: 5.98 MB (6275456) - RowsReturned: 1.43M (1433979) - SerializeBatchTime: 3s688ms - UncompressedRowBatchSize: 253.77 MB (266098957) CodeGen:(Total: 436.732ms, non-child: 436.732ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 270.151ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 25.121ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 321.608ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 777.960us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4493814) - ProbeRows: 1.43M (1433979) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 308.467ms - RowsReturned: 1.43M (1433979) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.028us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 395.238us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 73.858us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 2.518ms, non-child: 25.296us, % non-child: 1.00%) - ConvertRowBatchTime: 13.070us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 108.81 K/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.497ms - DataArrivalTimer: 2.493ms SenderSide: - DeserializeRowBatchTimer: 54.726us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 9s172ms, % non-child: 1.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499560) - BuildTime: 5s193ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546662334) - ProbeRows: 19.57M (19573307) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s513ms - RowsReturned: 1.43M (1433979) - RowsReturnedRate: 2.30 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s457ms - BuildRowsPartitioned: 9.50M (9499560) - GetNewBlockTime: 1.336ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.25K (50246) - HashTablesBuildTime: 723.195ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 390.625ms, % non-child: 0.47%) - ConvertRowBatchTime: 276.366ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499560) - RowsReturnedRate: 113.58 K/sec RecvrSide: BytesReceived(16s000ms): 65.13 MB, 170.20 MB, 209.72 MB, 219.67 MB, 223.11 MB, 224.09 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB, 224.18 MB - FirstBatchArrivalWaitTime: 129.121ms - TotalBytesReceived: 224.18 MB (235072967) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s667ms - NumBatchesAccepted: 16.90K (16903) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s391ms, % non-child: 0.25%) - ConvertRowBatchTime: 739.782ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19573307) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.55 MB, 10.01 MB, 10.01 MB, 10.01 MB, 25.38 MB, 251.95 MB, 619.05 MB, 1.02 GB, 1.41 GB, 1.68 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s464ms - TotalBytesReceived: 2.66 GB (2854765864) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s944ms - NumBatchesAccepted: 113.86K (113859) - NumBatchesRejected: 89 (89) Instance 5f429df048b5534b:41bcce18000001a1 (host=foo.234.45:22000):(Total: 10m33s, non-child: 4s410ms, % non-child: 0.70%) MemoryUsage(16s000ms): 148.29 MB, 285.65 MB, 289.37 MB, 289.37 MB, 289.37 MB, 403.21 MB, 536.99 MB, 536.82 MB, 537.26 MB, 536.84 MB, 536.97 MB, 536.76 MB, 536.92 MB, 537.02 MB, 536.70 MB, 536.40 MB, 536.81 MB, 536.61 MB, 536.57 MB, 536.88 MB, 536.48 MB, 536.52 MB, 536.79 MB, 536.71 MB, 536.79 MB, 536.68 MB, 536.75 MB, 536.77 MB, 536.71 MB, 536.85 MB, 536.79 MB, 536.82 MB, 536.41 MB, 536.59 MB, 536.70 MB, 536.74 MB, 536.67 MB, 536.57 MB, 536.57 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.25 MB (572789237) - PerHostPeakMemUsage: 1.19 GB (1277946058) - RowsProduced: 1.43M (1433499) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 185.730ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.97K (7970) - TotalThreadsTotalWallClockTime: 12m1s - TotalThreadsSysTime: 2s214ms - TotalThreadsUserTime: 21s067ms - TotalThreadsVoluntaryContextSwitches: 122.71K (122714) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m55s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 38.700ms - ExecTreePrepareTime: 688.387us DataStreamSender (dst_id=23):(Total: 3s635ms, non-child: 3s635ms, % non-child: 100.00%) - BytesSent: 253.62 MB (265934687) - OverallThroughput: 69.76 MB/sec - PeakMemoryUsage: 6.35 MB (6660480) - RowsReturned: 1.43M (1433499) - SerializeBatchTime: 3s631ms - UncompressedRowBatchSize: 253.62 MB (265934687) CodeGen:(Total: 477.705ms, non-child: 477.705ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 167.241ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 283.763ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 26.069ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 276.546ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 651.075us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.29 MB (4496469) - ProbeRows: 1.43M (1433499) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.446ms - RowsReturned: 1.43M (1433499) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 31.029us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 423.002us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.562us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 17.163us, non-child: 17.163us, % non-child: 100.00%) - ConvertRowBatchTime: 9.175us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 15.96 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.683us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 149.141us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s249ms, % non-child: 1.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9504191) - BuildTime: 4s948ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546661525) - ProbeRows: 19.57M (19574133) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s886ms - RowsReturned: 1.43M (1433499) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s309ms - BuildRowsPartitioned: 9.50M (9504191) - GetNewBlockTime: 1.762ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.62K (50623) - HashTablesBuildTime: 626.459ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 368.368ms, % non-child: 0.44%) - ConvertRowBatchTime: 257.108ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9504191) - RowsReturnedRate: 113.59 K/sec RecvrSide: BytesReceived(16s000ms): 67.81 MB, 171.69 MB, 210.22 MB, 219.91 MB, 223.28 MB, 224.22 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB, 224.30 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.30 MB (235198274) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s599ms - NumBatchesAccepted: 16.92K (16920) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s394ms, % non-child: 0.25%) - ConvertRowBatchTime: 706.953ms - PeakMemoryUsage: 0 - RowsReturned: 19.57M (19574133) - RowsReturnedRate: 35.72 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.76 MB, 10.00 MB, 10.00 MB, 10.00 MB, 27.35 MB, 259.04 MB, 627.28 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.53 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s310ms - TotalBytesReceived: 2.66 GB (2854743124) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 15s887ms - NumBatchesAccepted: 113.87K (113872) - NumBatchesRejected: 84 (84) Instance 5f429df048b5534b:41bcce1800000198 (host=foo.234.48:22000):(Total: 10m33s, non-child: 4s314ms, % non-child: 0.68%) MemoryUsage(16s000ms): 148.29 MB, 285.57 MB, 289.38 MB, 289.38 MB, 289.38 MB, 402.46 MB, 537.22 MB, 536.83 MB, 537.19 MB, 536.90 MB, 536.74 MB, 536.62 MB, 536.87 MB, 536.54 MB, 537.01 MB, 536.94 MB, 536.61 MB, 536.89 MB, 536.88 MB, 536.55 MB, 536.60 MB, 536.63 MB, 536.52 MB, 536.68 MB, 536.62 MB, 536.79 MB, 536.60 MB, 536.71 MB, 536.60 MB, 536.59 MB, 536.80 MB, 536.69 MB, 536.57 MB, 536.78 MB, 536.51 MB, 536.78 MB, 536.70 MB, 536.95 MB, 536.61 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.22 MB (572755021) - PerHostPeakMemUsage: 1.28 GB (1370121389) - RowsProduced: 1.43M (1431492) - TotalNetworkReceiveTime: 10m30s - TotalNetworkSendTime: 89.127ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.10K (8102) - TotalThreadsTotalWallClockTime: 12m1s - TotalThreadsSysTime: 2s287ms - TotalThreadsUserTime: 21s343ms - TotalThreadsVoluntaryContextSwitches: 122.20K (122199) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m56s - OpenTime: 1m29s - ExecTreeOpenTime: 1m28s - PrepareTime: 46.912ms - ExecTreePrepareTime: 839.624us DataStreamSender (dst_id=23):(Total: 3s627ms, non-child: 3s627ms, % non-child: 100.00%) - BytesSent: 253.34 MB (265641384) - OverallThroughput: 69.83 MB/sec - PeakMemoryUsage: 6.44 MB (6750592) - RowsReturned: 1.43M (1431492) - SerializeBatchTime: 3s623ms - UncompressedRowBatchSize: 253.34 MB (265641384) CodeGen:(Total: 452.801ms, non-child: 452.801ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 146.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 272.814ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 32.816ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 310.508ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 714.229us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.49 MB (4707349) - ProbeRows: 1.43M (1431492) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 297.112ms - RowsReturned: 1.43M (1431492) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 22.110us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 395.848us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 179.137us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 15.339us, non-child: 15.339us, % non-child: 100.00%) - ConvertRowBatchTime: 7.571us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 17.86 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 1.553us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 124.982us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s618ms, % non-child: 1.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9499685) - BuildTime: 4s825ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.34 MB (546659520) - ProbeRows: 19.58M (19581540) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s252ms - RowsReturned: 1.43M (1431492) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s221ms - BuildRowsPartitioned: 9.50M (9499685) - GetNewBlockTime: 1.740ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.05K (50045) - HashTablesBuildTime: 588.551ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 382.465ms, % non-child: 0.46%) - ConvertRowBatchTime: 270.240ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9499685) - RowsReturnedRate: 113.43 K/sec RecvrSide: BytesReceived(16s000ms): 67.32 MB, 171.35 MB, 210.01 MB, 219.75 MB, 223.15 MB, 224.10 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB, 224.19 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.19 MB (235080728) - TotalGetBatchTime: 1m23s - DataArrivalTimer: 1m23s SenderSide: - DeserializeRowBatchTimer: 1s745ms - NumBatchesAccepted: 16.91K (16914) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s371ms, % non-child: 0.25%) - ConvertRowBatchTime: 728.221ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19581540) - RowsReturnedRate: 35.76 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.71 MB, 10.01 MB, 10.01 MB, 10.01 MB, 27.09 MB, 258.25 MB, 626.33 MB, 1.03 GB, 1.41 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.20 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s343ms - TotalBytesReceived: 2.66 GB (2855693318) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s462ms - NumBatchesAccepted: 113.90K (113901) - NumBatchesRejected: 85 (85) Instance 5f429df048b5534b:41bcce18000001a4 (host=foo.234.46:22000):(Total: 10m33s, non-child: 4s385ms, % non-child: 0.69%) MemoryUsage(16s000ms): 148.37 MB, 285.72 MB, 289.40 MB, 289.40 MB, 289.39 MB, 402.64 MB, 536.57 MB, 537.09 MB, 536.88 MB, 537.09 MB, 537.10 MB, 536.84 MB, 536.68 MB, 536.55 MB, 537.02 MB, 537.23 MB, 536.59 MB, 537.37 MB, 536.91 MB, 536.61 MB, 536.73 MB, 536.67 MB, 536.50 MB, 536.46 MB, 536.85 MB, 536.66 MB, 536.77 MB, 536.69 MB, 536.69 MB, 536.55 MB, 536.75 MB, 537.08 MB, 536.66 MB, 536.62 MB, 536.72 MB, 536.96 MB, 536.41 MB, 536.39 MB, 537.49 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.39 MB (572931623) - PerHostPeakMemUsage: 1.30 GB (1394424713) - RowsProduced: 1.43M (1431978) - TotalNetworkReceiveTime: 10m29s - TotalNetworkSendTime: 77.990ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.28K (8279) - TotalThreadsTotalWallClockTime: 12m1s - TotalThreadsSysTime: 2s373ms - TotalThreadsUserTime: 21s489ms - TotalThreadsVoluntaryContextSwitches: 122.06K (122058) Fragment Instance Lifecycle Timings: - ExecTime: 9m4s - ExecTreeExecTime: 8m56s - OpenTime: 1m28s - ExecTreeOpenTime: 1m28s - PrepareTime: 33.903ms - ExecTreePrepareTime: 400.635us DataStreamSender (dst_id=23):(Total: 3s611ms, non-child: 3s611ms, % non-child: 100.00%) - BytesSent: 253.47 MB (265777396) - OverallThroughput: 70.17 MB/sec - PeakMemoryUsage: 6.08 MB (6373760) - RowsReturned: 1.43M (1431978) - SerializeBatchTime: 3s607ms - UncompressedRowBatchSize: 253.47 MB (265777396) CodeGen:(Total: 453.206ms, non-child: 453.206ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 141.688ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 286.903ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.988ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 302.691ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 1.257ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.44 MB (4659667) - ProbeRows: 1.43M (1431978) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 289.962ms - RowsReturned: 1.43M (1431978) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.967us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 844.675us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.229us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 20.746us, non-child: 20.746us, % non-child: 100.00%) - ConvertRowBatchTime: 10.117us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 13.21 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 2.649us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 159.354us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m24s, non-child: 8s809ms, % non-child: 1.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9500486) - BuildTime: 4s996ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546658367) - ProbeRows: 19.58M (19577706) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s291ms - RowsReturned: 1.43M (1431978) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s271ms - BuildRowsPartitioned: 9.50M (9500486) - GetNewBlockTime: 1.970ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.14K (50144) - HashTablesBuildTime: 711.061ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m23s, non-child: 377.748ms, % non-child: 0.45%) - ConvertRowBatchTime: 268.054ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9500486) - RowsReturnedRate: 114.04 K/sec RecvrSide: BytesReceived(16s000ms): 68.16 MB, 171.82 MB, 210.15 MB, 219.81 MB, 223.19 MB, 224.13 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB, 224.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.21 MB (235105781) - TotalGetBatchTime: 1m22s - DataArrivalTimer: 1m22s SenderSide: - DeserializeRowBatchTimer: 1s631ms - NumBatchesAccepted: 16.91K (16911) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m7s, non-child: 1s393ms, % non-child: 0.25%) - ConvertRowBatchTime: 728.299ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19577706) - RowsReturnedRate: 35.77 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.80 MB, 10.02 MB, 10.02 MB, 10.02 MB, 27.79 MB, 260.36 MB, 628.93 MB, 1.03 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.94 GB, 2.02 GB, 2.09 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.43 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 17s910ms - TotalBytesReceived: 2.66 GB (2855702733) - TotalGetBatchTime: 9m6s - DataArrivalTimer: 9m6s SenderSide: - DeserializeRowBatchTimer: 16s539ms - NumBatchesAccepted: 113.89K (113886) - NumBatchesRejected: 90 (90) Instance 5f429df048b5534b:41bcce180000019b (host=foo.246.45:22000):(Total: 10m32s, non-child: 4s576ms, % non-child: 0.72%) MemoryUsage(16s000ms): 156.60 MB, 286.02 MB, 289.39 MB, 289.39 MB, 289.39 MB, 408.25 MB, 536.99 MB, 536.92 MB, 536.82 MB, 536.77 MB, 536.63 MB, 536.74 MB, 536.78 MB, 536.74 MB, 537.04 MB, 536.93 MB, 536.70 MB, 536.38 MB, 536.66 MB, 536.78 MB, 536.88 MB, 536.83 MB, 536.66 MB, 536.68 MB, 536.67 MB, 536.63 MB, 536.88 MB, 536.77 MB, 536.90 MB, 536.64 MB, 536.57 MB, 536.88 MB, 536.73 MB, 536.70 MB, 536.87 MB, 536.65 MB, 536.51 MB, 536.35 MB, 536.66 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 6.00 MB (6291456) - PeakMemoryUsage: 546.29 MB (572830543) - PerHostPeakMemUsage: 1.21 GB (1300939375) - RowsProduced: 1.43M (1431833) - TotalNetworkReceiveTime: 10m28s - TotalNetworkSendTime: 189.320ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8.95K (8947) - TotalThreadsTotalWallClockTime: 12m1s - TotalThreadsSysTime: 2s366ms - TotalThreadsUserTime: 22s637ms - TotalThreadsVoluntaryContextSwitches: 121.52K (121518) Fragment Instance Lifecycle Timings: - ExecTime: 9m3s - ExecTreeExecTime: 8m55s - OpenTime: 1m28s - ExecTreeOpenTime: 1m28s - PrepareTime: 33.413ms - ExecTreePrepareTime: 614.321us DataStreamSender (dst_id=23):(Total: 3s665ms, non-child: 3s665ms, % non-child: 100.00%) - BytesSent: 253.42 MB (265734024) - OverallThroughput: 69.13 MB/sec - PeakMemoryUsage: 6.24 MB (6545792) - RowsReturned: 1.43M (1431833) - SerializeBatchTime: 3s661ms - UncompressedRowBatchSize: 253.42 MB (265734024) CodeGen:(Total: 468.181ms, non-child: 468.181ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 140.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 82 (82) - NumInstructions: 4.81K (4811) - OptimizationTime: 303.806ms - PeakMemoryUsage: 2.35 MB (2463232) - PrepareTime: 23.429ms HASH_JOIN_NODE (id=11):(Total: 10m24s, non-child: 307.371ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 274 (274) - BuildTime: 746.037us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.28 MB (4491496) - ProbeRows: 1.43M (1431833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 294.182ms - RowsReturned: 1.43M (1431833) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 15.470us - BuildRowsPartitioned: 274 (274) - GetNewBlockTime: 451.675us - HashBuckets: 512 (512) - HashCollisions: 0 (0) - HashTablesBuildTime: 143.264us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1074304) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 29.298us, non-child: 29.298us, % non-child: 100.00%) - ConvertRowBatchTime: 7.649us - PeakMemoryUsage: 0 - RowsReturned: 274 (274) - RowsReturnedRate: 9.35 M/sec RecvrSide: BytesReceived(16s000ms): 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB, 3.31 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.31 KB (3388) - TotalGetBatchTime: 18.009us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 70.834us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=10):(Total: 10m23s, non-child: 9s190ms, % non-child: 1.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 9.50M (9503340) - BuildTime: 5s410ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 521.33 MB (546657845) - ProbeRows: 19.58M (19580882) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s464ms - RowsReturned: 1.43M (1431833) - RowsReturnedRate: 2.29 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s671ms - BuildRowsPartitioned: 9.50M (9503340) - GetNewBlockTime: 1.482ms - HashBuckets: 16.78M (16777216) - HashCollisions: 50.05K (50049) - HashTablesBuildTime: 725.019ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 521.04 MB (546348160) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=20):(Total: 1m22s, non-child: 378.635ms, % non-child: 0.46%) - ConvertRowBatchTime: 270.017ms - PeakMemoryUsage: 0 - RowsReturned: 9.50M (9503340) - RowsReturnedRate: 114.51 K/sec RecvrSide: BytesReceived(16s000ms): 70.65 MB, 173.09 MB, 210.55 MB, 219.96 MB, 223.29 MB, 224.20 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB, 224.28 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 224.28 MB (235174512) - TotalGetBatchTime: 1m22s - DataArrivalTimer: 1m22s SenderSide: - DeserializeRowBatchTimer: 1s811ms - NumBatchesAccepted: 16.92K (16918) - NumBatchesRejected: 0 (0) EXCHANGE_NODE (id=19):(Total: 9m6s, non-child: 1s446ms, % non-child: 0.26%) - ConvertRowBatchTime: 766.590ms - PeakMemoryUsage: 0 - RowsReturned: 19.58M (19580882) - RowsReturnedRate: 35.81 K/sec RecvrSide: BytesReceived(16s000ms): 0, 7.98 MB, 10.02 MB, 10.02 MB, 10.02 MB, 29.57 MB, 266.70 MB, 636.62 MB, 1.04 GB, 1.42 GB, 1.69 GB, 1.85 GB, 1.95 GB, 2.03 GB, 2.10 GB, 2.15 GB, 2.21 GB, 2.26 GB, 2.32 GB, 2.37 GB, 2.40 GB, 2.44 GB, 2.46 GB, 2.49 GB, 2.51 GB, 2.54 GB, 2.56 GB, 2.57 GB, 2.59 GB, 2.60 GB, 2.62 GB, 2.63 GB, 2.64 GB, 2.64 GB, 2.65 GB, 2.65 GB, 2.66 GB, 2.66 GB, 2.66 GB - FirstBatchArrivalWaitTime: 18s016ms - TotalBytesReceived: 2.66 GB (2856012886) - TotalGetBatchTime: 9m5s - DataArrivalTimer: 9m5s SenderSide: - DeserializeRowBatchTimer: 16s856ms - NumBatchesAccepted: 113.90K (113904) - NumBatchesRejected: 89 (89) Averaged Fragment F01:(Total: 4m37s, non-child: 3m51s, % non-child: 83.28%) split sizes: min: 29.61 GB, max: 30.79 GB, avg: 30.33 GB, stddev: 203.85 MB completion times: min:1m48s max:10m34s mean: 4m38s stddev:2m21s execution rates: min:49.10 MB/sec max:284.71 MB/sec mean:141.47 MB/sec stddev:63.10 MB/sec num instances: 129 - AverageThreadTokens: 4.53 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 354.02 MB (371215598) - PerHostPeakMemUsage: 1.30 GB (1398503610) - RowsProduced: 19.57M (19573548) - TotalNetworkReceiveTime: 20s929ms - TotalNetworkSendTime: 3m34s - TotalStorageWaitTime: 130.527ms - TotalThreadsInvoluntaryContextSwitches: 15.58K (15582) - TotalThreadsTotalWallClockTime: 21m - TotalThreadsSysTime: 7s997ms - TotalThreadsUserTime: 2m4s - TotalThreadsVoluntaryContextSwitches: 615.69K (615690) Fragment Instance Lifecycle Timings: - ExecTime: 4m17s - ExecTreeExecTime: 3s869ms - OpenTime: 20s846ms - ExecTreeOpenTime: 20s356ms - PrepareTime: 45.456ms - ExecTreePrepareTime: 1.451ms DataStreamSender (dst_id=19):(Total: 21s749ms, non-child: 21s749ms, % non-child: 100.00%) - BytesSent: 2.66 GB (2854743198) - OverallThroughput: 125.83 MB/sec - PeakMemoryUsage: 7.96 MB (8348600) - RowsReturned: 19.57M (19573548) - SerializeBatchTime: 21s729ms - UncompressedRowBatchSize: 2.66 GB (2854743198) CodeGen:(Total: 517.565ms, non-child: 517.565ms, % non-child: 100.00%) - CodegenTime: 1.907ms - CompileTime: 156.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.794ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.903ms HASH_JOIN_NODE (id=9):(Total: 24s208ms, non-child: 3s274ms, % non-child: 13.52%) - BuildRows: 462.00K (462000) - BuildTime: 270.235ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161520645) - ProbeRows: 19.57M (19573548) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s956ms - RowsReturned: 19.57M (19573548) - RowsReturnedRate: 795.49 K/sec Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 221.936ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 629.882us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.337ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s071ms, non-child: 20s071ms, % non-child: 100.00%) - ConvertRowBatchTime: 12.953ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.10 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 3s458ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s057ms - DataArrivalTimer: 20s054ms SenderSide: - DeserializeRowBatchTimer: 210.446ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s417ms, non-child: 703.379ms, % non-child: 12.98%) - BuildRows: 91 (91) - BuildTime: 505.647us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2081324) - ProbeRows: 19.57M (19573548) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 659.914ms - RowsReturned: 19.57M (19573548) - RowsReturnedRate: 3.55 M/sec Hash Join Builder (join_node_id=8): - BuildRowsPartitionTime: 39.496us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 156.702us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.850us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 872.252ms, non-child: 872.252ms, % non-child: 100.00%) - ConvertRowBatchTime: 4.033us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 1.39 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 13.102ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 872.241ms - DataArrivalTimer: 872.238ms SenderSide: - DeserializeRowBatchTimer: 85.327us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s842ms, non-child: 3s842ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.46 - BytesRead: 172.30 MB (180674231) - BytesReadDataNodeCache: 0 - BytesReadLocal: 172.30 MB (180674231) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 172.30 MB (180674231) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 884.958ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 191.73 MB (201039556) - PerReadThreadRawHdfsThroughput: 976.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.987ms - RowBatchQueuePutWaitTime: 14m25s - RowsRead: 19.58M (19575044) - RowsReturned: 19.57M (19573548) - RowsReturnedRate: 5.28 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 9.99K (9986) - ScannerThreadsTotalWallClockTime: 16m1s - MaterializeTupleTime(*): 3s101ms - ScannerThreadsSysTime: 6s529ms - ScannerThreadsUserTime: 1m23s - ScannerThreadsVoluntaryContextSwitches: 598.54K (598541) - TotalRawHdfsReadTime(*): 179.566ms - TotalReadThroughput: 750.76 KB/sec Filter 0 (8.00 KB): - Rows processed: 63.73K (63729) - Rows rejected: 1.50K (1495) - Rows total: 19.58M (19575044) Filter 5 (2.00 MB): - Rows processed: 31.91K (31910) - Rows rejected: 0 (0) - Rows total: 19.57M (19573548) Filter 6 (2.00 MB): - Rows processed: 31.91K (31910) - Rows rejected: 0 (0) - Rows total: 19.57M (19573548) Filter 7 (2.00 MB): - Rows processed: 31.91K (31910) - Rows rejected: 0 (0) - Rows total: 19.57M (19573548) Filter 8 (256.00 KB): - Rows processed: 41.55K (41547) - Rows rejected: 0 (0) - Rows total: 19.57M (19573548) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 19.11K (19114) - RowGroups rejected: 0 (0) - RowGroups total: 19.11K (19114) - Rows processed: 62.23K (62233) - Rows rejected: 0 (0) - Rows total: 19.57M (19573548) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Fragment F01: Instance 5f429df048b5534b:41bcce18000000d3 (host=foo.232.45:22000):(Total: 10m34s, non-child: 9m31s, % non-child: 90.17%) Hdfs split stats (:<# splits>/): 5:12/2.94 GB 7:13/3.07 GB 3:14/3.22 GB 6:23/5.61 GB 4:16/3.72 GB 0:19/4.65 GB 2:11/2.58 GB 1:19/4.62 GB Filter 9 arrival: 752ms Filter 0 arrival: 913ms Filter 8 arrival: 19s044ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(16s000ms): 206.94 MB, 321.49 MB, 325.17 MB, 325.17 MB, 325.17 MB, 325.17 MB, 325.15 MB, 325.11 MB, 325.10 MB, 325.21 MB, 325.12 MB, 301.78 MB, 301.19 MB, 301.27 MB, 301.32 MB, 298.33 MB, 278.19 MB, 262.75 MB, 244.78 MB, 252.41 MB, 262.19 MB, 264.68 MB, 264.77 MB, 264.63 MB, 263.73 MB, 256.78 MB, 249.25 MB, 248.75 MB, 248.70 MB, 248.82 MB, 246.27 MB, 238.28 MB, 239.76 MB, 254.71 MB, 254.66 MB, 242.96 MB, 210.78 MB, 205.26 MB, 203.51 MB ThreadUsage(16s000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.45 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 328.34 MB (344284641) - PerHostPeakMemUsage: 1.33 GB (1424343503) - RowsProduced: 29.28M (29282693) - TotalNetworkReceiveTime: 18s430ms - TotalNetworkSendTime: 9m2s - TotalStorageWaitTime: 181.254ms - TotalThreadsInvoluntaryContextSwitches: 17.38K (17381) - TotalThreadsTotalWallClockTime: 36m25s - TotalThreadsSysTime: 3s754ms - TotalThreadsUserTime: 2m15s - TotalThreadsVoluntaryContextSwitches: 59.34K (59340) Fragment Instance Lifecycle Timings: - ExecTime: 10m15s - ExecTreeExecTime: 6s955ms - OpenTime: 19s054ms - ExecTreeOpenTime: 18s530ms - PrepareTime: 43.947ms - ExecTreePrepareTime: 1.402ms DataStreamSender (dst_id=19):(Total: 36s325ms, non-child: 36s325ms, % non-child: 100.00%) - BytesSent: 3.97 GB (4261948442) - OverallThroughput: 111.89 MB/sec - PeakMemoryUsage: 7.86 MB (8245280) - RowsReturned: 29.28M (29282693) - SerializeBatchTime: 36s292ms - UncompressedRowBatchSize: 3.97 GB (4261948442) CodeGen:(Total: 553.218ms, non-child: 553.218ms, % non-child: 100.00%) - CodegenTime: 1.941ms - CompileTime: 168.493ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 354.686ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.399ms HASH_JOIN_NODE (id=9):(Total: 25s450ms, non-child: 5s630ms, % non-child: 22.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.071ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 29.28M (29282693) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s289ms - RowsReturned: 29.28M (29282693) - RowsReturnedRate: 1.15 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 209.590ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 404.674us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.534ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s258ms, non-child: 18.550ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.275ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.30 K/sec RecvrSide: BytesReceived(16s000ms): 16.29 MB, 32.86 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s028ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s244ms - DataArrivalTimer: 18s240ms SenderSide: - DeserializeRowBatchTimer: 201.476ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 6s077ms, non-child: 1s205ms, % non-child: 19.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 831.953us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 29.28M (29282693) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s125ms - RowsReturned: 29.28M (29282693) - RowsReturnedRate: 4.82 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 50.366us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 352.316us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 95.216us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 185.623ms, non-child: 17.498us, % non-child: 0.01%) - ConvertRowBatchTime: 4.922us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 490.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 185.609ms - DataArrivalTimer: 185.606ms SenderSide: - DeserializeRowBatchTimer: 96.411us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s686ms, non-child: 4s686ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:12/2.94 GB 7:13/3.07 GB 3:14/3.22 GB 6:23/5.61 GB 4:16/3.72 GB 0:19/4.65 GB 2:11/2.58 GB 1:19/4.62 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s315ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:30 BytesRead(16s000ms): 92.12 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 134.00 MB, 158.81 MB, 192.21 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 217.54 MB, 230.13 MB, 257.83 MB, 257.83 MB, 257.83 MB, 257.83 MB, 257.83 MB, 257.83 MB - FooterProcessingTime: (Avg: 690.030us ; Min: 290.897us ; Max: 1.043ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.42 - BytesRead: 257.83 MB (270357814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 257.83 MB (270357814) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 257.83 MB (270357814) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s356ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 166.08 MB (174144053) - PerReadThreadRawHdfsThroughput: 960.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.377ms - RowBatchQueuePutWaitTime: 24m21s - RowsRead: 29.29M (29285072) - RowsReturned: 29.28M (29282693) - RowsReturnedRate: 6.25 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 7.18K (7177) - ScannerThreadsTotalWallClockTime: 25m32s - MaterializeTupleTime(*): 4s820ms - ScannerThreadsSysTime: 1s058ms - ScannerThreadsUserTime: 1m5s - ScannerThreadsVoluntaryContextSwitches: 29.25K (29250) - TotalRawHdfsReadTime(*): 268.402ms - TotalReadThroughput: 417.42 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.68K (100683) - Rows rejected: 2.38K (2379) - Rows total: 29.29M (29285072) Filter 5 (2.00 MB): - Rows processed: 72.70K (72704) - Rows rejected: 0 (0) - Rows total: 29.28M (29282693) Filter 6 (2.00 MB): - Rows processed: 72.70K (72704) - Rows rejected: 0 (0) - Rows total: 29.28M (29282693) Filter 7 (2.00 MB): - Rows processed: 72.70K (72704) - Rows rejected: 0 (0) - Rows total: 29.28M (29282693) Filter 8 (256.00 KB): - Rows processed: 86.02K (86016) - Rows rejected: 0 (0) - Rows total: 29.28M (29282693) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 121 (121) - Files total: 127 (127) - RowGroups processed: 28.59K (28595) - RowGroups rejected: 0 (0) - RowGroups total: 28.59K (28595) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 29.28M (29282693) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000d2 (host=foo.232.15:22000):(Total: 9m56s, non-child: 8m57s, % non-child: 90.14%) Hdfs split stats (:<# splits>/): 1:15/3.35 GB 5:17/3.55 GB 7:19/4.34 GB 3:17/4.04 GB 0:16/3.59 GB 2:13/2.83 GB 6:16/3.64 GB 4:21/5.13 GB Filter 9 arrival: 1s149ms Filter 0 arrival: 1s460ms Filter 8 arrival: 20s165ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 218.33 MB, 336.26 MB, 340.92 MB, 340.92 MB, 340.92 MB, 342.87 MB, 395.60 MB, 395.63 MB, 395.58 MB, 395.58 MB, 395.55 MB, 385.20 MB, 363.71 MB, 363.80 MB, 363.72 MB, 363.78 MB, 363.79 MB, 363.66 MB, 363.71 MB, 345.29 MB, 331.81 MB, 331.88 MB, 331.93 MB, 330.76 MB, 323.78 MB, 323.92 MB, 323.85 MB, 306.49 MB, 284.50 MB, 229.90 MB, 221.20 MB, 218.02 MB, 213.35 MB, 213.30 MB, 206.83 MB, 205.26 MB, 184.71 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.70 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.54 MB (416847191) - PerHostPeakMemUsage: 1.42 GB (1529109992) - RowsProduced: 27.32M (27324135) - TotalNetworkReceiveTime: 20s039ms - TotalNetworkSendTime: 8m31s - TotalStorageWaitTime: 183.569ms - TotalThreadsInvoluntaryContextSwitches: 34.66K (34660) - TotalThreadsTotalWallClockTime: 46m43s - TotalThreadsSysTime: 16s525ms - TotalThreadsUserTime: 4m57s - TotalThreadsVoluntaryContextSwitches: 1.79M (1786913) Fragment Instance Lifecycle Timings: - ExecTime: 9m36s - ExecTreeExecTime: 5s845ms - OpenTime: 20s186ms - ExecTreeOpenTime: 19s724ms - PrepareTime: 45.541ms - ExecTreePrepareTime: 1.295ms DataStreamSender (dst_id=19):(Total: 32s790ms, non-child: 32s790ms, % non-child: 100.00%) - BytesSent: 3.69 GB (3966515071) - OverallThroughput: 115.36 MB/sec - PeakMemoryUsage: 7.89 MB (8269856) - RowsReturned: 27.32M (27324135) - SerializeBatchTime: 32s762ms - UncompressedRowBatchSize: 3.69 GB (3966515071) CodeGen:(Total: 485.115ms, non-child: 485.115ms, % non-child: 100.00%) - CodegenTime: 1.594ms - CompileTime: 138.662ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 321.769ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.219ms HASH_JOIN_NODE (id=9):(Total: 25s543ms, non-child: 4s879ms, % non-child: 19.10%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 312.374ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.32M (27324135) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s503ms - RowsReturned: 27.32M (27324135) - RowsReturnedRate: 1.07 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 256.227ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 1.201ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.130ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s400ms, non-child: 25.462ms, % non-child: 0.13%) - ConvertRowBatchTime: 13.333ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.81 K/sec RecvrSide: BytesReceived(16s000ms): 15.64 MB, 32.84 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s632ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s385ms - DataArrivalTimer: 19s375ms SenderSide: - DeserializeRowBatchTimer: 300.753ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s908ms, non-child: 1s033ms, % non-child: 17.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 371.121us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.32M (27324135) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 963.384ms - RowsReturned: 27.32M (27324135) - RowsReturnedRate: 4.62 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.480us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 115.564us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.179us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 653.450ms, non-child: 11.860us, % non-child: 0.00%) - ConvertRowBatchTime: 3.201us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 139.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 653.442ms - DataArrivalTimer: 653.439ms SenderSide: - DeserializeRowBatchTimer: 107.554us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s221ms, non-child: 4s221ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/3.35 GB 5:17/3.55 GB 7:19/4.34 GB 3:17/4.04 GB 0:16/3.59 GB 2:13/2.83 GB 6:16/3.64 GB 4:21/5.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s914ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:30 BytesRead(16s000ms): 100.88 MB, 146.74 MB, 146.74 MB, 146.74 MB, 146.74 MB, 148.24 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 194.93 MB, 215.40 MB, 241.72 MB, 241.72 MB, 241.72 MB, 241.72 MB, 241.72 MB, 241.72 MB, 241.72 MB - FooterProcessingTime: (Avg: 5.050ms ; Min: 566.525us ; Max: 7.257ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.70 - BytesRead: 241.72 MB (253456839) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.72 MB (253456839) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.72 MB (253456839) - CachedFileHandlesHitCount: 50 (50) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.39 MB (248920152) - PerReadThreadRawHdfsThroughput: 918.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.214ms - RowBatchQueuePutWaitTime: 32m15s - RowsRead: 27.33M (27326569) - RowsReturned: 27.32M (27324135) - RowsReturnedRate: 6.47 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 25.71K (25708) - ScannerThreadsTotalWallClockTime: 36m26s - MaterializeTupleTime(*): 4s295ms - ScannerThreadsSysTime: 14s234ms - ScannerThreadsUserTime: 3m55s - ScannerThreadsVoluntaryContextSwitches: 1.76M (1759760) - TotalRawHdfsReadTime(*): 263.285ms - TotalReadThroughput: 418.81 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.74K (100738) - Rows rejected: 2.43K (2434) - Rows total: 27.33M (27326569) Filter 5 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 27.32M (27324135) Filter 6 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 27.32M (27324135) Filter 7 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 27.32M (27324135) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 27.32M (27324135) Filter 9 (8.00 KB): - Files processed: 134 (134) - Files rejected: 128 (128) - Files total: 134 (134) - RowGroups processed: 26.68K (26683) - RowGroups rejected: 0 (0) - RowGroups total: 26.68K (26683) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 27.32M (27324135) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000b4 (host=foo.221.15:22000):(Total: 9m55s, non-child: 8m45s, % non-child: 88.21%) Hdfs split stats (:<# splits>/): 7:10/2.34 GB 6:16/3.57 GB 3:19/4.68 GB 2:17/3.96 GB 4:19/4.41 GB 1:16/3.79 GB 5:15/3.58 GB 0:17/3.98 GB Filter 0 arrival: 1s975ms Filter 9 arrival: 2s323ms Filter 8 arrival: 22s040ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 236.00 MB, 367.65 MB, 376.05 MB, 376.05 MB, 376.05 MB, 375.53 MB, 373.67 MB, 373.72 MB, 373.03 MB, 345.15 MB, 362.50 MB, 370.38 MB, 370.24 MB, 365.82 MB, 350.37 MB, 346.42 MB, 342.18 MB, 338.41 MB, 338.50 MB, 334.68 MB, 301.32 MB, 314.53 MB, 329.01 MB, 323.70 MB, 320.93 MB, 320.98 MB, 320.95 MB, 315.92 MB, 306.23 MB, 281.38 MB, 263.23 MB, 263.06 MB, 262.89 MB, 253.14 MB, 247.30 MB, 243.98 MB, 201.43 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.52 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 377.00 MB (395312197) - PerHostPeakMemUsage: 1.42 GB (1528716801) - RowsProduced: 34.97M (34965079) - TotalNetworkReceiveTime: 23s042ms - TotalNetworkSendTime: 8m12s - TotalStorageWaitTime: 166.533ms - TotalThreadsInvoluntaryContextSwitches: 26.14K (26140) - TotalThreadsTotalWallClockTime: 44m50s - TotalThreadsSysTime: 6s311ms - TotalThreadsUserTime: 3m35s - TotalThreadsVoluntaryContextSwitches: 440.98K (440978) Fragment Instance Lifecycle Timings: - ExecTime: 9m33s - ExecTreeExecTime: 7s638ms - OpenTime: 22s040ms - ExecTreeOpenTime: 21s551ms - PrepareTime: 42.392ms - ExecTreePrepareTime: 1.510ms DataStreamSender (dst_id=19):(Total: 40s494ms, non-child: 40s494ms, % non-child: 100.00%) - BytesSent: 4.75 GB (5100218127) - OverallThroughput: 120.11 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 34.97M (34965079) - SerializeBatchTime: 40s461ms - UncompressedRowBatchSize: 4.75 GB (5100218127) CodeGen:(Total: 515.508ms, non-child: 515.508ms, % non-child: 100.00%) - CodegenTime: 1.759ms - CompileTime: 155.631ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.091ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.207ms HASH_JOIN_NODE (id=9):(Total: 29s158ms, non-child: 6s278ms, % non-child: 21.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.963ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 34.97M (34965079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s902ms - RowsReturned: 34.97M (34965079) - RowsReturnedRate: 1.20 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.499ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 610.501us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.489ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s263ms, non-child: 18.314ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.789ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.73 K/sec RecvrSide: BytesReceived(16s000ms): 14.55 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s126ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s248ms - DataArrivalTimer: 21s245ms SenderSide: - DeserializeRowBatchTimer: 197.716ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 6s179ms, non-child: 1s362ms, % non-child: 22.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 373.138us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 34.97M (34965079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s269ms - RowsReturned: 34.97M (34965079) - RowsReturnedRate: 5.66 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.256us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 117.974us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.590us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s793ms, non-child: 13.049us, % non-child: 0.00%) - ConvertRowBatchTime: 4.350us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 50.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s793ms - DataArrivalTimer: 1s793ms SenderSide: - DeserializeRowBatchTimer: 56.106us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s023ms, non-child: 3s023ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:10/2.34 GB 6:16/3.57 GB 3:19/4.68 GB 2:17/3.96 GB 4:19/4.41 GB 1:16/3.79 GB 5:15/3.58 GB 0:17/3.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s753ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:35 BytesRead(16s000ms): 114.78 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 166.95 MB, 201.58 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 215.13 MB, 226.57 MB, 269.59 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB, 307.36 MB - FooterProcessingTime: (Avg: 639.643us ; Min: 337.484us ; Max: 876.024us ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.50 - BytesRead: 307.36 MB (322295479) - BytesReadDataNodeCache: 0 - BytesReadLocal: 307.36 MB (322295479) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 307.36 MB (322295479) - CachedFileHandlesHitCount: 59 (59) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s570ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 214.65 MB (225076085) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.125ms - RowBatchQueuePutWaitTime: 32m10s - RowsRead: 34.97M (34968039) - RowsReturned: 34.97M (34965079) - RowsReturnedRate: 11.56 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 14.99K (14988) - ScannerThreadsTotalWallClockTime: 34m31s - MaterializeTupleTime(*): 5s531ms - ScannerThreadsSysTime: 3s595ms - ScannerThreadsUserTime: 2m17s - ScannerThreadsVoluntaryContextSwitches: 407.99K (407989) - TotalRawHdfsReadTime(*): 263.386ms - TotalReadThroughput: 531.21 KB/sec Filter 0 (8.00 KB): - Rows processed: 117.65K (117648) - Rows rejected: 2.96K (2960) - Rows total: 34.97M (34968039) Filter 5 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 34.97M (34965079) Filter 6 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 34.97M (34965079) Filter 7 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 34.97M (34965079) Filter 8 (256.00 KB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 34.97M (34965079) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 122 (122) - Files total: 129 (129) - RowGroups processed: 34.14K (34144) - RowGroups rejected: 0 (0) - RowGroups total: 34.14K (34144) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 34.97M (34965079) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 5f429df048b5534b:41bcce1800000100 (host=foo.221.47:22000):(Total: 9m55s, non-child: 8m46s, % non-child: 88.46%) Hdfs split stats (:<# splits>/): 2:19/4.00 GB 5:18/4.46 GB 6:14/3.30 GB 7:15/3.46 GB 3:16/3.92 GB 0:20/4.91 GB 4:10/2.17 GB 1:18/4.24 GB Filter 9 arrival: 1s343ms Filter 0 arrival: 1s640ms Filter 8 arrival: 22s189ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 251.14 MB, 389.43 MB, 397.62 MB, 397.62 MB, 397.62 MB, 397.20 MB, 395.74 MB, 395.69 MB, 395.75 MB, 381.06 MB, 363.85 MB, 363.85 MB, 363.90 MB, 363.83 MB, 362.65 MB, 344.46 MB, 331.96 MB, 332.02 MB, 331.51 MB, 324.06 MB, 324.04 MB, 323.95 MB, 316.38 MB, 292.30 MB, 279.17 MB, 279.14 MB, 279.03 MB, 279.15 MB, 277.65 MB, 263.36 MB, 263.19 MB, 263.30 MB, 263.22 MB, 254.76 MB, 247.33 MB, 247.22 MB, 240.35 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.60 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 399.00 MB (418378538) - PerHostPeakMemUsage: 1.42 GB (1520540796) - RowsProduced: 32.10M (32095004) - TotalNetworkReceiveTime: 22s230ms - TotalNetworkSendTime: 8m14s - TotalStorageWaitTime: 200.919ms - TotalThreadsInvoluntaryContextSwitches: 32.55K (32555) - TotalThreadsTotalWallClockTime: 45m38s - TotalThreadsSysTime: 4s117ms - TotalThreadsUserTime: 4m51s - TotalThreadsVoluntaryContextSwitches: 128.32K (128320) Fragment Instance Lifecycle Timings: - ExecTime: 9m32s - ExecTreeExecTime: 7s411ms - OpenTime: 22s188ms - ExecTreeOpenTime: 21s709ms - PrepareTime: 46.828ms - ExecTreePrepareTime: 1.404ms DataStreamSender (dst_id=19):(Total: 39s103ms, non-child: 39s103ms, % non-child: 100.00%) - BytesSent: 4.36 GB (4685776119) - OverallThroughput: 114.28 MB/sec - PeakMemoryUsage: 7.91 MB (8294432) - RowsReturned: 32.10M (32095004) - SerializeBatchTime: 39s060ms - UncompressedRowBatchSize: 4.36 GB (4685776119) CodeGen:(Total: 507.794ms, non-child: 507.794ms, % non-child: 100.00%) - CodegenTime: 1.599ms - CompileTime: 135.119ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 342.266ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.946ms HASH_JOIN_NODE (id=9):(Total: 29s085ms, non-child: 6s056ms, % non-child: 20.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 274.367ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 32.10M (32095004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s680ms - RowsReturned: 32.10M (32095004) - RowsReturnedRate: 1.10 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.025ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 602.757us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.248ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s423ms, non-child: 19.463ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.474ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.56 K/sec RecvrSide: BytesReceived(16s000ms): 14.96 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s799ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s408ms - DataArrivalTimer: 21s404ms SenderSide: - DeserializeRowBatchTimer: 185.284ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 6s178ms, non-child: 1s232ms, % non-child: 19.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 541.395us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 32.10M (32095004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s146ms - RowsReturned: 32.10M (32095004) - RowsReturnedRate: 5.19 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 74.437us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 145.572us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.607us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 821.751ms, non-child: 12.331us, % non-child: 0.00%) - ConvertRowBatchTime: 3.421us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 110.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 821.742ms - DataArrivalTimer: 821.739ms SenderSide: - DeserializeRowBatchTimer: 74.161us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s124ms, non-child: 4s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:19/4.00 GB 5:18/4.46 GB 6:14/3.30 GB 7:15/3.46 GB 3:16/3.92 GB 0:20/4.91 GB 4:10/2.17 GB 1:18/4.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s733ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:30 BytesRead(16s000ms): 131.32 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 191.02 MB, 224.01 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB, 287.14 MB - FooterProcessingTime: (Avg: 586.451us ; Min: 139.766us ; Max: 885.352us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.58 - BytesRead: 287.14 MB (301086375) - BytesReadDataNodeCache: 0 - BytesReadLocal: 287.14 MB (301086375) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 287.14 MB (301086375) - CachedFileHandlesHitCount: 53 (53) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s481ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 236.66 MB (248158661) - PerReadThreadRawHdfsThroughput: 896.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.070ms - RowBatchQueuePutWaitTime: 31m43s - RowsRead: 32.10M (32097382) - RowsReturned: 32.10M (32095004) - RowsReturnedRate: 7.78 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 21.68K (21678) - ScannerThreadsTotalWallClockTime: 35m20s - MaterializeTupleTime(*): 5s178ms - ScannerThreadsSysTime: 1s304ms - ScannerThreadsUserTime: 3m36s - ScannerThreadsVoluntaryContextSwitches: 96.42K (96423) - TotalRawHdfsReadTime(*): 320.159ms - TotalReadThroughput: 495.42 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.68K (100682) - Rows rejected: 2.38K (2378) - Rows total: 32.10M (32097382) Filter 5 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 32.10M (32095004) Filter 6 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 32.10M (32095004) Filter 7 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 32.10M (32095004) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 32.10M (32095004) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 124 (124) - Files total: 130 (130) - RowGroups processed: 31.34K (31341) - RowGroups rejected: 0 (0) - RowGroups total: 31.34K (31341) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 32.10M (32095004) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000ba (host=foo.221.49:22000):(Total: 9m13s, non-child: 8m7s, % non-child: 88.16%) Hdfs split stats (:<# splits>/): 0:10/2.48 GB 2:18/4.38 GB 1:17/4.21 GB 3:16/3.73 GB 6:11/2.72 GB 4:18/4.10 GB 5:16/3.96 GB 7:20/4.95 GB Filter 9 arrival: 1s306ms Filter 0 arrival: 1s605ms Filter 8 arrival: 19s965ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 242.35 MB, 387.87 MB, 392.32 MB, 392.32 MB, 392.32 MB, 392.78 MB, 393.74 MB, 393.74 MB, 386.77 MB, 361.82 MB, 361.83 MB, 361.92 MB, 361.90 MB, 352.18 MB, 329.95 MB, 329.92 MB, 329.98 MB, 329.92 MB, 329.84 MB, 323.20 MB, 319.37 MB, 288.70 MB, 279.09 MB, 279.12 MB, 279.17 MB, 270.22 MB, 263.20 MB, 263.06 MB, 263.07 MB, 263.13 MB, 249.46 MB, 247.22 MB, 247.27 MB, 247.20 MB ThreadUsage(16s000ms): 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.59 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.96 MB (416244865) - PerHostPeakMemUsage: 1.39 GB (1493206787) - RowsProduced: 32.57M (32566814) - TotalNetworkReceiveTime: 19s953ms - TotalNetworkSendTime: 7m37s - TotalStorageWaitTime: 144.973ms - TotalThreadsInvoluntaryContextSwitches: 32.65K (32650) - TotalThreadsTotalWallClockTime: 42m19s - TotalThreadsSysTime: 4s725ms - TotalThreadsUserTime: 4m45s - TotalThreadsVoluntaryContextSwitches: 134.17K (134174) Fragment Instance Lifecycle Timings: - ExecTime: 8m53s - ExecTreeExecTime: 7s050ms - OpenTime: 19s973ms - ExecTreeOpenTime: 19s486ms - PrepareTime: 42.157ms - ExecTreePrepareTime: 1.232ms DataStreamSender (dst_id=19):(Total: 38s442ms, non-child: 38s442ms, % non-child: 100.00%) - BytesSent: 4.43 GB (4753487951) - OverallThroughput: 117.92 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 32.57M (32566814) - SerializeBatchTime: 38s407ms - UncompressedRowBatchSize: 4.43 GB (4753487951) CodeGen:(Total: 514.549ms, non-child: 514.549ms, % non-child: 100.00%) - CodegenTime: 1.671ms - CompileTime: 155.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 329.761ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.507ms HASH_JOIN_NODE (id=9):(Total: 26s503ms, non-child: 5s726ms, % non-child: 21.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 284.494ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 32.57M (32566814) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s345ms - RowsReturned: 32.57M (32566814) - RowsReturnedRate: 1.23 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 236.160ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 1.140ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.126ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s188ms, non-child: 17.803ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.052ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.08 K/sec RecvrSide: BytesReceived(16s000ms): 14.63 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s757ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s174ms - DataArrivalTimer: 19s171ms SenderSide: - DeserializeRowBatchTimer: 182.155ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 6s178ms, non-child: 1s332ms, % non-child: 21.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 456.408us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 32.57M (32566814) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s250ms - RowsReturned: 32.57M (32566814) - RowsReturnedRate: 5.27 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.043us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 115.132us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 86.355us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 779.114ms, non-child: 12.034us, % non-child: 0.00%) - ConvertRowBatchTime: 3.321us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 116.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 779.105ms - DataArrivalTimer: 779.102ms SenderSide: - DeserializeRowBatchTimer: 98.854us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s067ms, non-child: 4s067ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.48 GB 2:18/4.38 GB 1:17/4.21 GB 3:16/3.73 GB 6:11/2.72 GB 4:18/4.10 GB 5:16/3.96 GB 7:20/4.95 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s772ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:120 PARQUET/SNAPPY:30 BytesRead(16s000ms): 124.90 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 190.33 MB, 266.82 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB, 284.20 MB - FooterProcessingTime: (Avg: 474.288us ; Min: 151.178us ; Max: 877.872us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.57 - BytesRead: 284.20 MB (298002489) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.20 MB (298002489) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.20 MB (298002489) - CachedFileHandlesHitCount: 50 (50) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s478ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.66 MB (246055158) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 57.040ms - RowBatchQueuePutWaitTime: 29m6s - RowsRead: 32.57M (32569112) - RowsReturned: 32.57M (32566814) - RowsReturnedRate: 8.01 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 22.30K (22301) - ScannerThreadsTotalWallClockTime: 32m45s - MaterializeTupleTime(*): 5s221ms - ScannerThreadsSysTime: 2s210ms - ScannerThreadsUserTime: 3m32s - ScannerThreadsVoluntaryContextSwitches: 105.59K (105588) - TotalRawHdfsReadTime(*): 246.690ms - TotalReadThroughput: 527.68 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.60K (100602) - Rows rejected: 2.30K (2298) - Rows total: 32.57M (32569112) Filter 5 (2.00 MB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 32.57M (32566814) Filter 6 (2.00 MB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 32.57M (32566814) Filter 7 (2.00 MB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 32.57M (32566814) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 32.57M (32566814) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 120 (120) - Files total: 126 (126) - RowGroups processed: 31.80K (31803) - RowGroups rejected: 0 (0) - RowGroups total: 31.80K (31803) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 32.57M (32566814) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000a8 (host=foo.221.41:22000):(Total: 9m8s, non-child: 8m2s, % non-child: 87.92%) Hdfs split stats (:<# splits>/): 2:14/3.29 GB 6:23/5.40 GB 0:8/1.98 GB 4:15/3.68 GB 1:18/4.43 GB 5:14/3.47 GB 3:18/4.07 GB 7:18/3.93 GB Filter 0 arrival: 1s714ms Filter 9 arrival: 1s825ms Filter 8 arrival: 22s359ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 239.07 MB, 371.51 MB, 380.68 MB, 380.68 MB, 380.68 MB, 380.08 MB, 378.23 MB, 378.21 MB, 378.25 MB, 362.01 MB, 346.33 MB, 346.35 MB, 346.35 MB, 353.96 MB, 363.91 MB, 346.47 MB, 346.51 MB, 346.53 MB, 346.49 MB, 345.56 MB, 338.47 MB, 316.15 MB, 291.82 MB, 270.64 MB, 270.65 MB, 270.67 MB, 265.50 MB, 257.27 MB, 254.80 MB, 254.76 MB, 254.74 MB, 230.38 MB, 205.30 MB, 205.23 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.61 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.55 MB (400088121) - PerHostPeakMemUsage: 1.43 GB (1531852975) - RowsProduced: 31.03M (31030670) - TotalNetworkReceiveTime: 22s835ms - TotalNetworkSendTime: 7m33s - TotalStorageWaitTime: 184.768ms - TotalThreadsInvoluntaryContextSwitches: 33.03K (33033) - TotalThreadsTotalWallClockTime: 42m10s - TotalThreadsSysTime: 9s540ms - TotalThreadsUserTime: 4m49s - TotalThreadsVoluntaryContextSwitches: 613.04K (613040) Fragment Instance Lifecycle Timings: - ExecTime: 8m46s - ExecTreeExecTime: 6s648ms - OpenTime: 22s367ms - ExecTreeOpenTime: 21s854ms - PrepareTime: 46.331ms - ExecTreePrepareTime: 1.277ms DataStreamSender (dst_id=19):(Total: 37s280ms, non-child: 37s280ms, % non-child: 100.00%) - BytesSent: 4.22 GB (4527238571) - OverallThroughput: 115.81 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 31.03M (31030670) - SerializeBatchTime: 37s249ms - UncompressedRowBatchSize: 4.22 GB (4527238571) CodeGen:(Total: 540.427ms, non-child: 540.427ms, % non-child: 100.00%) - CodegenTime: 1.768ms - CompileTime: 149.663ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 362.489ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.702ms HASH_JOIN_NODE (id=9):(Total: 28s470ms, non-child: 5s478ms, % non-child: 19.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 262.674ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 31.03M (31030670) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s120ms - RowsReturned: 31.03M (31030670) - RowsReturnedRate: 1.09 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 212.483ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 444.537us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.358ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s580ms, non-child: 17.398ms, % non-child: 0.08%) - ConvertRowBatchTime: 13.083ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.41 K/sec RecvrSide: BytesReceived(16s000ms): 14.68 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s837ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s566ms - DataArrivalTimer: 21s563ms SenderSide: - DeserializeRowBatchTimer: 169.030ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s959ms, non-child: 1s166ms, % non-child: 19.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 666.128us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 31.03M (31030670) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s086ms - RowsReturned: 31.03M (31030670) - RowsReturnedRate: 5.21 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.000us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 181.031us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.673us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s269ms, non-child: 12.609us, % non-child: 0.00%) - ConvertRowBatchTime: 3.307us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 71.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s269ms - DataArrivalTimer: 1s269ms SenderSide: - DeserializeRowBatchTimer: 31.729us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s523ms, non-child: 3s523ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/3.29 GB 6:23/5.40 GB 0:8/1.98 GB 4:15/3.68 GB 1:18/4.43 GB 5:14/3.47 GB 3:18/4.07 GB 7:18/3.93 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s250ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:30 BytesRead(16s000ms): 118.67 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 172.61 MB, 187.23 MB, 219.38 MB, 219.38 MB, 219.38 MB, 219.38 MB, 219.38 MB, 219.38 MB, 219.38 MB, 219.38 MB, 228.23 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB, 266.61 MB - FooterProcessingTime: (Avg: 610.844us ; Min: 353.791us ; Max: 925.284us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.58 - BytesRead: 266.61 MB (279557675) - BytesReadDataNodeCache: 0 - BytesReadLocal: 266.61 MB (279557675) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 266.61 MB (279557675) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s387ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.15 MB (229793780) - PerReadThreadRawHdfsThroughput: 922.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.219ms - RowBatchQueuePutWaitTime: 28m51s - RowsRead: 31.03M (31033051) - RowsReturned: 31.03M (31030670) - RowsReturnedRate: 8.81 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 22.98K (22976) - ScannerThreadsTotalWallClockTime: 32m38s - MaterializeTupleTime(*): 5s022ms - ScannerThreadsSysTime: 6s862ms - ScannerThreadsUserTime: 3m39s - ScannerThreadsVoluntaryContextSwitches: 584.36K (584360) - TotalRawHdfsReadTime(*): 288.964ms - TotalReadThroughput: 498.64 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.69K (100685) - Rows rejected: 2.38K (2381) - Rows total: 31.03M (31033051) Filter 5 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 31.03M (31030670) Filter 6 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 31.03M (31030670) Filter 7 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 31.03M (31030670) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 31.03M (31030670) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 122 (122) - Files total: 128 (128) - RowGroups processed: 30.30K (30303) - RowGroups rejected: 0 (0) - RowGroups total: 30.30K (30303) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 31.03M (31030670) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce180000010d (host=foo.232.43:22000):(Total: 8m59s, non-child: 8m2s, % non-child: 89.27%) Hdfs split stats (:<# splits>/): 3:13/3.13 GB 5:14/3.34 GB 0:18/4.38 GB 6:20/4.77 GB 7:13/3.17 GB 4:15/3.53 GB 2:15/3.33 GB 1:19/4.49 GB Filter 9 arrival: 504ms Filter 0 arrival: 762ms Filter 8 arrival: 21s183ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(16s000ms): 246.49 MB, 372.54 MB, 380.23 MB, 380.23 MB, 380.23 MB, 379.67 MB, 377.91 MB, 378.01 MB, 377.94 MB, 377.98 MB, 377.99 MB, 360.29 MB, 346.14 MB, 346.15 MB, 346.04 MB, 346.13 MB, 346.09 MB, 346.07 MB, 345.70 MB, 304.56 MB, 288.60 MB, 288.60 MB, 288.67 MB, 288.67 MB, 278.83 MB, 239.36 MB, 221.70 MB, 221.70 MB, 213.74 MB, 213.75 MB, 210.48 MB, 205.86 MB, 205.89 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 4.30 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.16 MB (399673193) - PerHostPeakMemUsage: 1.43 GB (1530522299) - RowsProduced: 25.43M (25429141) - TotalNetworkReceiveTime: 20s440ms - TotalNetworkSendTime: 7m35s - TotalStorageWaitTime: 154.345ms - TotalThreadsInvoluntaryContextSwitches: 21.61K (21607) - TotalThreadsTotalWallClockTime: 38m39s - TotalThreadsSysTime: 2s837ms - TotalThreadsUserTime: 3m6s - TotalThreadsVoluntaryContextSwitches: 49.46K (49459) Fragment Instance Lifecycle Timings: - ExecTime: 8m38s - ExecTreeExecTime: 5s700ms - OpenTime: 21s190ms - ExecTreeOpenTime: 20s725ms - PrepareTime: 47.406ms - ExecTreePrepareTime: 1.221ms DataStreamSender (dst_id=19):(Total: 31s020ms, non-child: 31s020ms, % non-child: 100.00%) - BytesSent: 3.45 GB (3706164640) - OverallThroughput: 113.94 MB/sec - PeakMemoryUsage: 7.87 MB (8253472) - RowsReturned: 25.43M (25429141) - SerializeBatchTime: 30s985ms - UncompressedRowBatchSize: 3.45 GB (3706164640) CodeGen:(Total: 492.435ms, non-child: 492.435ms, % non-child: 100.00%) - CodegenTime: 1.737ms - CompileTime: 162.202ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 302.613ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.134ms HASH_JOIN_NODE (id=9):(Total: 26s397ms, non-child: 4s716ms, % non-child: 17.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 260.111ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 25.43M (25429141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s397ms - RowsReturned: 25.43M (25429141) - RowsReturnedRate: 963.30 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.234ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 694.619us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.850ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s454ms, non-child: 17.528ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.551ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.59 K/sec RecvrSide: BytesReceived(16s000ms): 16.49 MB, 32.86 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s931ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s439ms - DataArrivalTimer: 20s436ms SenderSide: - DeserializeRowBatchTimer: 173.255ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s786ms, non-child: 1s003ms, % non-child: 17.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 332.472us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 25.43M (25429141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 939.367ms - RowsReturned: 25.43M (25429141) - RowsReturnedRate: 4.39 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 21.927us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.059us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.041us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 21.995us, non-child: 21.995us, % non-child: 100.00%) - ConvertRowBatchTime: 3.431us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 4.14 M/sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.973us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 172.808us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s783ms, non-child: 4s783ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/3.13 GB 5:14/3.34 GB 0:18/4.38 GB 6:20/4.77 GB 7:13/3.17 GB 4:15/3.53 GB 2:15/3.33 GB 1:19/4.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s558ms Hdfs Read Thread Concurrency Bucket: 0:99.91% 1:0.09372% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:25 BytesRead(16s000ms): 119.93 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 175.79 MB, 197.42 MB, 221.94 MB, 221.94 MB, 221.94 MB, 221.94 MB, 221.94 MB, 221.94 MB, 221.94 MB - FooterProcessingTime: (Avg: 677.444us ; Min: 365.816us ; Max: 1.264ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.30 - BytesRead: 221.94 MB (232723710) - BytesReadDataNodeCache: 0 - BytesReadLocal: 221.94 MB (232723710) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 221.94 MB (232723710) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s154ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 218.90 MB (229528061) - PerReadThreadRawHdfsThroughput: 1000.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.659ms - RowBatchQueuePutWaitTime: 27m6s - RowsRead: 25.43M (25431136) - RowsReturned: 25.43M (25429141) - RowsReturnedRate: 5.32 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 12.99K (12994) - ScannerThreadsTotalWallClockTime: 29m19s - MaterializeTupleTime(*): 4s134ms - ScannerThreadsSysTime: 602.906ms - ScannerThreadsUserTime: 2m7s - ScannerThreadsVoluntaryContextSwitches: 25.34K (25339) - TotalRawHdfsReadTime(*): 221.929ms - TotalReadThroughput: 425.60 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.92K (83915) - Rows rejected: 2.00K (1995) - Rows total: 25.43M (25431136) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 25.43M (25429141) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 25.43M (25429141) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 25.43M (25429141) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 25.43M (25429141) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 122 (122) - Files total: 127 (127) - RowGroups processed: 24.83K (24832) - RowGroups rejected: 0 (0) - RowGroups total: 24.83K (24832) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 25.43M (25429141) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000e9 (host=foo.232.11:22000):(Total: 8m57s, non-child: 8m1s, % non-child: 89.52%) Hdfs split stats (:<# splits>/): 0:13/3.22 GB 3:18/4.13 GB 7:14/3.33 GB 1:17/3.99 GB 5:16/3.61 GB 6:17/4.17 GB 2:17/4.17 GB 4:16/3.74 GB Filter 9 arrival: 1s273ms Filter 0 arrival: 1s570ms Filter 8 arrival: 21s393ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 233.65 MB, 364.23 MB, 371.54 MB, 371.54 MB, 371.54 MB, 371.23 MB, 370.39 MB, 370.30 MB, 370.33 MB, 370.36 MB, 370.38 MB, 348.74 MB, 338.50 MB, 338.43 MB, 338.40 MB, 338.49 MB, 338.53 MB, 338.32 MB, 332.85 MB, 286.34 MB, 280.32 MB, 280.32 MB, 289.60 MB, 304.33 MB, 303.58 MB, 295.22 MB, 227.57 MB, 217.35 MB, 212.90 MB, 212.97 MB, 208.36 MB, 204.91 MB, 204.91 MB ThreadUsage(16s000ms): 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.56 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 373.69 MB (391845858) - PerHostPeakMemUsage: 1.40 GB (1507459617) - RowsProduced: 24.61M (24609617) - TotalNetworkReceiveTime: 21s381ms - TotalNetworkSendTime: 7m37s - TotalStorageWaitTime: 151.692ms - TotalThreadsInvoluntaryContextSwitches: 31.90K (31898) - TotalThreadsTotalWallClockTime: 40m50s - TotalThreadsSysTime: 11s246ms - TotalThreadsUserTime: 4m35s - TotalThreadsVoluntaryContextSwitches: 1.27M (1274876) Fragment Instance Lifecycle Timings: - ExecTime: 8m36s - ExecTreeExecTime: 5s407ms - OpenTime: 21s401ms - ExecTreeOpenTime: 20s927ms - PrepareTime: 38.562ms - ExecTreePrepareTime: 1.362ms DataStreamSender (dst_id=19):(Total: 29s536ms, non-child: 29s536ms, % non-child: 100.00%) - BytesSent: 3.34 GB (3587778696) - OverallThroughput: 115.84 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 24.61M (24609617) - SerializeBatchTime: 29s504ms - UncompressedRowBatchSize: 3.34 GB (3587778696) CodeGen:(Total: 495.059ms, non-child: 495.059ms, % non-child: 100.00%) - CodegenTime: 1.898ms - CompileTime: 145.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 326.615ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.278ms HASH_JOIN_NODE (id=9):(Total: 26s308ms, non-child: 4s489ms, % non-child: 17.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 283.015ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 24.61M (24609617) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s134ms - RowsReturned: 24.61M (24609617) - RowsReturnedRate: 935.41 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 239.318ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 459.070us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.841ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s633ms, non-child: 19.215ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.749ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.39 K/sec RecvrSide: BytesReceived(16s000ms): 15.39 MB, 32.83 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s737ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s617ms - DataArrivalTimer: 20s614ms SenderSide: - DeserializeRowBatchTimer: 278.772ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s864ms, non-child: 985.651ms, % non-child: 16.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 517.272us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 24.61M (24609617) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 920.077ms - RowsReturned: 24.61M (24609617) - RowsReturnedRate: 4.20 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 58.849us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 137.064us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.874us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 763.595ms, non-child: 18.783us, % non-child: 0.00%) - ConvertRowBatchTime: 5.743us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 119.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 763.581ms - DataArrivalTimer: 763.577ms SenderSide: - DeserializeRowBatchTimer: 81.183us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s115ms, non-child: 4s115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/3.22 GB 3:18/4.13 GB 7:14/3.33 GB 1:17/3.99 GB 5:16/3.61 GB 6:17/4.17 GB 2:17/4.17 GB 4:16/3.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s792ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:25 BytesRead(16s000ms): 119.65 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 174.04 MB, 195.98 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB, 220.85 MB - FooterProcessingTime: (Avg: 449.986us ; Min: 317.986us ; Max: 640.019us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.56 - BytesRead: 220.85 MB (231577797) - BytesReadDataNodeCache: 0 - BytesReadLocal: 220.85 MB (231577797) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 220.85 MB (231577797) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s140ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 211.26 MB (221523570) - PerReadThreadRawHdfsThroughput: 762.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.261ms - RowBatchQueuePutWaitTime: 27m25s - RowsRead: 24.61M (24611610) - RowsReturned: 24.61M (24609617) - RowsReturnedRate: 5.98 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 23.64K (23643) - ScannerThreadsTotalWallClockTime: 31m31s - MaterializeTupleTime(*): 3s998ms - ScannerThreadsSysTime: 9s194ms - ScannerThreadsUserTime: 3m39s - ScannerThreadsVoluntaryContextSwitches: 1.25M (1251011) - TotalRawHdfsReadTime(*): 289.783ms - TotalReadThroughput: 425.09 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.91K (83913) - Rows rejected: 1.99K (1993) - Rows total: 24.61M (24611610) Filter 5 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 24.61M (24609617) Filter 6 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 24.61M (24609617) Filter 7 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 24.61M (24609617) Filter 8 (256.00 KB): - Rows processed: 78.85K (78848) - Rows rejected: 0 (0) - Rows total: 24.61M (24609617) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 123 (123) - Files total: 128 (128) - RowGroups processed: 24.03K (24031) - RowGroups rejected: 0 (0) - RowGroups total: 24.03K (24031) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 24.61M (24609617) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000be (host=foo.232.34:22000):(Total: 8m53s, non-child: 7m54s, % non-child: 88.85%) Hdfs split stats (:<# splits>/): 6:15/3.55 GB 5:12/2.97 GB 4:17/3.77 GB 0:21/4.96 GB 1:18/4.41 GB 2:15/3.29 GB 7:18/4.00 GB 3:14/3.39 GB Filter 0 arrival: 1s106ms Filter 9 arrival: 1s867ms Filter 8 arrival: 21s542ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 251.00 MB, 387.92 MB, 395.51 MB, 395.51 MB, 395.51 MB, 394.97 MB, 393.63 MB, 393.68 MB, 393.63 MB, 392.45 MB, 368.15 MB, 361.92 MB, 361.89 MB, 361.85 MB, 361.86 MB, 361.86 MB, 357.34 MB, 341.33 MB, 330.16 MB, 330.17 MB, 330.12 MB, 330.24 MB, 330.17 MB, 330.27 MB, 310.10 MB, 306.51 MB, 243.49 MB, 223.47 MB, 219.20 MB, 215.59 MB, 215.30 MB, 204.93 MB, 195.38 MB ThreadUsage(16s000ms): 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.72 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.08 MB (416371089) - PerHostPeakMemUsage: 1.42 GB (1529787983) - RowsProduced: 27.11M (27110370) - TotalNetworkReceiveTime: 22s135ms - TotalNetworkSendTime: 7m28s - TotalStorageWaitTime: 234.593ms - TotalThreadsInvoluntaryContextSwitches: 31.69K (31686) - TotalThreadsTotalWallClockTime: 41m56s - TotalThreadsSysTime: 28s468ms - TotalThreadsUserTime: 4m10s - TotalThreadsVoluntaryContextSwitches: 2.24M (2237762) Fragment Instance Lifecycle Timings: - ExecTime: 8m31s - ExecTreeExecTime: 5s779ms - OpenTime: 21s543ms - ExecTreeOpenTime: 21s079ms - PrepareTime: 49.599ms - ExecTreePrepareTime: 1.902ms DataStreamSender (dst_id=19):(Total: 32s147ms, non-child: 32s147ms, % non-child: 100.00%) - BytesSent: 3.68 GB (3949426610) - OverallThroughput: 117.16 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 27.11M (27110370) - SerializeBatchTime: 32s120ms - UncompressedRowBatchSize: 3.68 GB (3949426610) CodeGen:(Total: 492.792ms, non-child: 492.792ms, % non-child: 100.00%) - CodegenTime: 1.677ms - CompileTime: 155.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 307.695ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.560ms HASH_JOIN_NODE (id=9):(Total: 26s833ms, non-child: 4s700ms, % non-child: 17.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 276.369ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 27.11M (27110370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s353ms - RowsReturned: 27.11M (27110370) - RowsReturnedRate: 1.01 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.962ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 470.718us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.351ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s790ms, non-child: 18.185ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.412ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.22 K/sec RecvrSide: BytesReceived(16s000ms): 15.86 MB, 32.84 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s310ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s774ms - DataArrivalTimer: 20s772ms SenderSide: - DeserializeRowBatchTimer: 183.509ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s909ms, non-child: 1s025ms, % non-child: 17.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 474.630us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.11M (27110370) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 955.742ms - RowsReturned: 27.11M (27110370) - RowsReturnedRate: 4.59 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.277us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 126.197us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.645us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s360ms, non-child: 14.303us, % non-child: 0.00%) - ConvertRowBatchTime: 3.608us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 66.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s360ms - DataArrivalTimer: 1s360ms SenderSide: - DeserializeRowBatchTimer: 89.670us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s523ms, non-child: 3s523ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:15/3.55 GB 5:12/2.97 GB 4:17/3.77 GB 0:21/4.96 GB 1:18/4.41 GB 2:15/3.29 GB 7:18/4.00 GB 3:14/3.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s191ms Hdfs Read Thread Concurrency Bucket: 0:99.91% 1:0.09443% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:25 BytesRead(16s000ms): 127.30 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 189.33 MB, 205.19 MB, 240.09 MB, 240.09 MB, 240.09 MB, 240.09 MB, 240.09 MB, 240.09 MB, 240.09 MB, 240.09 MB - FooterProcessingTime: (Avg: 773.351us ; Min: 378.165us ; Max: 1.084ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.70 - BytesRead: 240.09 MB (251750406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.09 MB (251750406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.09 MB (251750406) - CachedFileHandlesHitCount: 46 (46) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s223ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.67 MB (246064877) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.604ms - RowBatchQueuePutWaitTime: 28m55s - RowsRead: 27.11M (27112338) - RowsReturned: 27.11M (27110370) - RowsReturnedRate: 7.69 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 22.89K (22892) - ScannerThreadsTotalWallClockTime: 32m40s - MaterializeTupleTime(*): 4s352ms - ScannerThreadsSysTime: 26s227ms - ScannerThreadsUserTime: 3m10s - ScannerThreadsVoluntaryContextSwitches: 2.21M (2211592) - TotalRawHdfsReadTime(*): 209.396ms - TotalReadThroughput: 463.87 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.89K (83888) - Rows rejected: 1.97K (1968) - Rows total: 27.11M (27112338) Filter 5 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.11M (27110370) Filter 6 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.11M (27110370) Filter 7 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.11M (27110370) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 27.11M (27110370) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 125 (125) - Files total: 130 (130) - RowGroups processed: 26.48K (26475) - RowGroups rejected: 0 (0) - RowGroups total: 26.48K (26475) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.11M (27110370) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000c0 (host=foo.232.49:22000):(Total: 8m44s, non-child: 7m43s, % non-child: 88.33%) Hdfs split stats (:<# splits>/): 0:18/4.28 GB 7:15/3.51 GB 6:20/4.65 GB 2:17/4.21 GB 3:10/2.48 GB 4:11/2.55 GB 1:19/4.71 GB 5:17/3.83 GB Filter 9 arrival: 587ms Filter 0 arrival: 896ms Filter 8 arrival: 21s107ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(16s000ms): 246.81 MB, 388.36 MB, 396.03 MB, 396.03 MB, 396.03 MB, 395.40 MB, 393.78 MB, 393.72 MB, 393.79 MB, 392.05 MB, 362.20 MB, 361.93 MB, 361.84 MB, 361.84 MB, 361.95 MB, 361.87 MB, 346.67 MB, 329.97 MB, 329.99 MB, 329.99 MB, 329.93 MB, 329.95 MB, 329.94 MB, 328.07 MB, 262.94 MB, 221.86 MB, 221.16 MB, 213.92 MB, 213.79 MB, 212.30 MB, 205.89 MB, 205.86 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 4.46 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.15 MB (416445671) - PerHostPeakMemUsage: 1.41 GB (1511109593) - RowsProduced: 27.58M (27578418) - TotalNetworkReceiveTime: 20s407ms - TotalNetworkSendTime: 7m15s - TotalStorageWaitTime: 197.625ms - TotalThreadsInvoluntaryContextSwitches: 22.37K (22367) - TotalThreadsTotalWallClockTime: 38m58s - TotalThreadsSysTime: 3s040ms - TotalThreadsUserTime: 3m12s - TotalThreadsVoluntaryContextSwitches: 53.90K (53897) Fragment Instance Lifecycle Timings: - ExecTime: 8m23s - ExecTreeExecTime: 6s208ms - OpenTime: 21s103ms - ExecTreeOpenTime: 20s638ms - PrepareTime: 55.887ms - ExecTreePrepareTime: 1.271ms DataStreamSender (dst_id=19):(Total: 33s902ms, non-child: 33s902ms, % non-child: 100.00%) - BytesSent: 3.74 GB (4019369827) - OverallThroughput: 113.06 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 27.58M (27578418) - SerializeBatchTime: 33s872ms - UncompressedRowBatchSize: 3.74 GB (4019369827) CodeGen:(Total: 497.979ms, non-child: 497.979ms, % non-child: 100.00%) - CodegenTime: 3.361ms - CompileTime: 149.220ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 314.088ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 33.953ms HASH_JOIN_NODE (id=9):(Total: 26s818ms, non-child: 5s152ms, % non-child: 19.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 278.835ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.58M (27578418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s800ms - RowsReturned: 27.58M (27578418) - RowsReturnedRate: 1.03 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 234.871ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 426.263us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.106ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s347ms, non-child: 18.362ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.297ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.70 K/sec RecvrSide: BytesReceived(16s000ms): 16.19 MB, 32.85 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s055ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s332ms - DataArrivalTimer: 20s329ms SenderSide: - DeserializeRowBatchTimer: 182.616ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s880ms, non-child: 1s078ms, % non-child: 18.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 373.772us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 27.58M (27578418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s010ms - RowsReturned: 27.58M (27578418) - RowsReturnedRate: 4.69 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.616us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 121.993us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 35.233us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 74.995ms, non-child: 12.559us, % non-child: 0.02%) - ConvertRowBatchTime: 4.022us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 1.21 K/sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 74.986ms - DataArrivalTimer: 74.983ms SenderSide: - DeserializeRowBatchTimer: 108.363us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s726ms, non-child: 4s726ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.28 GB 7:15/3.51 GB 6:20/4.65 GB 2:17/4.21 GB 3:10/2.48 GB 4:11/2.55 GB 1:19/4.71 GB 5:17/3.83 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s477ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:25 BytesRead(16s000ms): 124.20 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 189.26 MB, 210.99 MB, 235.61 MB, 235.61 MB, 235.61 MB, 235.61 MB, 235.61 MB, 235.61 MB, 235.61 MB - FooterProcessingTime: (Avg: 633.431us ; Min: 414.725us ; Max: 820.391us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.46 - BytesRead: 235.61 MB (247057439) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.61 MB (247057439) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.61 MB (247057439) - CachedFileHandlesHitCount: 44 (44) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.69 MB (246091114) - PerReadThreadRawHdfsThroughput: 930.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.280ms - RowBatchQueuePutWaitTime: 27m42s - RowsRead: 27.58M (27580334) - RowsReturned: 27.58M (27578418) - RowsReturnedRate: 5.83 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 13.10K (13095) - ScannerThreadsTotalWallClockTime: 29m53s - MaterializeTupleTime(*): 4s464ms - ScannerThreadsSysTime: 677.894ms - ScannerThreadsUserTime: 2m8s - ScannerThreadsVoluntaryContextSwitches: 27.31K (27310) - TotalRawHdfsReadTime(*): 253.308ms - TotalReadThroughput: 465.32 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.84K (83836) - Rows rejected: 1.92K (1916) - Rows total: 27.58M (27580334) Filter 5 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.58M (27578418) Filter 6 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.58M (27578418) Filter 7 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.58M (27578418) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 27.58M (27578418) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 122 (122) - Files total: 127 (127) - RowGroups processed: 26.93K (26933) - RowGroups rejected: 0 (0) - RowGroups total: 26.93K (26933) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.58M (27578418) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000c9 (host=foo.221.34:22000):(Total: 8m40s, non-child: 7m40s, % non-child: 88.44%) Hdfs split stats (:<# splits>/): 2:10/2.24 GB 6:21/5.20 GB 7:23/5.18 GB 0:16/3.80 GB 3:18/4.35 GB 4:15/3.64 GB 1:10/1.96 GB 5:16/3.82 GB Filter 0 arrival: 1s752ms Filter 9 arrival: 2s718ms Filter 8 arrival: 21s786ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(16s000ms): 249.65 MB, 388.09 MB, 396.62 MB, 396.62 MB, 396.62 MB, 396.04 MB, 393.93 MB, 393.93 MB, 393.99 MB, 385.05 MB, 362.10 MB, 362.11 MB, 362.13 MB, 362.14 MB, 362.22 MB, 353.56 MB, 332.20 MB, 330.07 MB, 330.13 MB, 330.11 MB, 330.27 MB, 330.13 MB, 330.07 MB, 330.17 MB, 304.57 MB, 248.63 MB, 221.25 MB, 218.69 MB, 213.30 MB, 213.23 MB, 205.60 MB, 205.17 MB ThreadUsage(16s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.73 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.27 MB (416572964) - PerHostPeakMemUsage: 1.40 GB (1500830944) - RowsProduced: 27.32M (27321130) - TotalNetworkReceiveTime: 23s196ms - TotalNetworkSendTime: 7m13s - TotalStorageWaitTime: 211.912ms - TotalThreadsInvoluntaryContextSwitches: 32.51K (32506) - TotalThreadsTotalWallClockTime: 40m59s - TotalThreadsSysTime: 16s824ms - TotalThreadsUserTime: 4m29s - TotalThreadsVoluntaryContextSwitches: 1.59M (1585268) Fragment Instance Lifecycle Timings: - ExecTime: 8m18s - ExecTreeExecTime: 5s985ms - OpenTime: 21s801ms - ExecTreeOpenTime: 21s319ms - PrepareTime: 44.875ms - ExecTreePrepareTime: 1.635ms DataStreamSender (dst_id=19):(Total: 32s356ms, non-child: 32s356ms, % non-child: 100.00%) - BytesSent: 3.71 GB (3980216434) - OverallThroughput: 117.31 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 27.32M (27321130) - SerializeBatchTime: 32s326ms - UncompressedRowBatchSize: 3.71 GB (3980216434) CodeGen:(Total: 509.775ms, non-child: 509.775ms, % non-child: 100.00%) - CodegenTime: 1.600ms - CompileTime: 151.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 329.665ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.045ms HASH_JOIN_NODE (id=9):(Total: 27s275ms, non-child: 4s941ms, % non-child: 18.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 291.939ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.32M (27321130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s565ms - RowsReturned: 27.32M (27321130) - RowsReturnedRate: 1.00 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 236.759ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 3.051ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.302ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s015ms, non-child: 18.661ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.451ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.98 K/sec RecvrSide: BytesReceived(16s000ms): 14.71 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s912ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s000ms - DataArrivalTimer: 20s996ms SenderSide: - DeserializeRowBatchTimer: 274.780ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s899ms, non-child: 1s102ms, % non-child: 18.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 407.873us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.32M (27321130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s028ms - RowsReturned: 27.32M (27321130) - RowsReturnedRate: 4.63 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 42.227us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 122.059us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.859us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s195ms, non-child: 13.414us, % non-child: 0.00%) - ConvertRowBatchTime: 3.605us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 41.00 /sec RecvrSide: BytesReceived(16s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s195ms - DataArrivalTimer: 2s195ms SenderSide: - DeserializeRowBatchTimer: 64.882us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s600ms, non-child: 2s600ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:10/2.24 GB 6:21/5.20 GB 7:23/5.18 GB 0:16/3.80 GB 3:18/4.35 GB 4:15/3.64 GB 1:10/1.96 GB 5:16/3.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s348ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:25 BytesRead(16s000ms): 129.19 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 187.91 MB, 195.31 MB, 235.28 MB, 235.28 MB, 235.28 MB, 235.28 MB, 235.28 MB, 235.28 MB, 235.28 MB - FooterProcessingTime: (Avg: 489.486us ; Min: 267.250us ; Max: 736.395us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.71 - BytesRead: 235.28 MB (246712707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.28 MB (246712707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.28 MB (246712707) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s209ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.90 MB (246310730) - PerReadThreadRawHdfsThroughput: 796.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.595ms - RowBatchQueuePutWaitTime: 28m10s - RowsRead: 27.32M (27323038) - RowsReturned: 27.32M (27321130) - RowsReturnedRate: 10.51 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 23.43K (23435) - ScannerThreadsTotalWallClockTime: 31m55s - MaterializeTupleTime(*): 4s413ms - ScannerThreadsSysTime: 14s561ms - ScannerThreadsUserTime: 3m27s - ScannerThreadsVoluntaryContextSwitches: 1.56M (1558929) - TotalRawHdfsReadTime(*): 295.403ms - TotalReadThroughput: 466.47 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.83K (83828) - Rows rejected: 1.91K (1908) - Rows total: 27.32M (27323038) Filter 5 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.32M (27321130) Filter 6 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.32M (27321130) Filter 7 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.32M (27321130) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 27.32M (27321130) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 124 (124) - Files total: 129 (129) - RowGroups processed: 26.68K (26680) - RowGroups rejected: 0 (0) - RowGroups total: 26.68K (26680) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.32M (27321130) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000ea (host=foo.221.18:22000):(Total: 8m29s, non-child: 7m30s, % non-child: 88.45%) Hdfs split stats (:<# splits>/): 3:10/2.14 GB 2:12/2.82 GB 1:18/4.35 GB 5:15/3.62 GB 4:21/5.03 GB 6:26/6.34 GB 7:14/3.23 GB 0:14/3.16 GB Filter 0 arrival: 1s926ms Filter 9 arrival: 2s037ms Filter 8 arrival: 21s160ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 126.51 MB, 375.87 MB, 383.93 MB, 397.63 MB, 397.63 MB, 397.63 MB, 397.63 MB, 397.63 MB, 397.63 MB, 397.63 MB, 397.63 MB, 396.82 MB, 395.86 MB, 395.80 MB, 395.89 MB, 395.96 MB, 395.98 MB, 396.03 MB, 423.55 MB, 445.37 MB, 440.89 MB, 416.50 MB, 413.50 MB, 413.55 MB, 413.63 MB, 413.55 MB, 413.52 MB, 413.52 MB, 413.58 MB, 413.52 MB, 413.52 MB, 413.60 MB, 413.52 MB, 408.62 MB, 405.56 MB, 405.54 MB, 405.58 MB, 405.61 MB, 401.68 MB, 386.62 MB, 373.81 MB, 373.60 MB, 373.88 MB, 373.72 MB, 373.74 MB, 373.90 MB, 373.84 MB, 373.64 MB, 367.19 MB, 365.82 MB, 365.76 MB, 365.68 MB, 365.75 MB, 365.83 MB, 361.91 MB, 357.86 MB, 357.70 MB, 357.90 MB, 322.82 MB, 322.42 MB, 322.38 MB, 281.28 MB, 233.18 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 4, 3 - AverageThreadTokens: 5.55 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 446.30 MB (467982558) - PerHostPeakMemUsage: 1.48 GB (1585855039) - RowsProduced: 26.30M (26297758) - TotalNetworkReceiveTime: 21s847ms - TotalNetworkSendTime: 7m5s - TotalStorageWaitTime: 153.672ms - TotalThreadsInvoluntaryContextSwitches: 9.85K (9849) - TotalThreadsTotalWallClockTime: 47m5s - TotalThreadsSysTime: 3s621ms - TotalThreadsUserTime: 1m6s - TotalThreadsVoluntaryContextSwitches: 148.09K (148086) Fragment Instance Lifecycle Timings: - ExecTime: 8m8s - ExecTreeExecTime: 5s783ms - OpenTime: 21s161ms - ExecTreeOpenTime: 20s645ms - PrepareTime: 49.285ms - ExecTreePrepareTime: 2.697ms DataStreamSender (dst_id=19):(Total: 31s865ms, non-child: 31s865ms, % non-child: 100.00%) - BytesSent: 3.58 GB (3839451417) - OverallThroughput: 114.91 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 26.30M (26297758) - SerializeBatchTime: 31s830ms - UncompressedRowBatchSize: 3.58 GB (3839451417) CodeGen:(Total: 544.405ms, non-child: 544.405ms, % non-child: 100.00%) - CodegenTime: 1.668ms - CompileTime: 172.248ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 342.289ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.189ms HASH_JOIN_NODE (id=9):(Total: 26s401ms, non-child: 4s824ms, % non-child: 18.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 251.308ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 26.30M (26297758) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s492ms - RowsReturned: 26.30M (26297758) - RowsReturnedRate: 996.07 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 205.855ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 474.671us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.606ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s382ms, non-child: 16.289ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.030ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.67 K/sec RecvrSide: BytesReceived(8s000ms): 2.69 MB, 26.92 MB, 32.70 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s046ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s368ms - DataArrivalTimer: 20s366ms SenderSide: - DeserializeRowBatchTimer: 302.677ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s757ms, non-child: 989.591ms, % non-child: 17.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 564.635us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 26.30M (26297758) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 925.588ms - RowsReturned: 26.30M (26297758) - RowsReturnedRate: 4.57 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.225us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 118.657us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.075us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s478ms, non-child: 13.034us, % non-child: 0.00%) - ConvertRowBatchTime: 3.368us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 61.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s478ms - DataArrivalTimer: 1s478ms SenderSide: - DeserializeRowBatchTimer: 110.331us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s289ms, non-child: 3s289ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:10/2.14 GB 2:12/2.82 GB 1:18/4.35 GB 5:15/3.62 GB 4:21/5.03 GB 6:26/6.34 GB 7:14/3.23 GB 0:14/3.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s031ms Hdfs Read Thread Concurrency Bucket: 0:99.9% 1:0.0993% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:25 BytesRead(8s000ms): 71.09 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 189.56 MB, 212.95 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB, 232.42 MB - FooterProcessingTime: (Avg: 382.409us ; Min: 174.261us ; Max: 1.131ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.55 - BytesRead: 232.42 MB (243714951) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.42 MB (243714951) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.42 MB (243714951) - CachedFileHandlesHitCount: 44 (44) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s189ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 286.34 MB (300253175) - PerReadThreadRawHdfsThroughput: 837.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.884ms - RowBatchQueuePutWaitTime: 38m5s - RowsRead: 26.30M (26299615) - RowsReturned: 26.30M (26297758) - RowsReturnedRate: 7.99 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 998 (998) - ScannerThreadsTotalWallClockTime: 38m14s - MaterializeTupleTime(*): 4s248ms - ScannerThreadsSysTime: 1s289ms - ScannerThreadsUserTime: 6s702ms - ScannerThreadsVoluntaryContextSwitches: 122.12K (122116) - TotalRawHdfsReadTime(*): 277.533ms - TotalReadThroughput: 472.23 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.78K (83777) - Rows rejected: 1.86K (1857) - Rows total: 26.30M (26299615) Filter 5 (2.00 MB): - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 26.30M (26297758) Filter 6 (2.00 MB): - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 26.30M (26297758) Filter 7 (2.00 MB): - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 26.30M (26297758) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 26.30M (26297758) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 125 (125) - Files total: 130 (130) - RowGroups processed: 25.68K (25681) - RowGroups rejected: 0 (0) - RowGroups total: 25.68K (25681) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 26.30M (26297758) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000d9 (host=foo.232.31:22000):(Total: 8m25s, non-child: 7m27s, % non-child: 88.50%) Hdfs split stats (:<# splits>/): 0:8/1.98 GB 1:20/4.89 GB 4:12/2.96 GB 6:17/3.88 GB 3:19/4.70 GB 2:26/6.44 GB 7:13/3.11 GB 5:11/2.55 GB Filter 9 arrival: 834ms Filter 0 arrival: 1s137ms Filter 8 arrival: 21s355ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 134.85 MB, 374.79 MB, 381.84 MB, 397.36 MB, 397.36 MB, 397.36 MB, 397.36 MB, 397.36 MB, 397.36 MB, 397.36 MB, 397.36 MB, 396.35 MB, 394.77 MB, 394.84 MB, 394.84 MB, 394.83 MB, 394.96 MB, 394.80 MB, 394.76 MB, 385.44 MB, 363.40 MB, 362.99 MB, 362.99 MB, 363.08 MB, 362.89 MB, 362.93 MB, 363.01 MB, 363.04 MB, 362.97 MB, 363.00 MB, 362.98 MB, 362.99 MB, 355.08 MB, 339.01 MB, 330.94 MB, 330.96 MB, 331.09 MB, 330.92 MB, 331.07 MB, 331.04 MB, 331.13 MB, 331.06 MB, 324.92 MB, 322.94 MB, 318.54 MB, 315.01 MB, 296.93 MB, 304.62 MB, 292.92 MB, 229.37 MB, 221.71 MB, 221.79 MB, 217.25 MB, 213.77 MB, 213.84 MB, 213.78 MB, 213.73 MB, 213.81 MB, 206.29 MB, 205.86 MB, 205.80 MB, 202.46 MB, 116.59 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.71 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.22 MB (417566859) - PerHostPeakMemUsage: 1.42 GB (1528772547) - RowsProduced: 26.77M (26770610) - TotalNetworkReceiveTime: 20s956ms - TotalNetworkSendTime: 7m1s - TotalStorageWaitTime: 156.146ms - TotalThreadsInvoluntaryContextSwitches: 30.82K (30816) - TotalThreadsTotalWallClockTime: 39m41s - TotalThreadsSysTime: 16s352ms - TotalThreadsUserTime: 4m24s - TotalThreadsVoluntaryContextSwitches: 2.01M (2005322) Fragment Instance Lifecycle Timings: - ExecTime: 8m4s - ExecTreeExecTime: 5s896ms - OpenTime: 21s361ms - ExecTreeOpenTime: 20s917ms - PrepareTime: 48.031ms - ExecTreePrepareTime: 1.342ms DataStreamSender (dst_id=19):(Total: 30s908ms, non-child: 30s908ms, % non-child: 100.00%) - BytesSent: 3.63 GB (3900446696) - OverallThroughput: 120.35 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 26.77M (26770610) - SerializeBatchTime: 30s882ms - UncompressedRowBatchSize: 3.63 GB (3900446696) CodeGen:(Total: 473.539ms, non-child: 473.539ms, % non-child: 100.00%) - CodegenTime: 1.986ms - CompileTime: 135.998ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 306.959ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.405ms HASH_JOIN_NODE (id=9):(Total: 26s785ms, non-child: 4s897ms, % non-child: 18.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 281.343ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 26.77M (26770610) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s548ms - RowsReturned: 26.77M (26770610) - RowsReturnedRate: 999.46 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.219ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 865.780us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.108ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s623ms, non-child: 18.010ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.314ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.40 K/sec RecvrSide: BytesReceived(8s000ms): 4.17 MB, 28.10 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s360ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s608ms - DataArrivalTimer: 20s605ms SenderSide: - DeserializeRowBatchTimer: 177.852ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s859ms, non-child: 1s041ms, % non-child: 17.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 469.759us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 26.77M (26770610) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 983.177ms - RowsReturned: 26.77M (26770610) - RowsReturnedRate: 4.57 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.643us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 122.464us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.087us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 348.008ms, non-child: 15.038us, % non-child: 0.00%) - ConvertRowBatchTime: 4.407us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 261.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 347.997ms - DataArrivalTimer: 347.994ms SenderSide: - DeserializeRowBatchTimer: 86.032us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s469ms, non-child: 4s469ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:8/1.98 GB 1:20/4.89 GB 4:12/2.96 GB 6:17/3.88 GB 3:19/4.70 GB 2:26/6.44 GB 7:13/3.11 GB 5:11/2.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s237ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:25 BytesRead(8s000ms): 71.10 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 189.60 MB, 216.85 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB, 238.06 MB - FooterProcessingTime: (Avg: 2.790ms ; Min: 735.915us ; Max: 4.191ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.70 - BytesRead: 238.06 MB (249619752) - BytesReadDataNodeCache: 0 - BytesReadLocal: 238.06 MB (249619752) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 238.06 MB (249619752) - CachedFileHandlesHitCount: 45 (45) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s227ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.78 MB (247234158) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.645ms - RowBatchQueuePutWaitTime: 27m5s - RowsRead: 26.77M (26772509) - RowsReturned: 26.77M (26770610) - RowsReturnedRate: 5.99 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 22.22K (22216) - ScannerThreadsTotalWallClockTime: 30m54s - MaterializeTupleTime(*): 4s432ms - ScannerThreadsSysTime: 14s288ms - ScannerThreadsUserTime: 3m23s - ScannerThreadsVoluntaryContextSwitches: 1.98M (1979146) - TotalRawHdfsReadTime(*): 205.780ms - TotalReadThroughput: 486.57 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.82K (83819) - Rows rejected: 1.90K (1899) - Rows total: 26.77M (26772509) Filter 5 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.77M (26770610) Filter 6 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.77M (26770610) Filter 7 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.77M (26770610) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 26.77M (26770610) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 121 (121) - Files total: 126 (126) - RowGroups processed: 26.14K (26142) - RowGroups rejected: 0 (0) - RowGroups total: 26.14K (26142) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 26.77M (26770610) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000107 (host=foo.232.32:22000):(Total: 8m24s, non-child: 7m31s, % non-child: 89.61%) Hdfs split stats (:<# splits>/): 4:12/2.87 GB 7:14/2.97 GB 1:11/2.72 GB 0:13/3.13 GB 3:21/5.20 GB 5:15/3.62 GB 2:19/4.71 GB 6:21/5.20 GB Filter 0 arrival: 1s125ms Filter 9 arrival: 1s294ms Filter 8 arrival: 21s767ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 134.72 MB, 374.38 MB, 379.61 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.82 MB, 394.98 MB, 394.39 MB, 394.39 MB, 394.46 MB, 394.46 MB, 394.46 MB, 394.50 MB, 394.50 MB, 394.36 MB, 394.49 MB, 394.35 MB, 390.95 MB, 377.95 MB, 363.14 MB, 362.68 MB, 362.65 MB, 362.53 MB, 362.72 MB, 362.61 MB, 362.57 MB, 362.60 MB, 362.64 MB, 362.67 MB, 362.61 MB, 362.67 MB, 362.56 MB, 362.60 MB, 362.74 MB, 355.16 MB, 346.74 MB, 346.80 MB, 341.93 MB, 323.92 MB, 323.00 MB, 322.93 MB, 322.84 MB, 322.97 MB, 322.98 MB, 323.08 MB, 315.46 MB, 314.70 MB, 314.98 MB, 314.89 MB, 311.91 MB, 306.83 MB, 306.98 MB, 284.74 MB, 272.76 MB, 243.93 MB, 243.83 MB, 235.61 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.90 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.66 MB (416978617) - PerHostPeakMemUsage: 1.42 GB (1522909179) - RowsProduced: 21.83M (21828202) - TotalNetworkReceiveTime: 21s774ms - TotalNetworkSendTime: 7m11s - TotalStorageWaitTime: 132.567ms - TotalThreadsInvoluntaryContextSwitches: 11.36K (11356) - TotalThreadsTotalWallClockTime: 41m10s - TotalThreadsSysTime: 5s143ms - TotalThreadsUserTime: 1m22s - TotalThreadsVoluntaryContextSwitches: 396.00K (395995) Fragment Instance Lifecycle Timings: - ExecTime: 8m2s - ExecTreeExecTime: 4s564ms - OpenTime: 21s786ms - ExecTreeOpenTime: 21s300ms - PrepareTime: 49.309ms - ExecTreePrepareTime: 1.341ms DataStreamSender (dst_id=19):(Total: 25s999ms, non-child: 25s999ms, % non-child: 100.00%) - BytesSent: 2.97 GB (3190393926) - OverallThroughput: 117.03 MB/sec - PeakMemoryUsage: 7.88 MB (8261664) - RowsReturned: 21.83M (21828202) - SerializeBatchTime: 25s975ms - UncompressedRowBatchSize: 2.97 GB (3190393926) CodeGen:(Total: 513.790ms, non-child: 513.790ms, % non-child: 100.00%) - CodegenTime: 2.204ms - CompileTime: 154.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 330.500ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.590ms HASH_JOIN_NODE (id=9):(Total: 25s841ms, non-child: 3s786ms, % non-child: 14.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 266.377ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.00 MB (161485568) - ProbeRows: 21.83M (21828202) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s462ms - RowsReturned: 21.83M (21828202) - RowsReturnedRate: 844.70 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 205.690ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 502.123us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.796ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s021ms, non-child: 17.275ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.032ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.98 K/sec RecvrSide: BytesReceived(8s000ms): 4.11 MB, 28.01 MB, 32.78 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s277ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s007ms - DataArrivalTimer: 21s004ms SenderSide: - DeserializeRowBatchTimer: 187.204ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s587ms, non-child: 842.477ms, % non-child: 15.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 521.937us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.83M (21828202) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 789.242ms - RowsReturned: 21.83M (21828202) - RowsReturnedRate: 3.91 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.600us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 162.816us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.430us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 766.869ms, non-child: 14.827us, % non-child: 0.00%) - ConvertRowBatchTime: 5.232us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 118.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 766.858ms - DataArrivalTimer: 766.855ms SenderSide: - DeserializeRowBatchTimer: 81.763us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s978ms, non-child: 3s978ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:12/2.87 GB 7:14/2.97 GB 1:11/2.72 GB 0:13/3.13 GB 3:21/5.20 GB 5:15/3.62 GB 2:19/4.71 GB 6:21/5.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s773ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:20 BytesRead(8s000ms): 72.52 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB, 193.39 MB - FooterProcessingTime: (Avg: 594.846us ; Min: 432.989us ; Max: 768.764us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.88 - BytesRead: 193.39 MB (202784798) - BytesReadDataNodeCache: 0 - BytesReadLocal: 193.39 MB (202784798) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 193.39 MB (202784798) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 995.920ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.40 MB (246830273) - PerReadThreadRawHdfsThroughput: 953.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.329ms - RowBatchQueuePutWaitTime: 31m37s - RowsRead: 21.83M (21829809) - RowsReturned: 21.83M (21828202) - RowsReturnedRate: 5.49 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 4.01K (4008) - ScannerThreadsTotalWallClockTime: 32m24s - MaterializeTupleTime(*): 3s532ms - ScannerThreadsSysTime: 3s449ms - ScannerThreadsUserTime: 33s266ms - ScannerThreadsVoluntaryContextSwitches: 374.02K (374016) - TotalRawHdfsReadTime(*): 202.883ms - TotalReadThroughput: 394.88 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.14K (67143) - Rows rejected: 1.61K (1607) - Rows total: 21.83M (21829809) Filter 5 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 21.83M (21828202) Filter 6 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 21.83M (21828202) Filter 7 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 21.83M (21828202) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.83M (21828202) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 122 (122) - Files total: 126 (126) - RowGroups processed: 21.32K (21316) - RowGroups rejected: 0 (0) - RowGroups total: 21.32K (21316) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.83M (21828202) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000a7 (host=foo.221.52:22000):(Total: 8m21s, non-child: 7m20s, % non-child: 87.79%) Hdfs split stats (:<# splits>/): 3:12/2.82 GB 1:18/3.86 GB 6:15/3.46 GB 2:18/4.36 GB 4:14/3.36 GB 7:15/3.47 GB 5:18/4.18 GB 0:19/4.71 GB Filter 0 arrival: 1s574ms Filter 9 arrival: 2s153ms Filter 8 arrival: 22s594ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 126.22 MB, 374.43 MB, 378.56 MB, 396.50 MB, 396.50 MB, 396.50 MB, 396.50 MB, 396.50 MB, 396.50 MB, 396.50 MB, 396.50 MB, 395.88 MB, 394.44 MB, 394.48 MB, 394.49 MB, 394.45 MB, 394.40 MB, 394.39 MB, 386.97 MB, 362.45 MB, 362.70 MB, 362.68 MB, 362.64 MB, 362.60 MB, 362.60 MB, 362.67 MB, 362.61 MB, 362.63 MB, 362.61 MB, 362.74 MB, 357.61 MB, 335.49 MB, 330.60 MB, 330.60 MB, 330.56 MB, 330.56 MB, 330.75 MB, 330.58 MB, 330.68 MB, 330.59 MB, 330.48 MB, 328.60 MB, 322.69 MB, 322.63 MB, 322.63 MB, 322.70 MB, 292.78 MB, 280.96 MB, 258.87 MB, 221.82 MB, 221.66 MB, 221.76 MB, 216.67 MB, 213.79 MB, 213.74 MB, 213.86 MB, 213.76 MB, 206.39 MB, 205.91 MB, 205.87 MB, 205.90 MB, 193.84 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.70 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.82 MB (417141766) - PerHostPeakMemUsage: 1.40 GB (1498813388) - RowsProduced: 27.27M (27271639) - TotalNetworkReceiveTime: 23s445ms - TotalNetworkSendTime: 6m53s - TotalStorageWaitTime: 145.267ms - TotalThreadsInvoluntaryContextSwitches: 31.44K (31440) - TotalThreadsTotalWallClockTime: 39m16s - TotalThreadsSysTime: 29s600ms - TotalThreadsUserTime: 4m11s - TotalThreadsVoluntaryContextSwitches: 2.67M (2671000) Fragment Instance Lifecycle Timings: - ExecTime: 7m58s - ExecTreeExecTime: 5s891ms - OpenTime: 22s616ms - ExecTreeOpenTime: 22s120ms - PrepareTime: 45.632ms - ExecTreePrepareTime: 1.669ms DataStreamSender (dst_id=19):(Total: 32s705ms, non-child: 32s705ms, % non-child: 100.00%) - BytesSent: 3.71 GB (3979299579) - OverallThroughput: 116.03 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 27.27M (27271639) - SerializeBatchTime: 32s678ms - UncompressedRowBatchSize: 3.71 GB (3979299579) CodeGen:(Total: 520.303ms, non-child: 520.303ms, % non-child: 100.00%) - CodegenTime: 1.907ms - CompileTime: 144.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 350.496ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.237ms HASH_JOIN_NODE (id=9):(Total: 27s984ms, non-child: 4s928ms, % non-child: 17.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.194ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.27M (27271639) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s577ms - RowsReturned: 27.27M (27271639) - RowsReturnedRate: 974.52 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 208.444ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 846.697us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.785ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s839ms, non-child: 17.701ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.619ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.15 K/sec RecvrSide: BytesReceived(8s000ms): 3.25 MB, 27.39 MB, 32.72 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s716ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s825ms - DataArrivalTimer: 21s822ms SenderSide: - DeserializeRowBatchTimer: 286.307ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s767ms, non-child: 998.553ms, % non-child: 17.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 384.414us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.27M (27271639) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 931.224ms - RowsReturned: 27.27M (27271639) - RowsReturnedRate: 4.73 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.339us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 124.203us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.618us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s619ms, non-child: 10.863us, % non-child: 0.00%) - ConvertRowBatchTime: 3.775us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 56.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s619ms - DataArrivalTimer: 1s619ms SenderSide: - DeserializeRowBatchTimer: 63.039us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s148ms, non-child: 3s148ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:12/2.82 GB 1:18/3.86 GB 6:15/3.46 GB 2:18/4.36 GB 4:14/3.36 GB 7:15/3.47 GB 5:18/4.18 GB 0:19/4.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s910ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:25 BytesRead(8s000ms): 71.14 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 189.72 MB, 218.56 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB, 235.86 MB - FooterProcessingTime: (Avg: 711.423us ; Min: 381.785us ; Max: 1.304ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.69 - BytesRead: 235.86 MB (247320668) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.86 MB (247320668) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.86 MB (247320668) - CachedFileHandlesHitCount: 43 (43) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s213ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.43 MB (246866739) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.259ms - RowBatchQueuePutWaitTime: 26m49s - RowsRead: 27.27M (27273609) - RowsReturned: 27.27M (27271639) - RowsReturnedRate: 8.66 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 22.62K (22625) - ScannerThreadsTotalWallClockTime: 30m31s - MaterializeTupleTime(*): 4s642ms - ScannerThreadsSysTime: 27s347ms - ScannerThreadsUserTime: 3m9s - ScannerThreadsVoluntaryContextSwitches: 2.65M (2645676) - TotalRawHdfsReadTime(*): 201.164ms - TotalReadThroughput: 486.45 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.89K (83890) - Rows rejected: 1.97K (1970) - Rows total: 27.27M (27273609) Filter 5 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.27M (27271639) Filter 6 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.27M (27271639) Filter 7 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 27.27M (27271639) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 27.27M (27271639) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 124 (124) - Files total: 129 (129) - RowGroups processed: 26.63K (26632) - RowGroups rejected: 0 (0) - RowGroups total: 26.63K (26632) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.27M (27271639) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000aa (host=foo.232.13:22000):(Total: 8m20s, non-child: 7m25s, % non-child: 89.04%) Hdfs split stats (:<# splits>/): 2:12/2.78 GB 0:10/2.33 GB 3:11/2.61 GB 1:14/3.47 GB 5:18/4.38 GB 7:32/7.54 GB 4:18/4.23 GB 6:15/3.18 GB Filter 0 arrival: 1s560ms Filter 9 arrival: 1s673ms Filter 8 arrival: 19s752ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 106.26 MB, 357.91 MB, 368.80 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 379.89 MB, 378.97 MB, 377.96 MB, 377.86 MB, 377.86 MB, 378.10 MB, 378.01 MB, 377.96 MB, 378.10 MB, 377.98 MB, 376.04 MB, 356.64 MB, 346.09 MB, 346.14 MB, 346.01 MB, 346.11 MB, 346.07 MB, 346.12 MB, 346.10 MB, 346.02 MB, 346.08 MB, 345.99 MB, 329.67 MB, 312.64 MB, 306.66 MB, 288.72 MB, 288.76 MB, 288.71 MB, 288.80 MB, 288.74 MB, 288.65 MB, 288.61 MB, 288.79 MB, 287.81 MB, 280.71 MB, 281.75 MB, 304.35 MB, 261.25 MB, 221.35 MB, 221.15 MB, 221.34 MB, 218.79 MB, 213.22 MB, 213.25 MB, 213.32 MB, 213.34 MB, 211.78 MB, 205.30 MB, 205.19 MB, 205.22 MB, 205.32 MB, 189.34 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.48 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.20 MB (399719515) - PerHostPeakMemUsage: 1.41 GB (1510408439) - RowsProduced: 25.33M (25334452) - TotalNetworkReceiveTime: 20s223ms - TotalNetworkSendTime: 7m1s - TotalStorageWaitTime: 269.598ms - TotalThreadsInvoluntaryContextSwitches: 32.54K (32543) - TotalThreadsTotalWallClockTime: 37m24s - TotalThreadsSysTime: 41s038ms - TotalThreadsUserTime: 4m5s - TotalThreadsVoluntaryContextSwitches: 2.51M (2509818) Fragment Instance Lifecycle Timings: - ExecTime: 8m - ExecTreeExecTime: 5s005ms - OpenTime: 19s751ms - ExecTreeOpenTime: 19s311ms - PrepareTime: 40.865ms - ExecTreePrepareTime: 1.380ms DataStreamSender (dst_id=19):(Total: 30s065ms, non-child: 30s065ms, % non-child: 100.00%) - BytesSent: 3.44 GB (3693901293) - OverallThroughput: 117.17 MB/sec - PeakMemoryUsage: 7.89 MB (8269856) - RowsReturned: 25.33M (25334452) - SerializeBatchTime: 30s039ms - UncompressedRowBatchSize: 3.44 GB (3693901293) CodeGen:(Total: 461.218ms, non-child: 461.218ms, % non-child: 100.00%) - CodegenTime: 1.718ms - CompileTime: 139.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 299.389ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 21.811ms HASH_JOIN_NODE (id=9):(Total: 24s293ms, non-child: 4s141ms, % non-child: 17.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.323ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 25.33M (25334452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s811ms - RowsReturned: 25.33M (25334452) - RowsReturnedRate: 1.04 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.426ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 599.183us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.860ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s038ms, non-child: 18.976ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.258ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.27 K/sec RecvrSide: BytesReceived(8s000ms): 2.64 MB, 26.95 MB, 32.72 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s764ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s023ms - DataArrivalTimer: 19s019ms SenderSide: - DeserializeRowBatchTimer: 279.423ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s758ms, non-child: 913.257ms, % non-child: 15.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 359.326us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 25.33M (25334452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 852.085ms - RowsReturned: 25.33M (25334452) - RowsReturnedRate: 4.40 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.777us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 98.739us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.918us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s200ms, non-child: 12.856us, % non-child: 0.00%) - ConvertRowBatchTime: 4.554us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 75.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s200ms - DataArrivalTimer: 1s200ms SenderSide: - DeserializeRowBatchTimer: 120.678us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s645ms, non-child: 3s645ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.78 GB 0:10/2.33 GB 3:11/2.61 GB 1:14/3.47 GB 5:18/4.38 GB 7:32/7.54 GB 4:18/4.23 GB 6:15/3.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s395ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:25 BytesRead(8s000ms): 54.70 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 175.05 MB, 181.00 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB, 222.65 MB - FooterProcessingTime: (Avg: 524.102us ; Min: 222.963us ; Max: 760.010us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.48 - BytesRead: 222.65 MB (233466844) - BytesReadDataNodeCache: 0 - BytesReadLocal: 222.65 MB (233466844) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 222.65 MB (233466844) - CachedFileHandlesHitCount: 41 (41) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s141ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 218.91 MB (229546203) - PerReadThreadRawHdfsThroughput: 651.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 63.249ms - RowBatchQueuePutWaitTime: 24m46s - RowsRead: 25.34M (25336421) - RowsReturned: 25.33M (25334452) - RowsReturnedRate: 6.95 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 24.26K (24260) - ScannerThreadsTotalWallClockTime: 28m43s - MaterializeTupleTime(*): 4s002ms - ScannerThreadsSysTime: 39s063ms - ScannerThreadsUserTime: 3m9s - ScannerThreadsVoluntaryContextSwitches: 2.48M (2484254) - TotalRawHdfsReadTime(*): 341.807ms - TotalReadThroughput: 459.67 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.89K (83889) - Rows rejected: 1.97K (1969) - Rows total: 25.34M (25336421) Filter 5 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 25.33M (25334452) Filter 6 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 25.33M (25334452) Filter 7 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 25.33M (25334452) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 25.33M (25334452) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 125 (125) - Files total: 130 (130) - RowGroups processed: 24.74K (24741) - RowGroups rejected: 0 (0) - RowGroups total: 24.74K (24741) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 25.33M (25334452) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000092 (host=foo.221.28:22000):(Total: 8m16s, non-child: 7m14s, % non-child: 87.59%) Hdfs split stats (:<# splits>/): 2:12/2.71 GB 4:14/3.43 GB 0:14/3.00 GB 3:17/3.79 GB 7:18/4.34 GB 1:14/3.41 GB 6:17/4.15 GB 5:24/5.56 GB Filter 0 arrival: 1s853ms Filter 9 arrival: 1s967ms Filter 8 arrival: 22s068ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 96.40 MB, 353.48 MB, 357.82 MB, 376.00 MB, 376.00 MB, 376.00 MB, 376.00 MB, 376.00 MB, 376.00 MB, 376.00 MB, 376.00 MB, 374.85 MB, 373.54 MB, 373.65 MB, 373.62 MB, 373.47 MB, 373.61 MB, 370.60 MB, 342.75 MB, 341.74 MB, 341.71 MB, 341.72 MB, 349.28 MB, 358.66 MB, 358.75 MB, 358.76 MB, 354.17 MB, 342.63 MB, 334.73 MB, 334.75 MB, 334.72 MB, 334.57 MB, 334.71 MB, 334.69 MB, 334.64 MB, 330.35 MB, 326.84 MB, 326.90 MB, 326.82 MB, 326.88 MB, 326.79 MB, 325.76 MB, 285.25 MB, 301.07 MB, 272.93 MB, 259.89 MB, 259.85 MB, 259.80 MB, 259.92 MB, 251.50 MB, 221.60 MB, 220.95 MB, 213.56 MB, 213.48 MB, 213.54 MB, 213.60 MB, 212.47 MB, 205.59 MB, 205.67 MB, 205.63 MB, 204.40 MB, 66.60 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.64 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 376.80 MB (395104607) - PerHostPeakMemUsage: 1.38 GB (1485233861) - RowsProduced: 28.39M (28391922) - TotalNetworkReceiveTime: 22s749ms - TotalNetworkSendTime: 6m46s - TotalStorageWaitTime: 167.625ms - TotalThreadsInvoluntaryContextSwitches: 32.32K (32318) - TotalThreadsTotalWallClockTime: 38m23s - TotalThreadsSysTime: 20s792ms - TotalThreadsUserTime: 4m31s - TotalThreadsVoluntaryContextSwitches: 1.69M (1685575) Fragment Instance Lifecycle Timings: - ExecTime: 7m54s - ExecTreeExecTime: 6s123ms - OpenTime: 22s078ms - ExecTreeOpenTime: 21s607ms - PrepareTime: 40.885ms - ExecTreePrepareTime: 1.598ms DataStreamSender (dst_id=19):(Total: 33s404ms, non-child: 33s404ms, % non-child: 100.00%) - BytesSent: 3.86 GB (4141333085) - OverallThroughput: 118.23 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 28.39M (28391922) - SerializeBatchTime: 33s376ms - UncompressedRowBatchSize: 3.86 GB (4141333085) CodeGen:(Total: 496.761ms, non-child: 496.761ms, % non-child: 100.00%) - CodegenTime: 1.648ms - CompileTime: 146.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 322.999ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.920ms HASH_JOIN_NODE (id=9):(Total: 27s699ms, non-child: 5s118ms, % non-child: 18.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 287.025ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 28.39M (28391922) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s749ms - RowsReturned: 28.39M (28391922) - RowsReturnedRate: 1.03 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 237.350ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 507.821us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.616ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s307ms, non-child: 18.297ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.673ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.68 K/sec RecvrSide: BytesReceived(8s000ms): 2.16 MB, 26.32 MB, 32.64 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s025ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s292ms - DataArrivalTimer: 21s289ms SenderSide: - DeserializeRowBatchTimer: 187.925ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s942ms, non-child: 1s053ms, % non-child: 17.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 446.949us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 28.39M (28391922) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 989.590ms - RowsReturned: 28.39M (28391922) - RowsReturnedRate: 4.78 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.169us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.782us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.108us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s457ms, non-child: 11.269us, % non-child: 0.00%) - ConvertRowBatchTime: 2.920us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 62.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s457ms - DataArrivalTimer: 1s457ms SenderSide: - DeserializeRowBatchTimer: 16.628us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s431ms, non-child: 3s431ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.71 GB 4:14/3.43 GB 0:14/3.00 GB 3:17/3.79 GB 7:18/4.34 GB 1:14/3.41 GB 6:17/4.15 GB 5:24/5.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s091ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:30 BytesRead(8s000ms): 51.89 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 165.97 MB, 181.89 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 202.34 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB, 250.40 MB - FooterProcessingTime: (Avg: 536.913us ; Min: 304.090us ; Max: 996.920us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.64 - BytesRead: 250.40 MB (262563395) - BytesReadDataNodeCache: 0 - BytesReadLocal: 250.40 MB (262563395) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 250.40 MB (262563395) - CachedFileHandlesHitCount: 50 (50) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s306ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 214.53 MB (224947593) - PerReadThreadRawHdfsThroughput: 985.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 127.472ms - RowBatchQueuePutWaitTime: 25m52s - RowsRead: 28.39M (28394253) - RowsReturned: 28.39M (28391922) - RowsReturnedRate: 8.27 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 23.25K (23248) - ScannerThreadsTotalWallClockTime: 29m43s - MaterializeTupleTime(*): 4s522ms - ScannerThreadsSysTime: 18s660ms - ScannerThreadsUserTime: 3m27s - ScannerThreadsVoluntaryContextSwitches: 1.66M (1658393) - TotalRawHdfsReadTime(*): 254.047ms - TotalReadThroughput: 522.22 KB/sec Filter 0 (8.00 KB): - Rows processed: 100.64K (100635) - Rows rejected: 2.33K (2331) - Rows total: 28.39M (28394253) Filter 5 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 28.39M (28391922) Filter 6 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 28.39M (28391922) Filter 7 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 28.39M (28391922) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 28.39M (28391922) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 124 (124) - Files total: 130 (130) - RowGroups processed: 27.73K (27726) - RowGroups rejected: 0 (0) - RowGroups total: 27.73K (27726) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 28.39M (28391922) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce180000009a (host=foo.232.28:22000):(Total: 8m5s, non-child: 7m9s, % non-child: 88.53%) Hdfs split stats (:<# splits>/): 6:18/4.29 GB 4:19/4.34 GB 0:17/4.15 GB 5:15/3.10 GB 3:17/3.92 GB 7:10/2.44 GB 2:15/3.30 GB 1:20/4.76 GB Filter 9 arrival: 1s035ms Filter 0 arrival: 1s191ms Filter 8 arrival: 19s551ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 119.35 MB, 373.94 MB, 384.15 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.21 MB, 393.55 MB, 393.97 MB, 393.92 MB, 393.95 MB, 394.06 MB, 393.94 MB, 393.94 MB, 393.92 MB, 391.98 MB, 365.62 MB, 362.03 MB, 362.21 MB, 362.17 MB, 362.14 MB, 362.17 MB, 361.96 MB, 362.14 MB, 362.17 MB, 362.02 MB, 362.14 MB, 362.15 MB, 351.09 MB, 330.66 MB, 330.18 MB, 330.11 MB, 330.17 MB, 330.18 MB, 330.21 MB, 330.08 MB, 330.23 MB, 330.16 MB, 330.18 MB, 330.06 MB, 330.22 MB, 330.16 MB, 330.26 MB, 322.67 MB, 314.20 MB, 273.44 MB, 206.15 MB, 205.75 MB, 205.65 MB, 205.80 MB, 201.77 MB, 197.84 MB, 197.71 MB, 197.83 MB, 197.88 MB, 189.45 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.78 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.13 MB (416416830) - PerHostPeakMemUsage: 1.43 GB (1534517528) - RowsProduced: 25.51M (25507200) - TotalNetworkReceiveTime: 19s336ms - TotalNetworkSendTime: 6m45s - TotalStorageWaitTime: 184.093ms - TotalThreadsInvoluntaryContextSwitches: 25.20K (25202) - TotalThreadsTotalWallClockTime: 38m42s - TotalThreadsSysTime: 26s787ms - TotalThreadsUserTime: 3m14s - TotalThreadsVoluntaryContextSwitches: 2.39M (2392304) Fragment Instance Lifecycle Timings: - ExecTime: 7m45s - ExecTreeExecTime: 5s662ms - OpenTime: 19s566ms - ExecTreeOpenTime: 19s108ms - PrepareTime: 37.900ms - ExecTreePrepareTime: 1.203ms DataStreamSender (dst_id=19):(Total: 30s439ms, non-child: 30s439ms, % non-child: 100.00%) - BytesSent: 3.47 GB (3722449548) - OverallThroughput: 116.62 MB/sec - PeakMemoryUsage: 7.80 MB (8179744) - RowsReturned: 25.51M (25507200) - SerializeBatchTime: 30s413ms - UncompressedRowBatchSize: 3.47 GB (3722449548) CodeGen:(Total: 479.456ms, non-child: 479.456ms, % non-child: 100.00%) - CodegenTime: 1.542ms - CompileTime: 146.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 310.449ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.001ms HASH_JOIN_NODE (id=9):(Total: 24s743ms, non-child: 4s632ms, % non-child: 18.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 287.876ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 25.51M (25507200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s277ms - RowsReturned: 25.51M (25507200) - RowsReturnedRate: 1.03 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 239.235ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 2.496ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.384ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s807ms, non-child: 18.555ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.700ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.57 K/sec RecvrSide: BytesReceived(8s000ms): 3.54 MB, 27.71 MB, 32.78 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s378ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s791ms - DataArrivalTimer: 18s788ms SenderSide: - DeserializeRowBatchTimer: 192.849ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s891ms, non-child: 990.349ms, % non-child: 16.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 469.432us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 25.51M (25507200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 926.035ms - RowsReturned: 25.51M (25507200) - RowsReturnedRate: 4.33 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.554us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 97.449us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.885us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 544.505ms, non-child: 11.813us, % non-child: 0.00%) - ConvertRowBatchTime: 3.478us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 167.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 544.497ms - DataArrivalTimer: 544.494ms SenderSide: - DeserializeRowBatchTimer: 61.059us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s356ms, non-child: 4s356ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:18/4.29 GB 4:19/4.34 GB 0:17/4.15 GB 5:15/3.10 GB 3:17/3.92 GB 7:10/2.44 GB 2:15/3.30 GB 1:20/4.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s034ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:25 BytesRead(8s000ms): 59.64 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 209.98 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB, 224.86 MB - FooterProcessingTime: (Avg: 660.089us ; Min: 329.902us ; Max: 961.663us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.78 - BytesRead: 224.86 MB (235786543) - BytesReadDataNodeCache: 0 - BytesReadLocal: 224.86 MB (235786543) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 224.86 MB (235786543) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s157ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.91 MB (246317452) - PerReadThreadRawHdfsThroughput: 998.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.486ms - RowBatchQueuePutWaitTime: 27m23s - RowsRead: 25.51M (25509114) - RowsReturned: 25.51M (25507200) - RowsReturnedRate: 5.85 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 16.98K (16977) - ScannerThreadsTotalWallClockTime: 30m16s - MaterializeTupleTime(*): 4s123ms - ScannerThreadsSysTime: 24s802ms - ScannerThreadsUserTime: 2m17s - ScannerThreadsVoluntaryContextSwitches: 2.37M (2367320) - TotalRawHdfsReadTime(*): 225.227ms - TotalReadThroughput: 478.21 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.83K (83834) - Rows rejected: 1.91K (1914) - Rows total: 25.51M (25509114) Filter 5 (2.00 MB): - Rows processed: 60.42K (60416) - Rows rejected: 0 (0) - Rows total: 25.51M (25507200) Filter 6 (2.00 MB): - Rows processed: 60.42K (60416) - Rows rejected: 0 (0) - Rows total: 25.51M (25507200) Filter 7 (2.00 MB): - Rows processed: 60.42K (60416) - Rows rejected: 0 (0) - Rows total: 25.51M (25507200) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 25.51M (25507200) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 126 (126) - Files total: 131 (131) - RowGroups processed: 24.91K (24909) - RowGroups rejected: 0 (0) - RowGroups total: 24.91K (24909) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 25.51M (25507200) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000bf (host=foo.232.52:22000):(Total: 7m56s, non-child: 7m1s, % non-child: 88.46%) Hdfs split stats (:<# splits>/): 7:16/3.70 GB 0:17/3.82 GB 3:8/1.82 GB 4:13/3.22 GB 5:20/4.67 GB 2:18/4.15 GB 1:16/3.74 GB 6:22/5.10 GB Filter 0 arrival: 472ms Filter 9 arrival: 508ms Filter 8 arrival: 18s656ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 123.60 MB, 354.39 MB, 367.15 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.57 MB, 374.41 MB, 374.53 MB, 374.42 MB, 374.31 MB, 374.38 MB, 374.45 MB, 374.49 MB, 374.56 MB, 374.51 MB, 365.04 MB, 346.65 MB, 342.58 MB, 342.54 MB, 342.63 MB, 342.65 MB, 342.64 MB, 342.72 MB, 342.66 MB, 342.45 MB, 342.69 MB, 342.69 MB, 342.55 MB, 342.56 MB, 336.05 MB, 322.31 MB, 312.33 MB, 310.94 MB, 307.36 MB, 281.53 MB, 281.49 MB, 277.32 MB, 246.22 MB, 240.00 MB, 240.06 MB, 241.16 MB, 221.36 MB, 221.31 MB, 221.39 MB, 216.84 MB, 213.24 MB, 213.35 MB, 213.42 MB, 213.41 MB, 207.44 MB, 205.45 MB, 205.42 MB, 205.46 MB, 204.46 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 4.35 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 377.74 MB (396092926) - PerHostPeakMemUsage: 1.41 GB (1515314840) - RowsProduced: 24.64M (24638936) - TotalNetworkReceiveTime: 17s868ms - TotalNetworkSendTime: 6m36s - TotalStorageWaitTime: 202.768ms - TotalThreadsInvoluntaryContextSwitches: 20.17K (20172) - TotalThreadsTotalWallClockTime: 34m32s - TotalThreadsSysTime: 2s807ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 48.89K (48893) Fragment Instance Lifecycle Timings: - ExecTime: 7m37s - ExecTreeExecTime: 5s700ms - OpenTime: 18s679ms - ExecTreeOpenTime: 18s205ms - PrepareTime: 41.313ms - ExecTreePrepareTime: 1.308ms DataStreamSender (dst_id=19):(Total: 30s580ms, non-child: 30s580ms, % non-child: 100.00%) - BytesSent: 3.35 GB (3592457875) - OverallThroughput: 112.03 MB/sec - PeakMemoryUsage: 7.96 MB (8343584) - RowsReturned: 24.64M (24638936) - SerializeBatchTime: 30s551ms - UncompressedRowBatchSize: 3.35 GB (3592457875) CodeGen:(Total: 496.247ms, non-child: 496.247ms, % non-child: 100.00%) - CodegenTime: 1.709ms - CompileTime: 143.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 329.406ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.470ms HASH_JOIN_NODE (id=9):(Total: 23s878ms, non-child: 4s797ms, % non-child: 20.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 293.863ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 24.64M (24638936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s439ms - RowsReturned: 24.64M (24638936) - RowsReturnedRate: 1.03 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 236.454ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 754.082us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.728ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s882ms, non-child: 19.275ms, % non-child: 0.11%) - ConvertRowBatchTime: 13.626ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.83 K/sec RecvrSide: BytesReceived(8s000ms): 5.37 MB, 28.71 MB, 32.85 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s643ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s867ms - DataArrivalTimer: 17s863ms SenderSide: - DeserializeRowBatchTimer: 271.099ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s742ms, non-child: 965.727ms, % non-child: 16.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 376.851us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 24.64M (24638936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 907.824ms - RowsReturned: 24.64M (24638936) - RowsReturnedRate: 4.29 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.851us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 121.613us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.451us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 13.979us, non-child: 13.979us, % non-child: 100.00%) - ConvertRowBatchTime: 3.655us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 6.51 M/sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.679us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 25.639us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s776ms, non-child: 4s776ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:16/3.70 GB 0:17/3.82 GB 3:8/1.82 GB 4:13/3.22 GB 5:20/4.67 GB 2:18/4.15 GB 1:16/3.74 GB 6:22/5.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s555ms Hdfs Read Thread Concurrency Bucket: 0:99.89% 1:0% 2:0.1054% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:25 BytesRead(8s000ms): 54.61 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 173.97 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB, 221.87 MB - FooterProcessingTime: (Avg: 672.302us ; Min: 362.890us ; Max: 875.349us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.32 - BytesRead: 221.87 MB (232643267) - BytesReadDataNodeCache: 0 - BytesReadLocal: 221.87 MB (232643267) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 221.87 MB (232643267) - CachedFileHandlesHitCount: 43 (43) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s160ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 215.40 MB (225861832) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.395ms - RowBatchQueuePutWaitTime: 24m16s - RowsRead: 24.64M (24640974) - RowsReturned: 24.64M (24638936) - RowsReturnedRate: 5.16 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 11.77K (11767) - ScannerThreadsTotalWallClockTime: 26m18s - MaterializeTupleTime(*): 4s140ms - ScannerThreadsSysTime: 594.908ms - ScannerThreadsUserTime: 1m54s - ScannerThreadsVoluntaryContextSwitches: 24.67K (24669) - TotalRawHdfsReadTime(*): 199.528ms - TotalReadThroughput: 478.30 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.96K (83958) - Rows rejected: 2.04K (2038) - Rows total: 24.64M (24640974) Filter 5 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 24.64M (24638936) Filter 6 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 24.64M (24638936) Filter 7 (2.00 MB): - Rows processed: 66.56K (66560) - Rows rejected: 0 (0) - Rows total: 24.64M (24638936) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 24.64M (24638936) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 125 (125) - Files total: 130 (130) - RowGroups processed: 24.06K (24061) - RowGroups rejected: 0 (0) - RowGroups total: 24.06K (24061) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 24.64M (24638936) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000094 (host=foo.221.39:22000):(Total: 7m39s, non-child: 6m39s, % non-child: 87.05%) Hdfs split stats (:<# splits>/): 6:12/2.87 GB 7:8/1.88 GB 2:20/4.63 GB 1:13/3.22 GB 0:21/4.98 GB 4:16/3.82 GB 5:21/5.20 GB 3:16/3.81 GB Filter 9 arrival: 1s406ms Filter 0 arrival: 1s710ms Filter 8 arrival: 22s357ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 126.21 MB, 374.65 MB, 378.86 MB, 397.11 MB, 397.11 MB, 397.11 MB, 397.11 MB, 397.11 MB, 397.11 MB, 397.11 MB, 397.11 MB, 396.10 MB, 394.65 MB, 394.62 MB, 394.69 MB, 394.70 MB, 394.56 MB, 394.31 MB, 368.85 MB, 362.92 MB, 362.76 MB, 362.85 MB, 362.85 MB, 362.85 MB, 362.77 MB, 362.88 MB, 362.75 MB, 362.78 MB, 348.52 MB, 338.95 MB, 334.06 MB, 331.00 MB, 331.01 MB, 330.94 MB, 331.01 MB, 330.99 MB, 324.63 MB, 323.06 MB, 322.95 MB, 322.97 MB, 308.12 MB, 288.51 MB, 294.21 MB, 272.52 MB, 263.63 MB, 235.07 MB, 222.44 MB, 222.30 MB, 220.79 MB, 214.41 MB, 214.31 MB, 214.21 MB, 211.84 MB, 206.31 MB, 206.42 MB, 204.90 MB, 191.83 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.70 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.02 MB (417356536) - PerHostPeakMemUsage: 1.37 GB (1474043505) - RowsProduced: 27.38M (27381144) - TotalNetworkReceiveTime: 22s453ms - TotalNetworkSendTime: 6m14s - TotalStorageWaitTime: 167.725ms - TotalThreadsInvoluntaryContextSwitches: 29.86K (29859) - TotalThreadsTotalWallClockTime: 35m56s - TotalThreadsSysTime: 20s728ms - TotalThreadsUserTime: 4m5s - TotalThreadsVoluntaryContextSwitches: 1.88M (1880003) Fragment Instance Lifecycle Timings: - ExecTime: 7m16s - ExecTreeExecTime: 5s650ms - OpenTime: 22s350ms - ExecTreeOpenTime: 21s870ms - PrepareTime: 54.608ms - ExecTreePrepareTime: 1.394ms DataStreamSender (dst_id=19):(Total: 31s460ms, non-child: 31s460ms, % non-child: 100.00%) - BytesSent: 3.72 GB (3990129412) - OverallThroughput: 120.95 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 27.38M (27381144) - SerializeBatchTime: 31s434ms - UncompressedRowBatchSize: 3.72 GB (3990129412) CodeGen:(Total: 505.534ms, non-child: 505.534ms, % non-child: 100.00%) - CodegenTime: 1.706ms - CompileTime: 146.310ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.066ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.585ms HASH_JOIN_NODE (id=9):(Total: 27s495ms, non-child: 4s682ms, % non-child: 17.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 277.934ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.38M (27381144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s330ms - RowsReturned: 27.38M (27381144) - RowsReturnedRate: 995.83 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 237.261ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 802.926us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.315ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s580ms, non-child: 18.318ms, % non-child: 0.08%) - ConvertRowBatchTime: 13.682ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.41 K/sec RecvrSide: BytesReceived(8s000ms): 2.95 MB, 27.15 MB, 32.71 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s863ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s565ms - DataArrivalTimer: 21s562ms SenderSide: - DeserializeRowBatchTimer: 187.683ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s794ms, non-child: 1s036ms, % non-child: 17.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 275.393us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.38M (27381144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 977.137ms - RowsReturned: 27.38M (27381144) - RowsReturnedRate: 4.73 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.285us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 52.265us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.962us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 888.378ms, non-child: 22.143us, % non-child: 0.00%) - ConvertRowBatchTime: 14.064us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 102.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 888.359ms - DataArrivalTimer: 888.356ms SenderSide: - DeserializeRowBatchTimer: 343.524us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s870ms, non-child: 3s870ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:12/2.87 GB 7:8/1.88 GB 2:20/4.63 GB 1:13/3.22 GB 0:21/4.98 GB 4:16/3.82 GB 5:21/5.20 GB 3:16/3.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s655ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:25 BytesRead(8s000ms): 71.04 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 189.45 MB, 204.68 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB, 238.18 MB - FooterProcessingTime: (Avg: 661.640us ; Min: 299.136us ; Max: 1.009ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.67 - BytesRead: 238.18 MB (249752859) - BytesReadDataNodeCache: 0 - BytesReadLocal: 238.18 MB (249752859) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 238.18 MB (249752859) - CachedFileHandlesHitCount: 43 (43) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s205ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.64 MB (247091022) - PerReadThreadRawHdfsThroughput: 1016.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.433ms - RowBatchQueuePutWaitTime: 24m22s - RowsRead: 27.38M (27383124) - RowsReturned: 27.38M (27381144) - RowsReturnedRate: 7.08 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 21.43K (21431) - ScannerThreadsTotalWallClockTime: 27m54s - MaterializeTupleTime(*): 4s279ms - ScannerThreadsSysTime: 18s563ms - ScannerThreadsUserTime: 3m6s - ScannerThreadsVoluntaryContextSwitches: 1.85M (1854941) - TotalRawHdfsReadTime(*): 234.294ms - TotalReadThroughput: 533.70 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.90K (83900) - Rows rejected: 1.98K (1980) - Rows total: 27.38M (27383124) Filter 5 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.38M (27381144) Filter 6 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.38M (27381144) Filter 7 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 27.38M (27381144) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 27.38M (27381144) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 122 (122) - Files total: 127 (127) - RowGroups processed: 26.74K (26739) - RowGroups rejected: 0 (0) - RowGroups total: 26.74K (26739) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.38M (27381144) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000ff (host=foo.232.17:22000):(Total: 7m31s, non-child: 6m39s, % non-child: 88.57%) Hdfs split stats (:<# splits>/): 5:16/3.93 GB 6:17/3.92 GB 1:15/3.51 GB 7:16/3.89 GB 0:18/4.13 GB 2:12/2.86 GB 4:16/3.84 GB 3:19/4.34 GB Filter 0 arrival: 1s029ms Filter 9 arrival: 1s196ms Filter 8 arrival: 21s240ms Filter 6 arrival: 1m28s Filter 5 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 140.93 MB, 369.42 MB, 377.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 391.58 MB, 390.15 MB, 389.67 MB, 389.37 MB, 389.57 MB, 389.40 MB, 389.40 MB, 389.55 MB, 389.43 MB, 389.61 MB, 389.54 MB, 389.51 MB, 389.43 MB, 371.04 MB, 357.48 MB, 357.51 MB, 357.59 MB, 357.52 MB, 357.58 MB, 357.58 MB, 357.60 MB, 357.55 MB, 357.57 MB, 357.62 MB, 357.53 MB, 357.56 MB, 357.54 MB, 357.85 MB, 341.64 MB, 327.14 MB, 325.74 MB, 325.61 MB, 325.81 MB, 325.67 MB, 325.83 MB, 325.67 MB, 325.75 MB, 323.56 MB, 288.64 MB, 288.35 MB, 288.34 MB, 288.26 MB, 288.40 MB, 283.43 MB, 278.28 MB, 224.01 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.83 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 392.89 MB (411974966) - PerHostPeakMemUsage: 1.41 GB (1512670434) - RowsProduced: 20.99M (20987773) - TotalNetworkReceiveTime: 21s162ms - TotalNetworkSendTime: 6m19s - TotalStorageWaitTime: 98.690ms - TotalThreadsInvoluntaryContextSwitches: 8.60K (8596) - TotalThreadsTotalWallClockTime: 36m21s - TotalThreadsSysTime: 2s527ms - TotalThreadsUserTime: 1m3s - TotalThreadsVoluntaryContextSwitches: 78.28K (78281) Fragment Instance Lifecycle Timings: - ExecTime: 7m10s - ExecTreeExecTime: 4s662ms - OpenTime: 21s246ms - ExecTreeOpenTime: 20s767ms - PrepareTime: 44.472ms - ExecTreePrepareTime: 1.386ms DataStreamSender (dst_id=19):(Total: 25s708ms, non-child: 25s708ms, % non-child: 100.00%) - BytesSent: 2.86 GB (3066814113) - OverallThroughput: 113.77 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 20.99M (20987773) - SerializeBatchTime: 25s685ms - UncompressedRowBatchSize: 2.86 GB (3066814113) CodeGen:(Total: 503.012ms, non-child: 503.012ms, % non-child: 100.00%) - CodegenTime: 1.761ms - CompileTime: 158.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 318.622ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.345ms HASH_JOIN_NODE (id=9):(Total: 25s408ms, non-child: 3s904ms, % non-child: 15.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 259.487ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 20.99M (20987773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s588ms - RowsReturned: 20.99M (20987773) - RowsReturnedRate: 826.02 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 213.000ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 576.972us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.511ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s495ms, non-child: 17.554ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.476ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.54 K/sec RecvrSide: BytesReceived(8s000ms): 4.49 MB, 28.28 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s192ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s481ms - DataArrivalTimer: 20s478ms SenderSide: - DeserializeRowBatchTimer: 182.480ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s553ms, non-child: 824.574ms, % non-child: 14.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 894.565us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.99M (20987773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 772.239ms - RowsReturned: 20.99M (20987773) - RowsReturnedRate: 3.78 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.710us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 376.101us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.809us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 680.107ms, non-child: 15.467us, % non-child: 0.00%) - ConvertRowBatchTime: 4.597us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 133.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 680.097ms - DataArrivalTimer: 680.092ms SenderSide: - DeserializeRowBatchTimer: 22.145us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s048ms, non-child: 4s048ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:16/3.93 GB 6:17/3.92 GB 1:15/3.51 GB 7:16/3.89 GB 0:18/4.13 GB 2:12/2.86 GB 4:16/3.84 GB 3:19/4.34 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s858ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 69.65 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB, 185.73 MB - FooterProcessingTime: (Avg: 327.710us ; Min: 217.247us ; Max: 511.634us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.81 - BytesRead: 185.73 MB (194748821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.73 MB (194748821) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.73 MB (194748821) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 966.885ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 230.41 MB (241599159) - PerReadThreadRawHdfsThroughput: 842.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.525ms - RowBatchQueuePutWaitTime: 28m11s - RowsRead: 20.99M (20989330) - RowsReturned: 20.99M (20987773) - RowsReturnedRate: 5.18 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.42K (1424) - ScannerThreadsTotalWallClockTime: 28m28s - MaterializeTupleTime(*): 3s357ms - ScannerThreadsSysTime: 670.897ms - ScannerThreadsUserTime: 14s251ms - ScannerThreadsVoluntaryContextSwitches: 56.56K (56556) - TotalRawHdfsReadTime(*): 220.417ms - TotalReadThroughput: 423.57 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.09K (67093) - Rows rejected: 1.56K (1557) - Rows total: 20.99M (20989330) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.99M (20987773) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.99M (20987773) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.99M (20987773) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 20.99M (20987773) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 20.50K (20495) - RowGroups rejected: 0 (0) - RowGroups total: 20.50K (20495) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.99M (20987773) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000099 (host=foo.232.21:22000):(Total: 7m27s, non-child: 6m36s, % non-child: 88.53%) Hdfs split stats (:<# splits>/): 5:13/2.88 GB 7:16/3.96 GB 2:19/4.40 GB 1:13/3.14 GB 4:13/3.12 GB 6:14/3.35 GB 3:14/3.47 GB 0:24/5.61 GB Filter 0 arrival: 1s151ms Filter 9 arrival: 1s255ms Filter 8 arrival: 19s528ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 122.64 MB, 342.23 MB, 354.05 MB, 363.18 MB, 363.18 MB, 363.18 MB, 363.18 MB, 363.18 MB, 363.18 MB, 363.18 MB, 363.18 MB, 362.51 MB, 362.25 MB, 362.19 MB, 362.17 MB, 362.34 MB, 362.23 MB, 362.20 MB, 362.24 MB, 362.23 MB, 361.26 MB, 335.39 MB, 330.40 MB, 330.40 MB, 330.39 MB, 330.34 MB, 330.36 MB, 330.31 MB, 330.38 MB, 330.39 MB, 330.43 MB, 320.19 MB, 297.00 MB, 299.21 MB, 313.72 MB, 305.70 MB, 305.63 MB, 305.60 MB, 305.61 MB, 305.71 MB, 305.68 MB, 301.09 MB, 297.72 MB, 295.71 MB, 261.98 MB, 255.21 MB, 214.08 MB, 213.83 MB, 213.92 MB, 213.67 MB, 205.82 MB, 206.03 MB, 205.91 MB, 201.74 MB, 103.19 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.47 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 365.65 MB (383414901) - PerHostPeakMemUsage: 1.39 GB (1494598744) - RowsProduced: 22.77M (22765127) - TotalNetworkReceiveTime: 19s613ms - TotalNetworkSendTime: 6m13s - TotalStorageWaitTime: 143.212ms - TotalThreadsInvoluntaryContextSwitches: 22.77K (22775) - TotalThreadsTotalWallClockTime: 33m19s - TotalThreadsSysTime: 24s411ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 2.77M (2773603) Fragment Instance Lifecycle Timings: - ExecTime: 7m7s - ExecTreeExecTime: 4s803ms - OpenTime: 19s527ms - ExecTreeOpenTime: 19s099ms - PrepareTime: 47.341ms - ExecTreePrepareTime: 1.521ms DataStreamSender (dst_id=19):(Total: 26s990ms, non-child: 26s990ms, % non-child: 100.00%) - BytesSent: 3.09 GB (3318818479) - OverallThroughput: 117.27 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 22.77M (22765127) - SerializeBatchTime: 26s964ms - UncompressedRowBatchSize: 3.09 GB (3318818479) CodeGen:(Total: 460.480ms, non-child: 460.480ms, % non-child: 100.00%) - CodegenTime: 1.512ms - CompileTime: 134.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 292.624ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 33.014ms HASH_JOIN_NODE (id=9):(Total: 23s881ms, non-child: 4s005ms, % non-child: 16.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 244.751ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.77M (22765127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s704ms - RowsReturned: 22.77M (22765127) - RowsReturnedRate: 953.27 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 201.499ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 345.126us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.563ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s844ms, non-child: 17.671ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.527ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.52 K/sec RecvrSide: BytesReceived(8s000ms): 4.13 MB, 28.08 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s356ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s830ms - DataArrivalTimer: 18s827ms SenderSide: - DeserializeRowBatchTimer: 249.427ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s641ms, non-child: 837.799ms, % non-child: 14.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 442.477us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.77M (22765127) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 778.907ms - RowsReturned: 22.77M (22765127) - RowsReturnedRate: 4.04 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.909us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 165.594us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.549us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 782.489ms, non-child: 14.853us, % non-child: 0.00%) - ConvertRowBatchTime: 4.109us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 116.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 782.478ms - DataArrivalTimer: 782.475ms SenderSide: - DeserializeRowBatchTimer: 9.514us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s020ms, non-child: 4s020ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:13/2.88 GB 7:16/3.96 GB 2:19/4.40 GB 1:13/3.14 GB 4:13/3.12 GB 6:14/3.35 GB 3:14/3.47 GB 0:24/5.61 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s815ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:25 BytesRead(8s000ms): 59.81 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 159.51 MB, 168.60 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB, 207.99 MB - FooterProcessingTime: (Avg: 670.593us ; Min: 433.523us ; Max: 1.228ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.51 - BytesRead: 207.99 MB (218088865) - BytesReadDataNodeCache: 0 - BytesReadLocal: 207.99 MB (218088865) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 207.99 MB (218088865) - CachedFileHandlesHitCount: 41 (41) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s056ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 203.19 MB (213059245) - PerReadThreadRawHdfsThroughput: 1007.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.008ms - RowBatchQueuePutWaitTime: 23m - RowsRead: 22.77M (22767166) - RowsReturned: 22.77M (22765127) - RowsReturnedRate: 5.66 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 15.41K (15410) - ScannerThreadsTotalWallClockTime: 25m32s - MaterializeTupleTime(*): 3s741ms - ScannerThreadsSysTime: 22s669ms - ScannerThreadsUserTime: 2m1s - ScannerThreadsVoluntaryContextSwitches: 2.75M (2752015) - TotalRawHdfsReadTime(*): 206.442ms - TotalReadThroughput: 487.36 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.96K (83959) - Rows rejected: 2.04K (2039) - Rows total: 22.77M (22767166) Filter 5 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 22.77M (22765127) Filter 6 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 22.77M (22765127) Filter 7 (2.00 MB): - Rows processed: 37.89K (37888) - Rows rejected: 0 (0) - Rows total: 22.77M (22765127) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 22.77M (22765127) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 121 (121) - Files total: 126 (126) - RowGroups processed: 22.23K (22231) - RowGroups rejected: 0 (0) - RowGroups total: 22.23K (22231) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 22.77M (22765127) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000db (host=foo.232.12:22000):(Total: 7m21s, non-child: 6m30s, % non-child: 88.47%) Hdfs split stats (:<# splits>/): 5:14/3.38 GB 6:14/3.33 GB 7:14/3.37 GB 2:14/3.47 GB 4:13/2.92 GB 1:18/4.46 GB 0:25/5.71 GB 3:17/3.70 GB Filter 0 arrival: 1s583ms Filter 9 arrival: 1s694ms Filter 8 arrival: 22s323ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 127.95 MB, 358.16 MB, 363.78 MB, 380.70 MB, 380.70 MB, 380.70 MB, 380.70 MB, 380.70 MB, 380.70 MB, 380.70 MB, 380.70 MB, 379.59 MB, 378.22 MB, 378.08 MB, 378.11 MB, 378.21 MB, 378.26 MB, 378.19 MB, 378.17 MB, 378.19 MB, 378.27 MB, 378.23 MB, 361.39 MB, 346.45 MB, 346.38 MB, 346.43 MB, 346.37 MB, 346.28 MB, 346.39 MB, 346.34 MB, 346.44 MB, 346.35 MB, 346.43 MB, 346.36 MB, 346.48 MB, 346.33 MB, 346.24 MB, 346.32 MB, 299.42 MB, 289.06 MB, 289.02 MB, 289.14 MB, 288.99 MB, 289.12 MB, 289.05 MB, 289.11 MB, 288.93 MB, 289.13 MB, 289.13 MB, 282.02 MB, 281.00 MB, 281.13 MB, 257.70 MB, 188.01 MB, 5.15 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 1 - AverageThreadTokens: 4.62 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.51 MB (400045152) - PerHostPeakMemUsage: 1.39 GB (1491728620) - RowsProduced: 19.77M (19773567) - TotalNetworkReceiveTime: 22s722ms - TotalNetworkSendTime: 6m8s - TotalStorageWaitTime: 150.160ms - TotalThreadsInvoluntaryContextSwitches: 8.43K (8433) - TotalThreadsTotalWallClockTime: 33m57s - TotalThreadsSysTime: 3s547ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 213.22K (213217) Fragment Instance Lifecycle Timings: - ExecTime: 6m58s - ExecTreeExecTime: 4s469ms - OpenTime: 22s329ms - ExecTreeOpenTime: 21s843ms - PrepareTime: 40.493ms - ExecTreePrepareTime: 1.342ms DataStreamSender (dst_id=19):(Total: 24s069ms, non-child: 24s069ms, % non-child: 100.00%) - BytesSent: 2.69 GB (2887520407) - OverallThroughput: 114.41 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 19.77M (19773567) - SerializeBatchTime: 24s044ms - UncompressedRowBatchSize: 2.69 GB (2887520407) CodeGen:(Total: 511.010ms, non-child: 511.010ms, % non-child: 100.00%) - CodegenTime: 1.923ms - CompileTime: 154.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 329.779ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.906ms HASH_JOIN_NODE (id=9):(Total: 26s292ms, non-child: 3s793ms, % non-child: 14.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 265.709ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 19.77M (19773567) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s469ms - RowsReturned: 19.77M (19773567) - RowsReturnedRate: 752.07 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.003ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 771.564us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.953ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s566ms, non-child: 17.600ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.703ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.42 K/sec RecvrSide: BytesReceived(8s000ms): 3.47 MB, 27.50 MB, 32.73 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s743ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s552ms - DataArrivalTimer: 21s549ms SenderSide: - DeserializeRowBatchTimer: 174.226ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s497ms, non-child: 761.181ms, % non-child: 13.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 374.005us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 19.77M (19773567) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 713.799ms - RowsReturned: 19.77M (19773567) - RowsReturnedRate: 3.60 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 55.545us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 112.548us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.789us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s169ms, non-child: 13.668us, % non-child: 0.00%) - ConvertRowBatchTime: 4.051us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 77.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s169ms - DataArrivalTimer: 1s169ms SenderSide: - DeserializeRowBatchTimer: 88.435us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s566ms, non-child: 3s566ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/3.38 GB 6:14/3.33 GB 7:14/3.37 GB 2:14/3.47 GB 4:13/2.92 GB 1:18/4.46 GB 0:25/5.71 GB 3:17/3.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s373ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 66.19 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB, 176.50 MB - FooterProcessingTime: (Avg: 480.806us ; Min: 283.075us ; Max: 912.802us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.65 - BytesRead: 176.50 MB (185069579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 176.50 MB (185069579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 176.50 MB (185069579) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 922.900ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.16 MB (229804101) - PerReadThreadRawHdfsThroughput: 938.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.660ms - RowBatchQueuePutWaitTime: 25m56s - RowsRead: 19.78M (19775120) - RowsReturned: 19.77M (19773567) - RowsReturnedRate: 5.54 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1749) - ScannerThreadsTotalWallClockTime: 26m13s - MaterializeTupleTime(*): 3s136ms - ScannerThreadsSysTime: 1s856ms - ScannerThreadsUserTime: 15s413ms - ScannerThreadsVoluntaryContextSwitches: 191.91K (191907) - TotalRawHdfsReadTime(*): 188.027ms - TotalReadThroughput: 419.33 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.09K (67089) - Rows rejected: 1.55K (1553) - Rows total: 19.78M (19775120) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.77M (19773567) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.77M (19773567) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.77M (19773567) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 19.77M (19773567) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 19.31K (19311) - RowGroups rejected: 0 (0) - RowGroups total: 19.31K (19311) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.77M (19773567) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000fc (host=foo.232.33:22000):(Total: 7m18s, non-child: 6m27s, % non-child: 88.21%) Hdfs split stats (:<# splits>/): 6:17/4.19 GB 7:18/4.16 GB 0:8/1.90 GB 4:21/5.06 GB 3:12/2.68 GB 5:15/3.25 GB 2:22/5.29 GB 1:18/4.06 GB Filter 0 arrival: 1s129ms Filter 9 arrival: 1s703ms Filter 8 arrival: 21s552ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 135.47 MB, 376.42 MB, 383.39 MB, 398.70 MB, 398.70 MB, 398.70 MB, 398.70 MB, 398.70 MB, 398.70 MB, 398.70 MB, 398.70 MB, 397.52 MB, 396.53 MB, 396.48 MB, 396.46 MB, 396.41 MB, 396.53 MB, 396.43 MB, 396.48 MB, 396.53 MB, 396.56 MB, 396.48 MB, 365.58 MB, 364.65 MB, 364.63 MB, 364.66 MB, 364.67 MB, 364.54 MB, 364.59 MB, 364.61 MB, 364.52 MB, 364.60 MB, 364.67 MB, 364.73 MB, 364.69 MB, 355.67 MB, 334.80 MB, 332.84 MB, 332.86 MB, 332.77 MB, 332.77 MB, 332.79 MB, 332.69 MB, 332.85 MB, 332.84 MB, 332.25 MB, 324.80 MB, 320.76 MB, 316.79 MB, 316.90 MB, 316.80 MB, 310.34 MB, 260.35 MB, 223.26 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 3 - AverageThreadTokens: 4.90 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 399.89 MB (419315846) - PerHostPeakMemUsage: 1.43 GB (1538772744) - RowsProduced: 21.60M (21601433) - TotalNetworkReceiveTime: 21s968ms - TotalNetworkSendTime: 6m5s - TotalStorageWaitTime: 147.613ms - TotalThreadsInvoluntaryContextSwitches: 9.09K (9089) - TotalThreadsTotalWallClockTime: 35m52s - TotalThreadsSysTime: 3s841ms - TotalThreadsUserTime: 1m5s - TotalThreadsVoluntaryContextSwitches: 269.18K (269178) Fragment Instance Lifecycle Timings: - ExecTime: 6m57s - ExecTreeExecTime: 4s819ms - OpenTime: 21s569ms - ExecTreeOpenTime: 21s088ms - PrepareTime: 45.274ms - ExecTreePrepareTime: 1.344ms DataStreamSender (dst_id=19):(Total: 25s372ms, non-child: 25s372ms, % non-child: 100.00%) - BytesSent: 2.94 GB (3156478169) - OverallThroughput: 118.64 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 21.60M (21601433) - SerializeBatchTime: 25s349ms - UncompressedRowBatchSize: 2.94 GB (3156478169) CodeGen:(Total: 504.590ms, non-child: 504.590ms, % non-child: 100.00%) - CodegenTime: 1.580ms - CompileTime: 163.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 315.543ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.995ms HASH_JOIN_NODE (id=9):(Total: 25s885ms, non-child: 4s043ms, % non-child: 15.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 280.184ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.60M (21601433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s703ms - RowsReturned: 21.60M (21601433) - RowsReturnedRate: 834.51 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 227.845ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 509.127us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.540ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s795ms, non-child: 17.026ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.775ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.21 K/sec RecvrSide: BytesReceived(8s000ms): 3.94 MB, 27.94 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s291ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s781ms - DataArrivalTimer: 20s779ms SenderSide: - DeserializeRowBatchTimer: 179.326ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s620ms, non-child: 861.524ms, % non-child: 15.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 434.620us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.60M (21601433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 805.905ms - RowsReturned: 21.60M (21601433) - RowsReturnedRate: 3.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 62.885us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 130.232us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.189us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s186ms, non-child: 22.112us, % non-child: 0.00%) - ConvertRowBatchTime: 12.854us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 76.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s186ms - DataArrivalTimer: 1s186ms SenderSide: - DeserializeRowBatchTimer: 53.702us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s572ms, non-child: 3s572ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:17/4.19 GB 7:18/4.16 GB 0:8/1.90 GB 4:21/5.06 GB 3:12/2.68 GB 5:15/3.25 GB 2:22/5.29 GB 1:18/4.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s374ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:20 BytesRead(8s000ms): 71.95 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB, 191.86 MB - FooterProcessingTime: (Avg: 528.045us ; Min: 287.766us ; Max: 948.504us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 191.86 MB (201176666) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.86 MB (201176666) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.86 MB (201176666) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 994.714ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.41 MB (248938929) - PerReadThreadRawHdfsThroughput: 896.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.430ms - RowBatchQueuePutWaitTime: 27m48s - RowsRead: 21.60M (21603062) - RowsReturned: 21.60M (21601433) - RowsReturnedRate: 6.05 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 1.96K (1956) - ScannerThreadsTotalWallClockTime: 28m11s - MaterializeTupleTime(*): 3s471ms - ScannerThreadsSysTime: 2s065ms - ScannerThreadsUserTime: 16s477ms - ScannerThreadsVoluntaryContextSwitches: 247.53K (247532) - TotalRawHdfsReadTime(*): 214.093ms - TotalReadThroughput: 453.20 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.17K (67165) - Rows rejected: 1.63K (1629) - Rows total: 21.60M (21603062) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 21.60M (21601433) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 21.60M (21601433) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 21.60M (21601433) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.60M (21601433) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 127 (127) - Files total: 131 (131) - RowGroups processed: 21.09K (21094) - RowGroups rejected: 0 (0) - RowGroups total: 21.09K (21094) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.60M (21601433) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000e6 (host=foo.232.39:22000):(Total: 7m8s, non-child: 6m17s, % non-child: 88.07%) Hdfs split stats (:<# splits>/): 7:12/2.97 GB 2:10/2.48 GB 5:21/4.45 GB 6:19/4.52 GB 3:17/3.98 GB 4:13/3.19 GB 1:19/4.53 GB 0:17/3.97 GB Filter 0 arrival: 946ms Filter 9 arrival: 1s259ms Filter 8 arrival: 20s983ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 121.72 MB, 316.84 MB, 325.05 MB, 338.74 MB, 338.74 MB, 338.74 MB, 338.74 MB, 338.74 MB, 338.74 MB, 338.74 MB, 338.74 MB, 337.56 MB, 336.78 MB, 336.78 MB, 337.03 MB, 336.90 MB, 336.88 MB, 336.96 MB, 334.33 MB, 314.00 MB, 312.98 MB, 313.03 MB, 313.03 MB, 312.97 MB, 313.03 MB, 313.06 MB, 313.06 MB, 299.14 MB, 289.14 MB, 289.07 MB, 289.07 MB, 289.06 MB, 289.13 MB, 288.77 MB, 281.24 MB, 257.58 MB, 246.67 MB, 246.62 MB, 235.43 MB, 221.52 MB, 221.47 MB, 221.64 MB, 216.48 MB, 213.51 MB, 213.48 MB, 213.69 MB, 213.55 MB, 206.58 MB, 205.55 MB, 205.50 MB, 205.56 MB, 205.49 MB, 194.39 MB ThreadUsage(8s000ms): 3, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.64 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.13 MB (356656128) - PerHostPeakMemUsage: 1.33 GB (1428372172) - RowsProduced: 21.30M (21299088) - TotalNetworkReceiveTime: 20s980ms - TotalNetworkSendTime: 5m57s - TotalStorageWaitTime: 124.994ms - TotalThreadsInvoluntaryContextSwitches: 19.79K (19791) - TotalThreadsTotalWallClockTime: 26m2s - TotalThreadsSysTime: 2s893ms - TotalThreadsUserTime: 2m47s - TotalThreadsVoluntaryContextSwitches: 41.55K (41549) Fragment Instance Lifecycle Timings: - ExecTime: 6m47s - ExecTreeExecTime: 4s622ms - OpenTime: 20s991ms - ExecTreeOpenTime: 20s529ms - PrepareTime: 41.418ms - ExecTreePrepareTime: 1.129ms DataStreamSender (dst_id=19):(Total: 25s530ms, non-child: 25s530ms, % non-child: 100.00%) - BytesSent: 2.89 GB (3102160526) - OverallThroughput: 115.88 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 21.30M (21299088) - SerializeBatchTime: 25s506ms - UncompressedRowBatchSize: 2.89 GB (3102160526) CodeGen:(Total: 490.012ms, non-child: 490.012ms, % non-child: 100.00%) - CodegenTime: 1.534ms - CompileTime: 150.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 310.247ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.809ms HASH_JOIN_NODE (id=9):(Total: 25s129ms, non-child: 3s922ms, % non-child: 15.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 279.416ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.30M (21299088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s589ms - RowsReturned: 21.30M (21299088) - RowsReturnedRate: 847.56 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.497ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 545.740us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.168ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s237ms, non-child: 17.046ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.790ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.83 K/sec RecvrSide: BytesReceived(8s000ms): 4.70 MB, 28.36 MB, 32.82 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s122ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s222ms - DataArrivalTimer: 20s220ms SenderSide: - DeserializeRowBatchTimer: 188.572ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s551ms, non-child: 792.635ms, % non-child: 14.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 320.262us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.30M (21299088) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 738.565ms - RowsReturned: 21.30M (21299088) - RowsReturnedRate: 3.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 55.240us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 62.970us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 90.007us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 757.637ms, non-child: 10.127us, % non-child: 0.00%) - ConvertRowBatchTime: 2.732us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 120.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 757.629ms - DataArrivalTimer: 757.628ms SenderSide: - DeserializeRowBatchTimer: 18.760us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s001ms, non-child: 4s001ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:12/2.97 GB 2:10/2.48 GB 5:21/4.45 GB 6:19/4.52 GB 3:17/3.98 GB 4:13/3.19 GB 1:19/4.53 GB 0:17/3.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s814ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(8s000ms): 52.81 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 140.83 MB, 181.41 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB, 187.20 MB - FooterProcessingTime: (Avg: 586.034us ; Min: 386.685us ; Max: 833.698us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.62 - BytesRead: 187.20 MB (196295219) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.20 MB (196295219) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.20 MB (196295219) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 969.752ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.83 MB (186467178) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.373ms - RowBatchQueuePutWaitTime: 16m32s - RowsRead: 21.30M (21300581) - RowsReturned: 21.30M (21299088) - RowsReturnedRate: 5.32 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 12.79K (12787) - ScannerThreadsTotalWallClockTime: 18m32s - MaterializeTupleTime(*): 3s414ms - ScannerThreadsSysTime: 1s113ms - ScannerThreadsUserTime: 1m58s - ScannerThreadsVoluntaryContextSwitches: 20.94K (20943) - TotalRawHdfsReadTime(*): 153.757ms - TotalReadThroughput: 451.58 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.03K (67029) - Rows rejected: 1.49K (1493) - Rows total: 21.30M (21300581) Filter 5 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 21.30M (21299088) Filter 6 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 21.30M (21299088) Filter 7 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 21.30M (21299088) Filter 8 (256.00 KB): - Rows processed: 53.25K (53248) - Rows rejected: 0 (0) - Rows total: 21.30M (21299088) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 20.80K (20800) - RowGroups rejected: 0 (0) - RowGroups total: 20.80K (20800) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.30M (21299088) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000b7 (host=foo.232.22:22000):(Total: 7m7s, non-child: 6m15s, % non-child: 87.95%) Hdfs split stats (:<# splits>/): 3:19/4.64 GB 4:18/4.37 GB 5:14/3.47 GB 6:15/3.71 GB 2:18/4.05 GB 0:6/1.49 GB 7:23/5.70 GB 1:11/2.72 GB Filter 0 arrival: 1s458ms Filter 9 arrival: 1s802ms Filter 8 arrival: 20s689ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 126.11 MB, 374.09 MB, 382.04 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.99 MB, 394.67 MB, 394.13 MB, 394.07 MB, 394.11 MB, 394.07 MB, 394.17 MB, 394.13 MB, 394.26 MB, 394.10 MB, 393.75 MB, 369.79 MB, 362.43 MB, 362.31 MB, 362.28 MB, 362.34 MB, 362.30 MB, 362.26 MB, 362.25 MB, 362.23 MB, 362.28 MB, 362.34 MB, 362.27 MB, 362.20 MB, 354.26 MB, 331.42 MB, 330.52 MB, 330.47 MB, 330.46 MB, 330.32 MB, 330.35 MB, 330.50 MB, 330.37 MB, 330.42 MB, 330.48 MB, 330.23 MB, 330.28 MB, 330.27 MB, 330.39 MB, 330.35 MB, 330.41 MB, 326.11 MB, 182.05 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 2 - AverageThreadTokens: 4.94 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.49 MB (416794741) - PerHostPeakMemUsage: 1.42 GB (1527033436) - RowsProduced: 21.68M (21681538) - TotalNetworkReceiveTime: 21s188ms - TotalNetworkSendTime: 5m53s - TotalStorageWaitTime: 150.910ms - TotalThreadsInvoluntaryContextSwitches: 7.87K (7872) - TotalThreadsTotalWallClockTime: 35m11s - TotalThreadsSysTime: 2s717ms - TotalThreadsUserTime: 56s906ms - TotalThreadsVoluntaryContextSwitches: 66.38K (66375) Fragment Instance Lifecycle Timings: - ExecTime: 6m46s - ExecTreeExecTime: 4s891ms - OpenTime: 20s701ms - ExecTreeOpenTime: 20s211ms - PrepareTime: 40.764ms - ExecTreePrepareTime: 1.319ms DataStreamSender (dst_id=19):(Total: 25s908ms, non-child: 25s908ms, % non-child: 100.00%) - BytesSent: 2.95 GB (3165044860) - OverallThroughput: 116.50 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 21.68M (21681538) - SerializeBatchTime: 25s886ms - UncompressedRowBatchSize: 2.95 GB (3165044860) CodeGen:(Total: 515.270ms, non-child: 515.270ms, % non-child: 100.00%) - CodegenTime: 1.740ms - CompileTime: 150.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 338.591ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.304ms HASH_JOIN_NODE (id=9):(Total: 25s078ms, non-child: 4s151ms, % non-child: 16.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 270.579ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.68M (21681538) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s822ms - RowsReturned: 21.68M (21681538) - RowsReturnedRate: 864.56 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.188ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 557.806us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.652ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s929ms, non-child: 17.454ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.706ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.18 K/sec RecvrSide: BytesReceived(8s000ms): 3.13 MB, 27.38 MB, 32.75 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s608ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s915ms - DataArrivalTimer: 19s912ms SenderSide: - DeserializeRowBatchTimer: 294.357ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s565ms, non-child: 809.082ms, % non-child: 14.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 486.095us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.68M (21681538) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 756.430ms - RowsReturned: 21.68M (21681538) - RowsReturnedRate: 3.90 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.877us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 124.796us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.958us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s273ms, non-child: 14.169us, % non-child: 0.00%) - ConvertRowBatchTime: 4.273us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 71.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s273ms - DataArrivalTimer: 1s273ms SenderSide: - DeserializeRowBatchTimer: 92.547us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s483ms, non-child: 3s483ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:19/4.64 GB 4:18/4.37 GB 5:14/3.47 GB 6:15/3.71 GB 2:18/4.05 GB 0:6/1.49 GB 7:23/5.70 GB 1:11/2.72 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s271ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:120 PARQUET/SNAPPY:20 BytesRead(8s000ms): 70.52 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB, 188.06 MB - FooterProcessingTime: (Avg: 475.912us ; Min: 316.660us ; Max: 622.803us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.94 - BytesRead: 188.06 MB (197191948) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.06 MB (197191948) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.06 MB (197191948) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 978.466ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.09 MB (246510412) - PerReadThreadRawHdfsThroughput: 886.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.008ms - RowBatchQueuePutWaitTime: 27m32s - RowsRead: 21.68M (21683115) - RowsReturned: 21.68M (21681538) - RowsReturnedRate: 6.22 M/sec - ScanRangesComplete: 124 (124) - ScannerThreadsInvoluntaryContextSwitches: 702 (702) - ScannerThreadsTotalWallClockTime: 27m42s - MaterializeTupleTime(*): 3s546ms - ScannerThreadsSysTime: 897.862ms - ScannerThreadsUserTime: 6s988ms - ScannerThreadsVoluntaryContextSwitches: 45.23K (45228) - TotalRawHdfsReadTime(*): 212.161ms - TotalReadThroughput: 456.33 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.11K (67113) - Rows rejected: 1.58K (1577) - Rows total: 21.68M (21683115) Filter 5 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 21.68M (21681538) Filter 6 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 21.68M (21681538) Filter 7 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 21.68M (21681538) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.68M (21681538) Filter 9 (8.00 KB): - Files processed: 124 (124) - Files rejected: 120 (120) - Files total: 124 (124) - RowGroups processed: 21.17K (21172) - RowGroups rejected: 0 (0) - RowGroups total: 21.17K (21172) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.68M (21681538) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000fb (host=foo.232.29:22000):(Total: 6m57s, non-child: 6m7s, % non-child: 87.94%) Hdfs split stats (:<# splits>/): 0:12/2.97 GB 5:21/4.98 GB 1:18/3.93 GB 7:6/1.40 GB 6:16/3.65 GB 2:19/4.45 GB 4:16/3.88 GB 3:21/5.20 GB Filter 0 arrival: 1s137ms Filter 9 arrival: 1s449ms Filter 8 arrival: 20s956ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 140.40 MB, 368.41 MB, 376.90 MB, 390.75 MB, 390.75 MB, 390.75 MB, 390.75 MB, 390.75 MB, 390.75 MB, 390.75 MB, 390.75 MB, 389.48 MB, 388.40 MB, 388.49 MB, 388.40 MB, 388.51 MB, 388.55 MB, 388.55 MB, 388.49 MB, 388.49 MB, 384.05 MB, 359.05 MB, 356.59 MB, 356.64 MB, 356.64 MB, 356.64 MB, 356.57 MB, 356.54 MB, 356.58 MB, 356.61 MB, 356.60 MB, 356.69 MB, 356.53 MB, 356.61 MB, 356.68 MB, 340.27 MB, 332.73 MB, 324.77 MB, 324.80 MB, 324.92 MB, 324.87 MB, 321.32 MB, 316.78 MB, 311.90 MB, 290.37 MB, 290.43 MB, 279.87 MB, 274.39 MB, 274.36 MB, 248.69 MB, 225.29 MB, 118.38 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.81 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 391.82 MB (410849143) - PerHostPeakMemUsage: 1.40 GB (1507296406) - RowsProduced: 20.89M (20890527) - TotalNetworkReceiveTime: 21s172ms - TotalNetworkSendTime: 5m46s - TotalStorageWaitTime: 158.376ms - TotalThreadsInvoluntaryContextSwitches: 9.78K (9780) - TotalThreadsTotalWallClockTime: 33m30s - TotalThreadsSysTime: 4s225ms - TotalThreadsUserTime: 1m13s - TotalThreadsVoluntaryContextSwitches: 173.46K (173462) Fragment Instance Lifecycle Timings: - ExecTime: 6m36s - ExecTreeExecTime: 4s428ms - OpenTime: 20s962ms - ExecTreeOpenTime: 20s497ms - PrepareTime: 41.165ms - ExecTreePrepareTime: 1.048ms DataStreamSender (dst_id=19):(Total: 24s966ms, non-child: 24s966ms, % non-child: 100.00%) - BytesSent: 2.85 GB (3056861399) - OverallThroughput: 116.77 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 20.89M (20890527) - SerializeBatchTime: 24s939ms - UncompressedRowBatchSize: 2.85 GB (3056861399) CodeGen:(Total: 488.680ms, non-child: 488.680ms, % non-child: 100.00%) - CodegenTime: 1.663ms - CompileTime: 141.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 322.042ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.579ms HASH_JOIN_NODE (id=9):(Total: 24s903ms, non-child: 3s703ms, % non-child: 14.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 247.144ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 20.89M (20890527) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s400ms - RowsReturned: 20.89M (20890527) - RowsReturnedRate: 838.86 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 205.603ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 438.029us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.823ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s237ms, non-child: 16.741ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.937ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.83 K/sec RecvrSide: BytesReceived(8s000ms): 4.59 MB, 28.29 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s312ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s224ms - DataArrivalTimer: 20s221ms SenderSide: - DeserializeRowBatchTimer: 182.927ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s542ms, non-child: 777.935ms, % non-child: 14.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 1.083ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.89M (20890527) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 726.648ms - RowsReturned: 20.89M (20890527) - RowsReturnedRate: 3.77 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.825us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 576.892us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.877us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 947.269ms, non-child: 17.367us, % non-child: 0.00%) - ConvertRowBatchTime: 6.555us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 96.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 947.255ms - DataArrivalTimer: 947.252ms SenderSide: - DeserializeRowBatchTimer: 127.922us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s817ms, non-child: 3s817ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:12/2.97 GB 5:21/4.98 GB 1:18/3.93 GB 7:6/1.40 GB 6:16/3.65 GB 2:19/4.45 GB 4:16/3.88 GB 3:21/5.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s612ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 70.54 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB, 188.11 MB - FooterProcessingTime: (Avg: 585.059us ; Min: 212.727us ; Max: 1.309ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.80 - BytesRead: 188.11 MB (197247166) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.11 MB (197247166) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.11 MB (197247166) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 968.963ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 229.41 MB (240549959) - PerReadThreadRawHdfsThroughput: 1012.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.165ms - RowBatchQueuePutWaitTime: 25m36s - RowsRead: 20.89M (20892083) - RowsReturned: 20.89M (20890527) - RowsReturnedRate: 5.47 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.90K (2895) - ScannerThreadsTotalWallClockTime: 26m10s - MaterializeTupleTime(*): 3s333ms - ScannerThreadsSysTime: 2s494ms - ScannerThreadsUserTime: 25s666ms - ScannerThreadsVoluntaryContextSwitches: 153.07K (153072) - TotalRawHdfsReadTime(*): 185.749ms - TotalReadThroughput: 466.40 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.09K (67092) - Rows rejected: 1.56K (1556) - Rows total: 20.89M (20892083) Filter 5 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 20.89M (20890527) Filter 6 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 20.89M (20890527) Filter 7 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 20.89M (20890527) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 20.89M (20890527) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 20.40K (20400) - RowGroups rejected: 0 (0) - RowGroups total: 20.40K (20400) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.89M (20890527) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000f1 (host=foo.221.42:22000):(Total: 6m39s, non-child: 5m48s, % non-child: 87.29%) Hdfs split stats (:<# splits>/): 0:20/4.92 GB 3:17/4.08 GB 1:18/4.05 GB 5:14/3.37 GB 7:12/2.84 GB 6:14/3.47 GB 4:14/2.77 GB 2:22/5.02 GB Filter 9 arrival: 1s426ms Filter 0 arrival: 1s724ms Filter 8 arrival: 21s110ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 126.14 MB, 374.46 MB, 382.76 MB, 396.42 MB, 396.42 MB, 396.42 MB, 396.42 MB, 396.42 MB, 396.42 MB, 396.42 MB, 396.42 MB, 395.10 MB, 394.45 MB, 394.43 MB, 394.53 MB, 394.40 MB, 394.48 MB, 394.48 MB, 394.49 MB, 394.49 MB, 394.37 MB, 374.10 MB, 362.67 MB, 362.73 MB, 362.58 MB, 362.73 MB, 362.63 MB, 362.67 MB, 362.61 MB, 362.52 MB, 362.61 MB, 362.62 MB, 362.58 MB, 351.71 MB, 335.83 MB, 330.81 MB, 330.91 MB, 330.85 MB, 330.85 MB, 330.98 MB, 330.71 MB, 330.85 MB, 330.87 MB, 330.89 MB, 330.85 MB, 330.87 MB, 328.13 MB, 313.12 MB, 281.86 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 4.93 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.81 MB (417131015) - PerHostPeakMemUsage: 1.43 GB (1539857554) - RowsProduced: 21.23M (21226138) - TotalNetworkReceiveTime: 21s239ms - TotalNetworkSendTime: 5m27s - TotalStorageWaitTime: 130.815ms - TotalThreadsInvoluntaryContextSwitches: 7.76K (7761) - TotalThreadsTotalWallClockTime: 32m52s - TotalThreadsSysTime: 3s095ms - TotalThreadsUserTime: 56s466ms - TotalThreadsVoluntaryContextSwitches: 162.15K (162147) Fragment Instance Lifecycle Timings: - ExecTime: 6m18s - ExecTreeExecTime: 4s685ms - OpenTime: 21s119ms - ExecTreeOpenTime: 20s632ms - PrepareTime: 46.676ms - ExecTreePrepareTime: 1.600ms DataStreamSender (dst_id=19):(Total: 25s006ms, non-child: 25s006ms, % non-child: 100.00%) - BytesSent: 2.89 GB (3102784973) - OverallThroughput: 118.33 MB/sec - PeakMemoryUsage: 7.96 MB (8343584) - RowsReturned: 21.23M (21226138) - SerializeBatchTime: 24s980ms - UncompressedRowBatchSize: 2.89 GB (3102784973) CodeGen:(Total: 512.123ms, non-child: 512.123ms, % non-child: 100.00%) - CodegenTime: 1.876ms - CompileTime: 155.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 330.555ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.725ms HASH_JOIN_NODE (id=9):(Total: 25s296ms, non-child: 3s969ms, % non-child: 15.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 268.526ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.23M (21226138) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s636ms - RowsReturned: 21.23M (21226138) - RowsReturnedRate: 839.11 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.947ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 527.226us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.742ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s352ms, non-child: 17.347ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.791ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.70 K/sec RecvrSide: BytesReceived(8s000ms): 2.93 MB, 27.11 MB, 32.71 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s874ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s338ms - DataArrivalTimer: 20s335ms SenderSide: - DeserializeRowBatchTimer: 170.074ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s532ms, non-child: 806.568ms, % non-child: 14.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 400.823us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.23M (21226138) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 757.696ms - RowsReturned: 21.23M (21226138) - RowsReturnedRate: 3.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 46.845us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 88.304us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.379us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 900.898ms, non-child: 11.076us, % non-child: 0.00%) - ConvertRowBatchTime: 2.156us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 101.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 900.890ms - DataArrivalTimer: 900.888ms SenderSide: - DeserializeRowBatchTimer: 89.356us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s825ms, non-child: 3s825ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:20/4.92 GB 3:17/4.08 GB 1:18/4.05 GB 5:14/3.37 GB 7:12/2.84 GB 6:14/3.47 GB 4:14/2.77 GB 2:22/5.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s635ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:20 BytesRead(8s000ms): 72.07 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB, 192.18 MB - FooterProcessingTime: (Avg: 533.600us ; Min: 338.876us ; Max: 990.704us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 192.18 MB (201518523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 192.18 MB (201518523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 192.18 MB (201518523) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 982.765ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.41 MB (246845521) - PerReadThreadRawHdfsThroughput: 986.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.043ms - RowBatchQueuePutWaitTime: 25m41s - RowsRead: 21.23M (21227715) - RowsReturned: 21.23M (21226138) - RowsReturnedRate: 5.55 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 849 (849) - ScannerThreadsTotalWallClockTime: 25m51s - MaterializeTupleTime(*): 3s449ms - ScannerThreadsSysTime: 1s439ms - ScannerThreadsUserTime: 8s278ms - ScannerThreadsVoluntaryContextSwitches: 141.67K (141666) - TotalRawHdfsReadTime(*): 194.783ms - TotalReadThroughput: 496.33 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.11K (67113) - Rows rejected: 1.58K (1577) - Rows total: 21.23M (21227715) Filter 5 (2.00 MB): - Rows processed: 8.19K (8192) - Rows rejected: 0 (0) - Rows total: 21.23M (21226138) Filter 6 (2.00 MB): - Rows processed: 8.19K (8192) - Rows rejected: 0 (0) - Rows total: 21.23M (21226138) Filter 7 (2.00 MB): - Rows processed: 8.19K (8192) - Rows rejected: 0 (0) - Rows total: 21.23M (21226138) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.23M (21226138) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 127 (127) - Files total: 131 (131) - RowGroups processed: 20.73K (20728) - RowGroups rejected: 0 (0) - RowGroups total: 20.73K (20728) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.23M (21226138) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000010a (host=foo.221.17:22000):(Total: 6m35s, non-child: 5m43s, % non-child: 86.91%) Hdfs split stats (:<# splits>/): 1:8/1.82 GB 2:21/4.63 GB 4:16/3.83 GB 0:22/5.18 GB 5:19/4.39 GB 6:12/2.93 GB 7:20/4.95 GB 3:11/2.59 GB Filter 9 arrival: 1s611ms Filter 0 arrival: 1s906ms Filter 8 arrival: 21s512ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 127.60 MB, 378.79 MB, 385.46 MB, 400.16 MB, 400.16 MB, 400.16 MB, 400.16 MB, 400.16 MB, 400.16 MB, 400.16 MB, 400.16 MB, 399.45 MB, 398.90 MB, 398.93 MB, 398.92 MB, 398.92 MB, 398.94 MB, 398.78 MB, 398.91 MB, 398.81 MB, 375.04 MB, 367.07 MB, 366.99 MB, 367.08 MB, 366.94 MB, 366.98 MB, 366.92 MB, 366.93 MB, 367.00 MB, 367.00 MB, 367.03 MB, 361.64 MB, 347.06 MB, 343.00 MB, 328.05 MB, 327.20 MB, 327.09 MB, 327.15 MB, 327.22 MB, 327.29 MB, 327.12 MB, 323.65 MB, 319.09 MB, 319.07 MB, 311.70 MB, 280.86 MB, 263.00 MB, 214.57 MB, 142.46 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.86 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 402.08 MB (421614743) - PerHostPeakMemUsage: 1.43 GB (1532785948) - RowsProduced: 21.36M (21356158) - TotalNetworkReceiveTime: 21s867ms - TotalNetworkSendTime: 5m21s - TotalStorageWaitTime: 139.604ms - TotalThreadsInvoluntaryContextSwitches: 9.95K (9945) - TotalThreadsTotalWallClockTime: 32m - TotalThreadsSysTime: 4s261ms - TotalThreadsUserTime: 1m14s - TotalThreadsVoluntaryContextSwitches: 211.58K (211584) Fragment Instance Lifecycle Timings: - ExecTime: 6m13s - ExecTreeExecTime: 4s532ms - OpenTime: 21s525ms - ExecTreeOpenTime: 21s063ms - PrepareTime: 47.403ms - ExecTreePrepareTime: 1.629ms DataStreamSender (dst_id=19):(Total: 25s644ms, non-child: 25s644ms, % non-child: 100.00%) - BytesSent: 2.90 GB (3114863625) - OverallThroughput: 115.84 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 21.36M (21356158) - SerializeBatchTime: 25s621ms - UncompressedRowBatchSize: 2.90 GB (3114863625) CodeGen:(Total: 491.650ms, non-child: 491.650ms, % non-child: 100.00%) - CodegenTime: 1.703ms - CompileTime: 142.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 317.258ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.859ms HASH_JOIN_NODE (id=9):(Total: 25s575ms, non-child: 3s832ms, % non-child: 14.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 275.738ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.36M (21356158) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s486ms - RowsReturned: 21.36M (21356158) - RowsReturnedRate: 835.01 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 218.737ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 486.649us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.161ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s775ms, non-child: 18.357ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.114ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.24 K/sec RecvrSide: BytesReceived(8s000ms): 2.78 MB, 27.02 MB, 32.71 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s081ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s760ms - DataArrivalTimer: 20s757ms SenderSide: - DeserializeRowBatchTimer: 238.553ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s553ms, non-child: 793.008ms, % non-child: 14.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 334.053us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.36M (21356158) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 741.302ms - RowsReturned: 21.36M (21356158) - RowsReturnedRate: 3.85 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.387us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.944us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.092us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s106ms, non-child: 13.134us, % non-child: 0.00%) - ConvertRowBatchTime: 3.826us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 82.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s106ms - DataArrivalTimer: 1s106ms SenderSide: - DeserializeRowBatchTimer: 76.729us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:8/1.82 GB 2:21/4.63 GB 4:16/3.83 GB 0:22/5.18 GB 5:19/4.39 GB 6:12/2.93 GB 7:20/4.95 GB 3:11/2.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s453ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 72.55 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB, 193.46 MB - FooterProcessingTime: (Avg: 654.159us ; Min: 518.270us ; Max: 880.651us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.86 - BytesRead: 193.46 MB (202857762) - BytesReadDataNodeCache: 0 - BytesReadLocal: 193.46 MB (202857762) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 193.46 MB (202857762) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 988.993ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 239.78 MB (251428640) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.658ms - RowBatchQueuePutWaitTime: 24m34s - RowsRead: 21.36M (21357788) - RowsReturned: 21.36M (21356158) - RowsReturnedRate: 5.84 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 2.92K (2917) - ScannerThreadsTotalWallClockTime: 25m3s - MaterializeTupleTime(*): 3s345ms - ScannerThreadsSysTime: 2s485ms - ScannerThreadsUserTime: 25s890ms - ScannerThreadsVoluntaryContextSwitches: 192.00K (192001) - TotalRawHdfsReadTime(*): 182.218ms - TotalReadThroughput: 507.96 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.17K (67166) - Rows rejected: 1.63K (1630) - Rows total: 21.36M (21357788) Filter 5 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 21.36M (21356158) Filter 6 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 21.36M (21356158) Filter 7 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 21.36M (21356158) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.36M (21356158) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 20.85K (20854) - RowGroups rejected: 0 (0) - RowGroups total: 20.85K (20854) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.36M (21356158) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000a6 (host=foo.232.25:22000):(Total: 6m25s, non-child: 5m37s, % non-child: 87.63%) Hdfs split stats (:<# splits>/): 7:13/3.15 GB 0:15/3.61 GB 3:18/4.29 GB 2:15/3.37 GB 6:13/2.94 GB 5:18/4.19 GB 1:13/3.15 GB 4:24/5.88 GB Filter 9 arrival: 1s115ms Filter 0 arrival: 1s415ms Filter 8 arrival: 19s760ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 106.68 MB, 359.27 MB, 369.39 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.11 MB, 379.15 MB, 379.20 MB, 379.29 MB, 379.33 MB, 379.27 MB, 379.42 MB, 379.25 MB, 379.25 MB, 379.20 MB, 379.33 MB, 370.93 MB, 347.55 MB, 347.48 MB, 347.57 MB, 347.59 MB, 347.46 MB, 347.37 MB, 347.61 MB, 347.42 MB, 347.46 MB, 347.50 MB, 347.52 MB, 347.61 MB, 347.50 MB, 332.23 MB, 294.59 MB, 289.43 MB, 289.31 MB, 289.27 MB, 289.34 MB, 289.35 MB, 289.29 MB, 289.28 MB, 289.37 MB, 286.29 MB, 280.80 MB, 148.32 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.71 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 382.57 MB (401152978) - PerHostPeakMemUsage: 1.41 GB (1513013883) - RowsProduced: 19.82M (19823807) - TotalNetworkReceiveTime: 19s596ms - TotalNetworkSendTime: 5m17s - TotalStorageWaitTime: 136.587ms - TotalThreadsInvoluntaryContextSwitches: 7.62K (7621) - TotalThreadsTotalWallClockTime: 30m13s - TotalThreadsSysTime: 2s149ms - TotalThreadsUserTime: 51s997ms - TotalThreadsVoluntaryContextSwitches: 51.66K (51657) Fragment Instance Lifecycle Timings: - ExecTime: 6m5s - ExecTreeExecTime: 4s338ms - OpenTime: 19s761ms - ExecTreeOpenTime: 19s285ms - PrepareTime: 43.522ms - ExecTreePrepareTime: 1.877ms DataStreamSender (dst_id=19):(Total: 23s572ms, non-child: 23s572ms, % non-child: 100.00%) - BytesSent: 2.70 GB (2895626256) - OverallThroughput: 117.15 MB/sec - PeakMemoryUsage: 7.90 MB (8286240) - RowsReturned: 19.82M (19823807) - SerializeBatchTime: 23s551ms - UncompressedRowBatchSize: 2.70 GB (2895626256) CodeGen:(Total: 503.167ms, non-child: 503.167ms, % non-child: 100.00%) - CodegenTime: 1.645ms - CompileTime: 145.812ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 328.529ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.273ms HASH_JOIN_NODE (id=9):(Total: 23s602ms, non-child: 3s651ms, % non-child: 15.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.969ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 19.82M (19823807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s335ms - RowsReturned: 19.82M (19823807) - RowsReturnedRate: 839.90 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.247ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 429.026us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.675ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s012ms, non-child: 17.372ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.155ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.30 K/sec RecvrSide: BytesReceived(8s000ms): 2.97 MB, 27.21 MB, 32.73 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s581ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s997ms - DataArrivalTimer: 18s995ms SenderSide: - DeserializeRowBatchTimer: 173.565ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s504ms, non-child: 767.937ms, % non-child: 13.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 731.659us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 19.82M (19823807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 718.851ms - RowsReturned: 19.82M (19823807) - RowsReturnedRate: 3.60 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.528us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 118.308us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.385us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 598.257ms, non-child: 23.497us, % non-child: 0.00%) - ConvertRowBatchTime: 3.034us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 152.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 598.238ms - DataArrivalTimer: 598.235ms SenderSide: - DeserializeRowBatchTimer: 125.646us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s138ms, non-child: 4s138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.15 GB 0:15/3.61 GB 3:18/4.29 GB 2:15/3.37 GB 6:13/2.94 GB 5:18/4.19 GB 1:13/3.15 GB 4:24/5.88 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s955ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 55.38 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB, 177.20 MB - FooterProcessingTime: (Avg: 382.981us ; Min: 248.375us ; Max: 540.778us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.69 - BytesRead: 177.20 MB (185809093) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.20 MB (185809093) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.20 MB (185809093) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 902.732ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 220.27 MB (230973410) - PerReadThreadRawHdfsThroughput: 1016.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.169ms - RowBatchQueuePutWaitTime: 23m18s - RowsRead: 19.83M (19825352) - RowsReturned: 19.82M (19823807) - RowsReturnedRate: 4.79 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.08K (1077) - ScannerThreadsTotalWallClockTime: 23m28s - MaterializeTupleTime(*): 3s123ms - ScannerThreadsSysTime: 570.910ms - ScannerThreadsUserTime: 6s970ms - ScannerThreadsVoluntaryContextSwitches: 32.40K (32399) - TotalRawHdfsReadTime(*): 174.281ms - TotalReadThroughput: 475.01 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.08K (67081) - Rows rejected: 1.54K (1545) - Rows total: 19.83M (19825352) Filter 5 (2.00 MB): - Rows processed: 26.62K (26624) - Rows rejected: 0 (0) - Rows total: 19.82M (19823807) Filter 6 (2.00 MB): - Rows processed: 26.62K (26624) - Rows rejected: 0 (0) - Rows total: 19.82M (19823807) Filter 7 (2.00 MB): - Rows processed: 26.62K (26624) - Rows rejected: 0 (0) - Rows total: 19.82M (19823807) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 19.82M (19823807) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 19.36K (19360) - RowGroups rejected: 0 (0) - RowGroups total: 19.36K (19360) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.82M (19823807) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000b0 (host=foo.221.11:22000):(Total: 6m23s, non-child: 5m30s, % non-child: 86.24%) Hdfs split stats (:<# splits>/): 0:18/4.10 GB 3:19/3.97 GB 7:21/4.97 GB 6:12/2.92 GB 5:9/2.01 GB 4:17/4.21 GB 1:16/3.57 GB 2:19/4.50 GB Filter 0 arrival: 1s971ms Filter 9 arrival: 2s715ms Filter 8 arrival: 20s547ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 108.62 MB, 350.39 MB, 358.69 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.02 MB, 369.69 MB, 370.37 MB, 370.48 MB, 370.47 MB, 370.42 MB, 370.50 MB, 370.44 MB, 360.49 MB, 338.61 MB, 340.29 MB, 350.51 MB, 350.49 MB, 350.56 MB, 350.52 MB, 350.52 MB, 350.48 MB, 350.50 MB, 350.56 MB, 350.62 MB, 344.60 MB, 330.18 MB, 326.66 MB, 326.66 MB, 326.12 MB, 318.63 MB, 318.68 MB, 318.67 MB, 318.72 MB, 318.76 MB, 318.71 MB, 318.67 MB, 318.74 MB, 318.76 MB, 318.68 MB, 303.37 MB, 249.23 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4 - AverageThreadTokens: 4.91 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 373.63 MB (391774860) - PerHostPeakMemUsage: 1.39 GB (1488551165) - RowsProduced: 23.05M (23049809) - TotalNetworkReceiveTime: 21s912ms - TotalNetworkSendTime: 5m7s - TotalStorageWaitTime: 162.924ms - TotalThreadsInvoluntaryContextSwitches: 8.45K (8454) - TotalThreadsTotalWallClockTime: 31m20s - TotalThreadsSysTime: 3s119ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 84.39K (84391) Fragment Instance Lifecycle Timings: - ExecTime: 6m2s - ExecTreeExecTime: 4s836ms - OpenTime: 20s549ms - ExecTreeOpenTime: 20s053ms - PrepareTime: 57.970ms - ExecTreePrepareTime: 1.307ms DataStreamSender (dst_id=19):(Total: 27s313ms, non-child: 27s313ms, % non-child: 100.00%) - BytesSent: 3.13 GB (3364767841) - OverallThroughput: 117.48 MB/sec - PeakMemoryUsage: 7.85 MB (8228896) - RowsReturned: 23.05M (23049809) - SerializeBatchTime: 27s291ms - UncompressedRowBatchSize: 3.13 GB (3364767841) CodeGen:(Total: 527.907ms, non-child: 527.907ms, % non-child: 100.00%) - CodegenTime: 1.851ms - CompileTime: 156.707ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 338.143ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.473ms HASH_JOIN_NODE (id=9):(Total: 24s867ms, non-child: 4s107ms, % non-child: 16.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 288.069ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 23.05M (23049809) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s747ms - RowsReturned: 23.05M (23049809) - RowsReturnedRate: 926.92 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 235.428ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 973.976us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.765ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s752ms, non-child: 18.736ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.487ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.39 K/sec RecvrSide: BytesReceived(8s000ms): 2.15 MB, 26.28 MB, 32.64 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s100ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s737ms - DataArrivalTimer: 19s734ms SenderSide: - DeserializeRowBatchTimer: 290.665ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s565ms, non-child: 833.222ms, % non-child: 14.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 540.655us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 23.05M (23049809) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 777.598ms - RowsReturned: 23.05M (23049809) - RowsReturnedRate: 4.14 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 51.368us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 163.206us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.341us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s174ms, non-child: 13.444us, % non-child: 0.00%) - ConvertRowBatchTime: 3.334us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 41.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s174ms - DataArrivalTimer: 2s174ms SenderSide: - DeserializeRowBatchTimer: 32.729us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s557ms, non-child: 2s557ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.10 GB 3:19/3.97 GB 7:21/4.97 GB 6:12/2.92 GB 5:9/2.01 GB 4:17/4.21 GB 1:16/3.57 GB 2:19/4.50 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s350ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:25 BytesRead(8s000ms): 60.94 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 162.50 MB, 166.22 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB, 192.28 MB - FooterProcessingTime: (Avg: 491.030us ; Min: 266.044us ; Max: 737.825us ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.90 - BytesRead: 192.28 MB (201616312) - BytesReadDataNodeCache: 0 - BytesReadLocal: 192.28 MB (201616312) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 192.28 MB (201616312) - CachedFileHandlesHitCount: 40 (40) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 998.209ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 211.39 MB (221662088) - PerReadThreadRawHdfsThroughput: 854.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.361ms - RowBatchQueuePutWaitTime: 24m23s - RowsRead: 23.05M (23051792) - RowsReturned: 23.05M (23049809) - RowsReturnedRate: 9.01 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 950 (950) - ScannerThreadsTotalWallClockTime: 24m35s - MaterializeTupleTime(*): 3s794ms - ScannerThreadsSysTime: 1s155ms - ScannerThreadsUserTime: 10s458ms - ScannerThreadsVoluntaryContextSwitches: 62.74K (62740) - TotalRawHdfsReadTime(*): 225.017ms - TotalReadThroughput: 520.19 KB/sec Filter 0 (8.00 KB): - Rows processed: 83.90K (83903) - Rows rejected: 1.98K (1983) - Rows total: 23.05M (23051792) Filter 5 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 23.05M (23049809) Filter 6 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 23.05M (23049809) Filter 7 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 23.05M (23049809) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 23.05M (23049809) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 126 (126) - Files total: 131 (131) - RowGroups processed: 22.51K (22508) - RowGroups rejected: 0 (0) - RowGroups total: 22.51K (22508) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 23.05M (23049809) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000eb (host=foo.232.30:22000):(Total: 6m18s, non-child: 5m31s, % non-child: 87.63%) Hdfs split stats (:<# splits>/): 5:8/1.98 GB 1:17/4.04 GB 6:15/3.18 GB 2:19/4.37 GB 7:17/4.12 GB 0:16/3.38 GB 4:16/3.87 GB 3:21/5.08 GB Filter 9 arrival: 1s079ms Filter 0 arrival: 1s169ms Filter 8 arrival: 19s301ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 128.63 MB, 358.16 MB, 369.69 MB, 379.35 MB, 379.35 MB, 379.35 MB, 379.35 MB, 379.35 MB, 379.35 MB, 379.35 MB, 379.35 MB, 378.32 MB, 378.22 MB, 378.15 MB, 378.19 MB, 378.16 MB, 378.18 MB, 378.16 MB, 378.22 MB, 373.18 MB, 346.37 MB, 346.34 MB, 346.45 MB, 346.41 MB, 346.37 MB, 346.34 MB, 346.31 MB, 346.37 MB, 346.43 MB, 325.78 MB, 312.99 MB, 310.49 MB, 291.62 MB, 289.22 MB, 289.19 MB, 289.18 MB, 289.11 MB, 289.21 MB, 289.24 MB, 289.14 MB, 289.01 MB, 289.19 MB, 289.20 MB, 285.63 MB, 281.12 MB, 258.09 MB, 198.56 MB ThreadUsage(8s000ms): 5, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.61 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.53 MB (400067062) - PerHostPeakMemUsage: 1.40 GB (1502874196) - RowsProduced: 19.77M (19773484) - TotalNetworkReceiveTime: 19s069ms - TotalNetworkSendTime: 5m12s - TotalStorageWaitTime: 154.357ms - TotalThreadsInvoluntaryContextSwitches: 8.03K (8025) - TotalThreadsTotalWallClockTime: 29m6s - TotalThreadsSysTime: 3s390ms - TotalThreadsUserTime: 58s667ms - TotalThreadsVoluntaryContextSwitches: 231.48K (231482) Fragment Instance Lifecycle Timings: - ExecTime: 5m59s - ExecTreeExecTime: 4s220ms - OpenTime: 19s295ms - ExecTreeOpenTime: 18s805ms - PrepareTime: 45.917ms - ExecTreePrepareTime: 1.575ms DataStreamSender (dst_id=19):(Total: 23s348ms, non-child: 23s348ms, % non-child: 100.00%) - BytesSent: 2.69 GB (2886847162) - OverallThroughput: 117.92 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 19.77M (19773484) - SerializeBatchTime: 23s328ms - UncompressedRowBatchSize: 2.69 GB (2886847162) CodeGen:(Total: 520.161ms, non-child: 520.161ms, % non-child: 100.00%) - CodegenTime: 1.645ms - CompileTime: 137.507ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 351.939ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.213ms HASH_JOIN_NODE (id=9):(Total: 23s006ms, non-child: 3s556ms, % non-child: 15.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 255.415ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 19.77M (19773484) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s251ms - RowsReturned: 19.77M (19773484) - RowsReturnedRate: 859.47 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 218.055ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 612.682us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.424ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s538ms, non-child: 17.737ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.828ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.92 K/sec RecvrSide: BytesReceived(8s000ms): 3.93 MB, 27.97 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s346ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s523ms - DataArrivalTimer: 18s520ms SenderSide: - DeserializeRowBatchTimer: 170.681ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s472ms, non-child: 750.262ms, % non-child: 13.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 539.886us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 19.77M (19773484) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 702.957ms - RowsReturned: 19.77M (19773484) - RowsReturnedRate: 3.61 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.619us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 143.486us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.819us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 545.879ms, non-child: 11.885us, % non-child: 0.00%) - ConvertRowBatchTime: 3.876us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 166.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 545.870ms - DataArrivalTimer: 545.868ms SenderSide: - DeserializeRowBatchTimer: 199.208us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s176ms, non-child: 4s176ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:8/1.98 GB 1:17/4.04 GB 6:15/3.18 GB 2:19/4.37 GB 7:17/4.12 GB 0:16/3.38 GB 4:16/3.87 GB 3:21/5.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s997ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(8s000ms): 64.57 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB, 172.17 MB - FooterProcessingTime: (Avg: 463.222us ; Min: 256.608us ; Max: 593.357us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.59 - BytesRead: 172.17 MB (180537466) - BytesReadDataNodeCache: 0 - BytesReadLocal: 172.17 MB (180537466) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 172.17 MB (180537466) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 885.205ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.15 MB (229798985) - PerReadThreadRawHdfsThroughput: 963.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.206ms - RowBatchQueuePutWaitTime: 21m57s - RowsRead: 19.78M (19775015) - RowsReturned: 19.77M (19773484) - RowsReturnedRate: 4.73 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.54K (1538) - ScannerThreadsTotalWallClockTime: 22m28s - MaterializeTupleTime(*): 3s122ms - ScannerThreadsSysTime: 1s834ms - ScannerThreadsUserTime: 14s412ms - ScannerThreadsVoluntaryContextSwitches: 212.65K (212646) - TotalRawHdfsReadTime(*): 178.788ms - TotalReadThroughput: 468.90 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.07K (67067) - Rows rejected: 1.53K (1531) - Rows total: 19.78M (19775015) Filter 5 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 19.77M (19773484) Filter 6 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 19.77M (19773484) Filter 7 (2.00 MB): - Rows processed: 47.10K (47104) - Rows rejected: 0 (0) - Rows total: 19.77M (19773484) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 19.77M (19773484) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 19.31K (19309) - RowGroups rejected: 0 (0) - RowGroups total: 19.31K (19309) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.77M (19773484) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000e1 (host=foo.232.44:22000):(Total: 6m11s, non-child: 5m26s, % non-child: 87.72%) Hdfs split stats (:<# splits>/): 3:8/1.90 GB 5:13/3.04 GB 1:18/4.32 GB 7:17/4.19 GB 0:12/2.81 GB 2:21/5.20 GB 6:22/4.98 GB 4:16/3.96 GB Filter 0 arrival: 892ms Filter 9 arrival: 1s024ms Filter 8 arrival: 20s712ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 121.34 MB, 315.82 MB, 325.57 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 336.23 MB, 335.89 MB, 335.78 MB, 335.86 MB, 335.81 MB, 335.93 MB, 335.86 MB, 335.87 MB, 335.93 MB, 330.38 MB, 315.41 MB, 311.99 MB, 311.91 MB, 311.90 MB, 311.95 MB, 311.98 MB, 312.01 MB, 311.91 MB, 311.43 MB, 299.02 MB, 295.97 MB, 296.00 MB, 290.51 MB, 288.10 MB, 288.14 MB, 287.94 MB, 287.94 MB, 288.04 MB, 287.97 MB, 288.16 MB, 288.03 MB, 285.49 MB, 226.61 MB, 205.28 MB, 129.13 MB ThreadUsage(8s000ms): 4, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 1 - AverageThreadTokens: 3.92 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.25 MB (355728394) - PerHostPeakMemUsage: 1.36 GB (1459149788) - RowsProduced: 17.20M (17204640) - TotalNetworkReceiveTime: 20s512ms - TotalNetworkSendTime: 5m7s - TotalStorageWaitTime: 73.223ms - TotalThreadsInvoluntaryContextSwitches: 8.24K (8243) - TotalThreadsTotalWallClockTime: 24m18s - TotalThreadsSysTime: 1s893ms - TotalThreadsUserTime: 1m4s - TotalThreadsVoluntaryContextSwitches: 34.18K (34178) Fragment Instance Lifecycle Timings: - ExecTime: 5m50s - ExecTreeExecTime: 3s818ms - OpenTime: 20s725ms - ExecTreeOpenTime: 20s276ms - PrepareTime: 40.722ms - ExecTreePrepareTime: 1.179ms DataStreamSender (dst_id=19):(Total: 21s082ms, non-child: 21s082ms, % non-child: 100.00%) - BytesSent: 2.33 GB (2504317176) - OverallThroughput: 113.29 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 17.20M (17204640) - SerializeBatchTime: 21s061ms - UncompressedRowBatchSize: 2.33 GB (2504317176) CodeGen:(Total: 476.082ms, non-child: 476.082ms, % non-child: 100.00%) - CodegenTime: 1.638ms - CompileTime: 141.441ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 306.681ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.473ms HASH_JOIN_NODE (id=9):(Total: 24s076ms, non-child: 3s232ms, % non-child: 13.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.298ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 17.20M (17204640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s921ms - RowsReturned: 17.20M (17204640) - RowsReturnedRate: 714.60 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.924ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 979.069us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.496ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s991ms, non-child: 17.687ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.739ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.11 K/sec RecvrSide: BytesReceived(8s000ms): 4.75 MB, 28.40 MB, 32.82 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s081ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s976ms - DataArrivalTimer: 19s973ms SenderSide: - DeserializeRowBatchTimer: 171.834ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s423ms, non-child: 686.571ms, % non-child: 12.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 351.026us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 17.20M (17204640) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 646.252ms - RowsReturned: 17.20M (17204640) - RowsReturnedRate: 3.17 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.995us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 110.158us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.311us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 536.177ms, non-child: 15.149us, % non-child: 0.00%) - ConvertRowBatchTime: 4.243us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 169.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 536.165ms - DataArrivalTimer: 536.162ms SenderSide: - DeserializeRowBatchTimer: 18.336us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s201ms, non-child: 4s201ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:8/1.90 GB 5:13/3.04 GB 1:18/4.32 GB 7:17/4.19 GB 0:12/2.81 GB 2:21/5.20 GB 6:22/4.98 GB 4:16/3.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s035ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 52.84 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB, 140.91 MB - FooterProcessingTime: (Avg: 413.881us ; Min: 291.920us ; Max: 481.552us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 140.91 MB (147752201) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.91 MB (147752201) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.91 MB (147752201) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 752.863ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 176.82 MB (185413588) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.200ms - RowBatchQueuePutWaitTime: 17m16s - RowsRead: 17.21M (17205806) - RowsReturned: 17.20M (17204640) - RowsReturnedRate: 4.10 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.42K (2418) - ScannerThreadsTotalWallClockTime: 17m46s - MaterializeTupleTime(*): 2s803ms - ScannerThreadsSysTime: 389.939ms - ScannerThreadsUserTime: 23s852ms - ScannerThreadsVoluntaryContextSwitches: 17.26K (17259) - TotalRawHdfsReadTime(*): 114.956ms - TotalReadThroughput: 394.77 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.32K (50318) - Rows rejected: 1.17K (1166) - Rows total: 17.21M (17205806) Filter 5 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 17.20M (17204640) Filter 6 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 17.20M (17204640) Filter 7 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 17.20M (17204640) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 17.20M (17204640) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 16.80K (16801) - RowGroups rejected: 0 (0) - RowGroups total: 16.80K (16801) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 17.20M (17204640) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000009d (host=foo.232.19:22000):(Total: 6m5s, non-child: 5m22s, % non-child: 88.21%) Hdfs split stats (:<# splits>/): 6:11/2.63 GB 1:16/3.63 GB 7:11/2.65 GB 3:20/4.68 GB 5:21/5.10 GB 0:14/3.22 GB 2:17/3.92 GB 4:19/4.48 GB Filter 0 arrival: 1s153ms Filter 9 arrival: 2s116ms Filter 8 arrival: 19s513ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 101.88 MB, 316.37 MB, 327.89 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.61 MB, 336.27 MB, 336.41 MB, 336.50 MB, 336.36 MB, 336.40 MB, 336.40 MB, 336.42 MB, 336.32 MB, 336.38 MB, 336.38 MB, 328.01 MB, 312.48 MB, 312.53 MB, 312.61 MB, 312.50 MB, 312.43 MB, 312.57 MB, 312.55 MB, 312.47 MB, 306.50 MB, 298.14 MB, 288.70 MB, 288.70 MB, 288.70 MB, 288.75 MB, 288.65 MB, 288.79 MB, 288.60 MB, 288.77 MB, 288.71 MB, 288.67 MB, 288.82 MB, 286.05 MB, 234.22 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.54 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.79 MB (356291936) - PerHostPeakMemUsage: 1.36 GB (1462073058) - RowsProduced: 16.52M (16515788) - TotalNetworkReceiveTime: 20s335ms - TotalNetworkSendTime: 5m5s - TotalStorageWaitTime: 110.107ms - TotalThreadsInvoluntaryContextSwitches: 28.58K (28578) - TotalThreadsTotalWallClockTime: 27m41s - TotalThreadsSysTime: 2s210ms - TotalThreadsUserTime: 4m17s - TotalThreadsVoluntaryContextSwitches: 74.86K (74856) Fragment Instance Lifecycle Timings: - ExecTime: 5m46s - ExecTreeExecTime: 3s690ms - OpenTime: 19s520ms - ExecTreeOpenTime: 19s046ms - PrepareTime: 43.847ms - ExecTreePrepareTime: 1.672ms DataStreamSender (dst_id=19):(Total: 19s926ms, non-child: 19s926ms, % non-child: 100.00%) - BytesSent: 2.25 GB (2411210794) - OverallThroughput: 115.40 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 16.52M (16515788) - SerializeBatchTime: 19s908ms - UncompressedRowBatchSize: 2.25 GB (2411210794) CodeGen:(Total: 502.530ms, non-child: 502.530ms, % non-child: 100.00%) - CodegenTime: 1.855ms - CompileTime: 143.542ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 328.771ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.718ms HASH_JOIN_NODE (id=9):(Total: 22s721ms, non-child: 3s175ms, % non-child: 13.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 284.373ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.52M (16515788) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s852ms - RowsReturned: 16.52M (16515788) - RowsReturnedRate: 726.88 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 234.935ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 389.051us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.462ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s750ms, non-child: 18.586ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.907ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.64 K/sec RecvrSide: BytesReceived(8s000ms): 3.60 MB, 27.68 MB, 32.77 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s318ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s734ms - DataArrivalTimer: 18s732ms SenderSide: - DeserializeRowBatchTimer: 176.761ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s371ms, non-child: 646.888ms, % non-child: 12.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 644.325us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.52M (16515788) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 607.509ms - RowsReturned: 16.52M (16515788) - RowsReturnedRate: 3.07 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 56.159us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 163.546us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.848us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s600ms, non-child: 12.254us, % non-child: 0.00%) - ConvertRowBatchTime: 2.967us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 56.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s600ms - DataArrivalTimer: 1s600ms SenderSide: - DeserializeRowBatchTimer: 165.352us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s124ms, non-child: 3s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:11/2.63 GB 1:16/3.63 GB 7:11/2.65 GB 3:20/4.68 GB 5:21/5.10 GB 0:14/3.22 GB 2:17/3.92 GB 4:19/4.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s951ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:15 BytesRead(8s000ms): 43.83 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB, 140.26 MB - FooterProcessingTime: (Avg: 638.787us ; Min: 570.625us ; Max: 704.954us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.52 - BytesRead: 140.26 MB (147071025) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.26 MB (147071025) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.26 MB (147071025) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 732.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.38 MB (186000960) - PerReadThreadRawHdfsThroughput: 881.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.602ms - RowBatchQueuePutWaitTime: 17m30s - RowsRead: 16.52M (16516963) - RowsReturned: 16.52M (16515788) - RowsReturnedRate: 5.29 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 23.02K (23016) - ScannerThreadsTotalWallClockTime: 21m14s - MaterializeTupleTime(*): 2s709ms - ScannerThreadsSysTime: 780.880ms - ScannerThreadsUserTime: 3m38s - ScannerThreadsVoluntaryContextSwitches: 57.44K (57435) - TotalRawHdfsReadTime(*): 159.093ms - TotalReadThroughput: 395.66 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.33K (50327) - Rows rejected: 1.18K (1175) - Rows total: 16.52M (16516963) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 16.52M (16515788) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 16.52M (16515788) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 16.52M (16515788) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.52M (16515788) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 126 (126) - Files total: 129 (129) - RowGroups processed: 16.13K (16128) - RowGroups rejected: 0 (0) - RowGroups total: 16.13K (16128) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.52M (16515788) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000103 (host=foo.232.20:22000):(Total: 6m2s, non-child: 5m17s, % non-child: 87.64%) Hdfs split stats (:<# splits>/): 2:16/3.80 GB 4:12/2.91 GB 1:15/3.61 GB 0:16/3.93 GB 6:24/5.75 GB 3:14/3.27 GB 5:14/3.32 GB 7:16/3.81 GB Filter 9 arrival: 1s117ms Filter 0 arrival: 1s481ms Filter 8 arrival: 21s953ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 112.80 MB, 316.41 MB, 321.63 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.31 MB, 337.33 MB, 336.51 MB, 336.46 MB, 336.53 MB, 336.46 MB, 336.43 MB, 336.40 MB, 336.50 MB, 336.36 MB, 336.43 MB, 321.99 MB, 312.56 MB, 312.51 MB, 312.57 MB, 312.61 MB, 312.52 MB, 312.59 MB, 312.56 MB, 312.44 MB, 312.52 MB, 303.60 MB, 288.69 MB, 288.66 MB, 288.54 MB, 288.69 MB, 288.62 MB, 288.62 MB, 288.66 MB, 288.55 MB, 283.39 MB, 280.51 MB, 268.27 MB, 234.09 MB, 113.08 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.54 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.76 MB (356261688) - PerHostPeakMemUsage: 1.37 GB (1474452829) - RowsProduced: 16.39M (16386790) - TotalNetworkReceiveTime: 21s809ms - TotalNetworkSendTime: 5m - TotalStorageWaitTime: 114.076ms - TotalThreadsInvoluntaryContextSwitches: 29.94K (29943) - TotalThreadsTotalWallClockTime: 27m25s - TotalThreadsSysTime: 3s144ms - TotalThreadsUserTime: 4m27s - TotalThreadsVoluntaryContextSwitches: 209.50K (209502) Fragment Instance Lifecycle Timings: - ExecTime: 5m40s - ExecTreeExecTime: 3s524ms - OpenTime: 21s952ms - ExecTreeOpenTime: 21s486ms - PrepareTime: 40.030ms - ExecTreePrepareTime: 1.404ms DataStreamSender (dst_id=19):(Total: 19s316ms, non-child: 19s316ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2392701360) - OverallThroughput: 118.13 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 16.39M (16386790) - SerializeBatchTime: 19s300ms - UncompressedRowBatchSize: 2.23 GB (2392701360) CodeGen:(Total: 490.848ms, non-child: 490.848ms, % non-child: 100.00%) - CodegenTime: 1.529ms - CompileTime: 143.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 320.819ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.837ms HASH_JOIN_NODE (id=9):(Total: 24s996ms, non-child: 3s005ms, % non-child: 12.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 264.138ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.39M (16386790) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s697ms - RowsReturned: 16.39M (16386790) - RowsReturnedRate: 655.56 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 226.655ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 498.152us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.228ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s210ms, non-child: 18.655ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.364ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.78 K/sec RecvrSide: BytesReceived(8s000ms): 3.60 MB, 27.71 MB, 32.75 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s655ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s195ms - DataArrivalTimer: 21s192ms SenderSide: - DeserializeRowBatchTimer: 177.550ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s374ms, non-child: 641.673ms, % non-child: 11.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 482.267us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 16.39M (16386790) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 603.965ms - RowsReturned: 16.39M (16386790) - RowsReturnedRate: 3.05 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 50.193us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 112.589us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 93.090us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 613.231ms, non-child: 12.386us, % non-child: 0.00%) - ConvertRowBatchTime: 3.054us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 148.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 613.222ms - DataArrivalTimer: 613.220ms SenderSide: - DeserializeRowBatchTimer: 80.691us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s119ms, non-child: 4s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:16/3.80 GB 4:12/2.91 GB 1:15/3.61 GB 0:16/3.93 GB 6:24/5.75 GB 3:14/3.27 GB 5:14/3.32 GB 7:16/3.81 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s954ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 53.44 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB, 142.50 MB - FooterProcessingTime: (Avg: 563.307us ; Min: 314.185us ; Max: 821.601us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.53 - BytesRead: 142.50 MB (149416901) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.50 MB (149416901) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.50 MB (149416901) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 726.552ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.42 MB (186042090) - PerReadThreadRawHdfsThroughput: 834.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.992ms - RowBatchQueuePutWaitTime: 17m4s - RowsRead: 16.39M (16387997) - RowsReturned: 16.39M (16386790) - RowsReturnedRate: 3.98 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 24.55K (24547) - ScannerThreadsTotalWallClockTime: 21m - MaterializeTupleTime(*): 2s707ms - ScannerThreadsSysTime: 1s894ms - ScannerThreadsUserTime: 3m50s - ScannerThreadsVoluntaryContextSwitches: 192.44K (192439) - TotalRawHdfsReadTime(*): 170.813ms - TotalReadThroughput: 408.15 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.36K (50359) - Rows rejected: 1.21K (1207) - Rows total: 16.39M (16387997) Filter 5 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.39M (16386790) Filter 6 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.39M (16386790) Filter 7 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.39M (16386790) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.39M (16386790) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 16.00K (16003) - RowGroups rejected: 0 (0) - RowGroups total: 16.00K (16003) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.39M (16386790) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000010c (host=foo.232.23:22000):(Total: 6m1s, non-child: 5m18s, % non-child: 88.02%) Hdfs split stats (:<# splits>/): 7:8/1.90 GB 1:16/3.88 GB 5:15/3.67 GB 6:18/4.23 GB 4:22/5.13 GB 0:18/4.30 GB 3:19/4.58 GB 2:10/2.48 GB Filter 9 arrival: 1s285ms Filter 0 arrival: 1s440ms Filter 8 arrival: 19s817ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 113.06 MB, 317.09 MB, 328.26 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.32 MB, 336.76 MB, 337.16 MB, 337.17 MB, 337.15 MB, 336.99 MB, 337.09 MB, 337.21 MB, 337.08 MB, 337.15 MB, 337.19 MB, 335.10 MB, 317.22 MB, 313.22 MB, 313.36 MB, 313.26 MB, 313.32 MB, 313.21 MB, 313.18 MB, 313.21 MB, 313.23 MB, 313.14 MB, 302.43 MB, 292.83 MB, 289.41 MB, 289.30 MB, 289.31 MB, 289.25 MB, 289.40 MB, 281.33 MB, 281.33 MB, 281.21 MB, 272.69 MB, 216.35 MB, 112.83 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.46 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.53 MB (357066697) - PerHostPeakMemUsage: 1.38 GB (1486259692) - RowsProduced: 16.35M (16346394) - TotalNetworkReceiveTime: 19s775ms - TotalNetworkSendTime: 5m2s - TotalStorageWaitTime: 116.000ms - TotalThreadsInvoluntaryContextSwitches: 26.80K (26796) - TotalThreadsTotalWallClockTime: 26m50s - TotalThreadsSysTime: 3s937ms - TotalThreadsUserTime: 3m58s - TotalThreadsVoluntaryContextSwitches: 209.34K (209344) Fragment Instance Lifecycle Timings: - ExecTime: 5m41s - ExecTreeExecTime: 3s256ms - OpenTime: 19s802ms - ExecTreeOpenTime: 19s311ms - PrepareTime: 57.928ms - ExecTreePrepareTime: 1.638ms DataStreamSender (dst_id=19):(Total: 20s219ms, non-child: 20s219ms, % non-child: 100.00%) - BytesSent: 2.21 GB (2374281751) - OverallThroughput: 111.98 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 16.35M (16346394) - SerializeBatchTime: 20s201ms - UncompressedRowBatchSize: 2.21 GB (2374281751) CodeGen:(Total: 531.602ms, non-child: 531.602ms, % non-child: 100.00%) - CodegenTime: 1.701ms - CompileTime: 149.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 340.281ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 41.243ms HASH_JOIN_NODE (id=9):(Total: 22s552ms, non-child: 2s756ms, % non-child: 12.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 251.993ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.35M (16346394) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s462ms - RowsReturned: 16.35M (16346394) - RowsReturnedRate: 724.80 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 213.678ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 368.572us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.510ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s049ms, non-child: 18.332ms, % non-child: 0.10%) - ConvertRowBatchTime: 14.097ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.25 K/sec RecvrSide: BytesReceived(8s000ms): 3.85 MB, 27.87 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s571ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s033ms - DataArrivalTimer: 19s031ms SenderSide: - DeserializeRowBatchTimer: 169.367ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s278ms, non-child: 607.588ms, % non-child: 11.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 418.396us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.35M (16346394) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 562.881ms - RowsReturned: 16.35M (16346394) - RowsReturnedRate: 3.10 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.456us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 96.320us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 109.898us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 741.472ms, non-child: 12.505us, % non-child: 0.00%) - ConvertRowBatchTime: 3.165us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 122.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 741.463ms - DataArrivalTimer: 741.460ms SenderSide: - DeserializeRowBatchTimer: 19.488us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s929ms, non-child: 3s929ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:8/1.90 GB 1:16/3.88 GB 5:15/3.67 GB 6:18/4.23 GB 4:22/5.13 GB 0:18/4.30 GB 3:19/4.58 GB 2:10/2.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s772ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:15 BytesRead(8s000ms): 53.62 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB, 142.98 MB - FooterProcessingTime: (Avg: 382.148us ; Min: 277.195us ; Max: 587.141us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.45 - BytesRead: 142.98 MB (149921505) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.98 MB (149921505) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.98 MB (149921505) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 728.378ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.08 MB (186729134) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.279ms - RowBatchQueuePutWaitTime: 17m4s - RowsRead: 16.35M (16347577) - RowsReturned: 16.35M (16346394) - RowsReturnedRate: 4.16 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 21.31K (21311) - ScannerThreadsTotalWallClockTime: 20m29s - MaterializeTupleTime(*): 2s542ms - ScannerThreadsSysTime: 2s557ms - ScannerThreadsUserTime: 3m20s - ScannerThreadsVoluntaryContextSwitches: 191.27K (191267) - TotalRawHdfsReadTime(*): 127.766ms - TotalReadThroughput: 410.11 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.34K (50335) - Rows rejected: 1.18K (1183) - Rows total: 16.35M (16347577) Filter 5 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 16.35M (16346394) Filter 6 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 16.35M (16346394) Filter 7 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 16.35M (16346394) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.35M (16346394) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 123 (123) - Files total: 126 (126) - RowGroups processed: 15.96K (15963) - RowGroups rejected: 0 (0) - RowGroups total: 15.96K (15963) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.35M (16346394) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000a2 (host=foo.232.50:22000):(Total: 5m49s, non-child: 5m7s, % non-child: 87.88%) Hdfs split stats (:<# splits>/): 5:16/3.87 GB 4:15/3.47 GB 7:14/3.18 GB 6:14/3.10 GB 0:26/6.35 GB 3:16/3.88 GB 2:16/3.58 GB 1:13/3.16 GB Filter 0 arrival: 540ms Filter 9 arrival: 557ms Filter 8 arrival: 19s761ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 122.19 MB, 317.88 MB, 328.84 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.57 MB, 338.04 MB, 337.89 MB, 337.96 MB, 337.93 MB, 337.90 MB, 337.76 MB, 337.82 MB, 337.79 MB, 337.91 MB, 321.98 MB, 314.01 MB, 313.96 MB, 314.04 MB, 314.03 MB, 314.12 MB, 314.15 MB, 314.04 MB, 314.03 MB, 312.42 MB, 294.51 MB, 290.01 MB, 290.02 MB, 289.98 MB, 289.99 MB, 290.03 MB, 289.95 MB, 290.00 MB, 285.63 MB, 277.51 MB, 273.95 MB, 263.69 MB, 182.78 MB ThreadUsage(8s000ms): 2, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 2 - AverageThreadTokens: 3.92 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 341.11 MB (357681952) - PerHostPeakMemUsage: 1.33 GB (1430724863) - RowsProduced: 15.90M (15904380) - TotalNetworkReceiveTime: 18s932ms - TotalNetworkSendTime: 4m49s - TotalStorageWaitTime: 146.701ms - TotalThreadsInvoluntaryContextSwitches: 6.63K (6633) - TotalThreadsTotalWallClockTime: 22m50s - TotalThreadsSysTime: 1s812ms - TotalThreadsUserTime: 45s813ms - TotalThreadsVoluntaryContextSwitches: 31.94K (31943) Fragment Instance Lifecycle Timings: - ExecTime: 5m29s - ExecTreeExecTime: 3s735ms - OpenTime: 19s766ms - ExecTreeOpenTime: 19s247ms - PrepareTime: 50.226ms - ExecTreePrepareTime: 1.436ms DataStreamSender (dst_id=19):(Total: 18s883ms, non-child: 18s883ms, % non-child: 100.00%) - BytesSent: 2.16 GB (2323442033) - OverallThroughput: 117.34 MB/sec - PeakMemoryUsage: 7.83 MB (8212512) - RowsReturned: 15.90M (15904380) - SerializeBatchTime: 18s866ms - UncompressedRowBatchSize: 2.16 GB (2323442033) CodeGen:(Total: 543.812ms, non-child: 543.812ms, % non-child: 100.00%) - CodegenTime: 2.220ms - CompileTime: 164.041ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 352.926ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.276ms HASH_JOIN_NODE (id=9):(Total: 22s967ms, non-child: 3s154ms, % non-child: 13.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 287.108ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.90M (15904380) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s843ms - RowsReturned: 15.90M (15904380) - RowsReturnedRate: 692.48 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 243.667ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 440.575us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.447ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s947ms, non-child: 20.266ms, % non-child: 0.11%) - ConvertRowBatchTime: 13.675ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.38 K/sec RecvrSide: BytesReceived(8s000ms): 5.64 MB, 28.86 MB, 32.85 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s651ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s932ms - DataArrivalTimer: 18s927ms SenderSide: - DeserializeRowBatchTimer: 289.527ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s368ms, non-child: 666.727ms, % non-child: 12.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 349.502us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.90M (15904380) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 629.430ms - RowsReturned: 15.90M (15904380) - RowsReturnedRate: 2.96 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.299us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 139.771us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.795us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.064us, non-child: 12.064us, % non-child: 100.00%) - ConvertRowBatchTime: 3.401us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.54 M/sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.599us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 116.922us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s701ms, non-child: 4s701ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:16/3.87 GB 4:15/3.47 GB 7:14/3.18 GB 6:14/3.10 GB 0:26/6.35 GB 3:16/3.88 GB 2:16/3.58 GB 1:13/3.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s496ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(8s000ms): 54.45 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB, 145.21 MB - FooterProcessingTime: (Avg: 1.140ms ; Min: 414.261us ; Max: 2.194ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 145.21 MB (152260246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.21 MB (152260246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.21 MB (152260246) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 727.544ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.84 MB (187524523) - PerReadThreadRawHdfsThroughput: 923.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46.175ms - RowBatchQueuePutWaitTime: 16m32s - RowsRead: 15.91M (15905597) - RowsReturned: 15.90M (15904380) - RowsReturnedRate: 3.38 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 991 (991) - ScannerThreadsTotalWallClockTime: 16m41s - MaterializeTupleTime(*): 2s730ms - ScannerThreadsSysTime: 404.936ms - ScannerThreadsUserTime: 8s445ms - ScannerThreadsVoluntaryContextSwitches: 15.74K (15739) - TotalRawHdfsReadTime(*): 157.210ms - TotalReadThroughput: 431.62 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.37K (50369) - Rows rejected: 1.22K (1217) - Rows total: 15.91M (15905597) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.90M (15904380) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.90M (15904380) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.90M (15904380) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.90M (15904380) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 15.53K (15532) - RowGroups rejected: 0 (0) - RowGroups total: 15.53K (15532) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.90M (15904380) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000e7 (host=foo.221.12:22000):(Total: 5m48s, non-child: 4m58s, % non-child: 85.67%) Hdfs split stats (:<# splits>/): 3:18/4.32 GB 0:17/4.11 GB 4:21/5.09 GB 6:11/2.53 GB 5:17/4.02 GB 7:15/3.60 GB 1:19/4.71 GB 2:8/1.95 GB Filter 9 arrival: 1s872ms Filter 0 arrival: 2s167ms Filter 8 arrival: 20s755ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(8s000ms): 116.54 MB, 371.54 MB, 380.91 MB, 393.03 MB, 393.03 MB, 393.03 MB, 393.03 MB, 393.03 MB, 393.03 MB, 393.03 MB, 393.03 MB, 392.14 MB, 391.57 MB, 391.51 MB, 391.54 MB, 391.67 MB, 391.56 MB, 391.46 MB, 381.59 MB, 359.78 MB, 359.70 MB, 359.83 MB, 359.69 MB, 359.81 MB, 359.73 MB, 359.74 MB, 359.77 MB, 359.72 MB, 359.68 MB, 348.27 MB, 333.76 MB, 327.91 MB, 327.84 MB, 327.80 MB, 327.77 MB, 327.85 MB, 323.76 MB, 301.20 MB, 282.50 MB, 282.48 MB, 275.91 MB, 247.04 MB, 239.47 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.83 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 394.92 MB (414108589) - PerHostPeakMemUsage: 1.39 GB (1490657978) - RowsProduced: 21.09M (21094182) - TotalNetworkReceiveTime: 21s228ms - TotalNetworkSendTime: 4m38s - TotalStorageWaitTime: 136.531ms - TotalThreadsInvoluntaryContextSwitches: 9.23K (9227) - TotalThreadsTotalWallClockTime: 28m3s - TotalThreadsSysTime: 2s340ms - TotalThreadsUserTime: 1m9s - TotalThreadsVoluntaryContextSwitches: 67.87K (67867) Fragment Instance Lifecycle Timings: - ExecTime: 5m27s - ExecTreeExecTime: 4s445ms - OpenTime: 20s767ms - ExecTreeOpenTime: 20s232ms - PrepareTime: 43.571ms - ExecTreePrepareTime: 1.402ms DataStreamSender (dst_id=19):(Total: 24s694ms, non-child: 24s694ms, % non-child: 100.00%) - BytesSent: 2.87 GB (3082193612) - OverallThroughput: 119.03 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 21.09M (21094182) - SerializeBatchTime: 24s674ms - UncompressedRowBatchSize: 2.87 GB (3082193612) CodeGen:(Total: 562.770ms, non-child: 562.770ms, % non-child: 100.00%) - CodegenTime: 2.086ms - CompileTime: 163.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 370.309ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.832ms HASH_JOIN_NODE (id=9):(Total: 24s656ms, non-child: 3s759ms, % non-child: 15.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 274.888ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.09M (21094182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s412ms - RowsReturned: 21.09M (21094182) - RowsReturnedRate: 855.52 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.271ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 1.980ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.803ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s946ms, non-child: 17.279ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.861ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.16 K/sec RecvrSide: BytesReceived(8s000ms): 2.18 MB, 26.30 MB, 32.65 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s273ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s932ms - DataArrivalTimer: 19s929ms SenderSide: - DeserializeRowBatchTimer: 172.199ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s470ms, non-child: 788.513ms, % non-child: 14.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 542.839us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.09M (21094182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 732.918ms - RowsReturned: 21.09M (21094182) - RowsReturnedRate: 3.86 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 51.436us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 158.326us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 81.345us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s296ms, non-child: 13.297us, % non-child: 0.00%) - ConvertRowBatchTime: 3.472us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 70.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s296ms - DataArrivalTimer: 1s296ms SenderSide: - DeserializeRowBatchTimer: 60.389us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s384ms, non-child: 3s384ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:18/4.32 GB 0:17/4.11 GB 4:21/5.09 GB 6:11/2.53 GB 5:17/4.02 GB 7:15/3.60 GB 1:19/4.71 GB 2:8/1.95 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s190ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:20 BytesRead(8s000ms): 69.61 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB, 185.64 MB - FooterProcessingTime: (Avg: 3.530ms ; Min: 510.772us ; Max: 12.352ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.80 - BytesRead: 185.64 MB (194654165) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.64 MB (194654165) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.64 MB (194654165) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 971.953ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 232.53 MB (243821260) - PerReadThreadRawHdfsThroughput: 798.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.735ms - RowBatchQueuePutWaitTime: 21m29s - RowsRead: 21.10M (21095777) - RowsReturned: 21.09M (21094182) - RowsReturnedRate: 6.23 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 2.55K (2546) - ScannerThreadsTotalWallClockTime: 21m53s - MaterializeTupleTime(*): 3s608ms - ScannerThreadsSysTime: 606.907ms - ScannerThreadsUserTime: 23s012ms - ScannerThreadsVoluntaryContextSwitches: 49.26K (49257) - TotalRawHdfsReadTime(*): 232.428ms - TotalReadThroughput: 549.40 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.13K (67131) - Rows rejected: 1.59K (1595) - Rows total: 21.10M (21095777) Filter 5 (2.00 MB): - Rows processed: 43.01K (43008) - Rows rejected: 0 (0) - Rows total: 21.09M (21094182) Filter 6 (2.00 MB): - Rows processed: 43.01K (43008) - Rows rejected: 0 (0) - Rows total: 21.09M (21094182) Filter 7 (2.00 MB): - Rows processed: 43.01K (43008) - Rows rejected: 0 (0) - Rows total: 21.09M (21094182) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.09M (21094182) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 122 (122) - Files total: 126 (126) - RowGroups processed: 20.60K (20600) - RowGroups rejected: 0 (0) - RowGroups total: 20.60K (20600) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.09M (21094182) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000110 (host=foo.221.44:22000):(Total: 5m46s, non-child: 4m57s, % non-child: 85.88%) Hdfs split stats (:<# splits>/): 2:14/3.26 GB 0:23/5.47 GB 6:16/3.64 GB 3:13/3.17 GB 4:20/4.79 GB 5:17/4.13 GB 7:13/2.96 GB 1:12/2.89 GB Filter 9 arrival: 1s526ms Filter 0 arrival: 1s666ms Filter 8 arrival: 20s032ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 121.81 MB, 362.88 MB, 372.99 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.08 MB, 383.20 MB, 382.85 MB, 382.97 MB, 382.95 MB, 382.91 MB, 383.00 MB, 382.94 MB, 364.48 MB, 351.11 MB, 351.12 MB, 351.06 MB, 351.10 MB, 351.02 MB, 351.12 MB, 351.14 MB, 351.08 MB, 351.14 MB, 346.17 MB, 341.14 MB, 325.84 MB, 319.43 MB, 319.45 MB, 319.30 MB, 319.29 MB, 297.43 MB, 289.90 MB, 283.93 MB, 281.89 MB, 258.42 MB, 247.52 MB, 247.37 MB, 221.69 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.79 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 386.30 MB (405067900) - PerHostPeakMemUsage: 1.39 GB (1493934538) - RowsProduced: 21.34M (21338779) - TotalNetworkReceiveTime: 20s371ms - TotalNetworkSendTime: 4m37s - TotalStorageWaitTime: 143.217ms - TotalThreadsInvoluntaryContextSwitches: 11.22K (11224) - TotalThreadsTotalWallClockTime: 27m40s - TotalThreadsSysTime: 2s739ms - TotalThreadsUserTime: 1m19s - TotalThreadsVoluntaryContextSwitches: 93.95K (93953) Fragment Instance Lifecycle Timings: - ExecTime: 5m26s - ExecTreeExecTime: 4s351ms - OpenTime: 20s031ms - ExecTreeOpenTime: 19s586ms - PrepareTime: 41.848ms - ExecTreePrepareTime: 1.200ms DataStreamSender (dst_id=19):(Total: 24s575ms, non-child: 24s575ms, % non-child: 100.00%) - BytesSent: 2.89 GB (3105859847) - OverallThroughput: 120.53 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 21.34M (21338779) - SerializeBatchTime: 24s554ms - UncompressedRowBatchSize: 2.89 GB (3105859847) CodeGen:(Total: 470.385ms, non-child: 470.385ms, % non-child: 100.00%) - CodegenTime: 1.782ms - CompileTime: 134.355ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 309.438ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.051ms HASH_JOIN_NODE (id=9):(Total: 23s916ms, non-child: 3s571ms, % non-child: 14.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 233.427ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.34M (21338779) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s272ms - RowsReturned: 21.34M (21338779) - RowsReturnedRate: 892.21 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 196.424ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 327.693us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.263ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s341ms, non-child: 15.330ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.439ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.89 K/sec RecvrSide: BytesReceived(8s000ms): 2.63 MB, 26.83 MB, 32.70 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s863ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s328ms - DataArrivalTimer: 19s325ms SenderSide: - DeserializeRowBatchTimer: 183.303ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s608ms, non-child: 845.596ms, % non-child: 15.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 557.275us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.34M (21338779) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 795.894ms - RowsReturned: 21.34M (21338779) - RowsReturnedRate: 3.81 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 78.642us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 144.336us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.729us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s042ms, non-child: 14.511us, % non-child: 0.00%) - ConvertRowBatchTime: 4.260us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 87.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s042ms - DataArrivalTimer: 1s042ms SenderSide: - DeserializeRowBatchTimer: 20.110us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s719ms, non-child: 3s719ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:14/3.26 GB 0:23/5.47 GB 6:16/3.64 GB 3:13/3.17 GB 4:20/4.79 GB 5:17/4.13 GB 7:13/2.96 GB 1:12/2.89 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s533ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(8s000ms): 67.33 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB, 179.54 MB - FooterProcessingTime: (Avg: 826.518us ; Min: 548.619us ; Max: 1.343ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.76 - BytesRead: 179.54 MB (188266074) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.54 MB (188266074) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.54 MB (188266074) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 925.284ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 223.89 MB (234767890) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.122ms - RowBatchQueuePutWaitTime: 20m56s - RowsRead: 21.34M (21340394) - RowsReturned: 21.34M (21338779) - RowsReturnedRate: 5.74 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 4.48K (4483) - ScannerThreadsTotalWallClockTime: 21m33s - MaterializeTupleTime(*): 3s309ms - ScannerThreadsSysTime: 1s053ms - ScannerThreadsUserTime: 32s382ms - ScannerThreadsVoluntaryContextSwitches: 72.77K (72767) - TotalRawHdfsReadTime(*): 173.666ms - TotalReadThroughput: 533.68 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.15K (67151) - Rows rejected: 1.61K (1615) - Rows total: 21.34M (21340394) Filter 5 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 21.34M (21338779) Filter 6 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 21.34M (21338779) Filter 7 (2.00 MB): - Rows processed: 39.94K (39936) - Rows rejected: 0 (0) - Rows total: 21.34M (21338779) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.34M (21338779) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 20.84K (20839) - RowGroups rejected: 0 (0) - RowGroups total: 20.84K (20839) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.34M (21338779) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000cf (host=foo.221.32:22000):(Total: 5m46s, non-child: 4m56s, % non-child: 85.63%) Hdfs split stats (:<# splits>/): 6:8/1.87 GB 4:17/4.14 GB 3:13/2.79 GB 2:22/5.10 GB 5:21/5.13 GB 1:18/4.18 GB 7:16/3.57 GB 0:15/3.39 GB Filter 9 arrival: 1s610ms Filter 0 arrival: 1s776ms Filter 8 arrival: 21s009ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 119.96 MB, 358.38 MB, 365.73 MB, 378.17 MB, 378.17 MB, 378.17 MB, 378.17 MB, 378.17 MB, 378.17 MB, 378.17 MB, 378.17 MB, 377.97 MB, 378.41 MB, 378.43 MB, 378.47 MB, 378.30 MB, 378.36 MB, 378.52 MB, 351.54 MB, 346.66 MB, 346.64 MB, 346.55 MB, 346.80 MB, 346.70 MB, 346.66 MB, 346.60 MB, 346.56 MB, 346.66 MB, 344.11 MB, 299.79 MB, 288.96 MB, 289.17 MB, 289.15 MB, 289.13 MB, 289.21 MB, 289.10 MB, 289.13 MB, 289.19 MB, 289.14 MB, 289.17 MB, 284.13 MB, 222.18 MB, 131.88 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.61 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.69 MB (400235320) - PerHostPeakMemUsage: 1.38 GB (1478564799) - RowsProduced: 20.72M (20721862) - TotalNetworkReceiveTime: 21s283ms - TotalNetworkSendTime: 4m35s - TotalStorageWaitTime: 269.128ms - TotalThreadsInvoluntaryContextSwitches: 9.37K (9371) - TotalThreadsTotalWallClockTime: 26m35s - TotalThreadsSysTime: 7s671ms - TotalThreadsUserTime: 1m2s - TotalThreadsVoluntaryContextSwitches: 799.49K (799493) Fragment Instance Lifecycle Timings: - ExecTime: 5m24s - ExecTreeExecTime: 4s450ms - OpenTime: 21s013ms - ExecTreeOpenTime: 20s513ms - PrepareTime: 50.217ms - ExecTreePrepareTime: 1.451ms DataStreamSender (dst_id=19):(Total: 24s232ms, non-child: 24s232ms, % non-child: 100.00%) - BytesSent: 2.81 GB (3020405246) - OverallThroughput: 118.87 MB/sec - PeakMemoryUsage: 7.93 MB (8310816) - RowsReturned: 20.72M (20721862) - SerializeBatchTime: 24s206ms - UncompressedRowBatchSize: 2.81 GB (3020405246) CodeGen:(Total: 535.088ms, non-child: 535.088ms, % non-child: 100.00%) - CodegenTime: 1.830ms - CompileTime: 166.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 331.330ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 36.829ms HASH_JOIN_NODE (id=9):(Total: 24s943ms, non-child: 3s755ms, % non-child: 15.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 266.852ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 20.72M (20721862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s425ms - RowsReturned: 20.72M (20721862) - RowsReturnedRate: 830.76 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.304ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 514.219us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.628ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s234ms, non-child: 17.918ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.215ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.83 K/sec RecvrSide: BytesReceived(8s000ms): 3.03 MB, 27.21 MB, 32.73 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s910ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s219ms - DataArrivalTimer: 20s217ms SenderSide: - DeserializeRowBatchTimer: 176.653ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s496ms, non-child: 787.242ms, % non-child: 14.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 457.793us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.72M (20721862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 736.064ms - RowsReturned: 20.72M (20721862) - RowsReturnedRate: 3.77 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 45.905us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 147.568us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.334us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s063ms, non-child: 13.997us, % non-child: 0.00%) - ConvertRowBatchTime: 4.130us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 85.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s063ms - DataArrivalTimer: 1s063ms SenderSide: - DeserializeRowBatchTimer: 30.955us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s646ms, non-child: 3s646ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:8/1.87 GB 4:17/4.14 GB 3:13/2.79 GB 2:22/5.10 GB 5:21/5.13 GB 1:18/4.18 GB 7:16/3.57 GB 0:15/3.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s452ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:20 BytesRead(8s000ms): 65.99 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB, 175.97 MB - FooterProcessingTime: (Avg: 8.625ms ; Min: 655.235us ; Max: 31.558ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.59 - BytesRead: 175.97 MB (184520142) - BytesReadDataNodeCache: 0 - BytesReadLocal: 175.97 MB (184520142) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 175.97 MB (184520142) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 947.674ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.40 MB (230052448) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.769ms - RowBatchQueuePutWaitTime: 20m4s - RowsRead: 20.72M (20723473) - RowsReturned: 20.72M (20721862) - RowsReturnedRate: 5.68 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 2.78K (2777) - ScannerThreadsTotalWallClockTime: 20m27s - MaterializeTupleTime(*): 3s441ms - ScannerThreadsSysTime: 5s896ms - ScannerThreadsUserTime: 16s010ms - ScannerThreadsVoluntaryContextSwitches: 781.22K (781216) - TotalRawHdfsReadTime(*): 156.287ms - TotalReadThroughput: 526.89 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.15K (67147) - Rows rejected: 1.61K (1611) - Rows total: 20.72M (20723473) Filter 5 (2.00 MB): - Rows processed: 51.20K (51200) - Rows rejected: 0 (0) - Rows total: 20.72M (20721862) Filter 6 (2.00 MB): - Rows processed: 51.20K (51200) - Rows rejected: 0 (0) - Rows total: 20.72M (20721862) Filter 7 (2.00 MB): - Rows processed: 51.20K (51200) - Rows rejected: 0 (0) - Rows total: 20.72M (20721862) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 20.72M (20721862) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 126 (126) - Files total: 130 (130) - RowGroups processed: 20.23K (20235) - RowGroups rejected: 0 (0) - RowGroups total: 20.23K (20235) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.72M (20721862) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000cb (host=foo.221.46:22000):(Total: 5m45s, non-child: 4m56s, % non-child: 85.60%) Hdfs split stats (:<# splits>/): 6:12/2.97 GB 7:11/2.72 GB 2:16/3.63 GB 1:23/5.44 GB 0:20/4.95 GB 3:14/3.47 GB 4:12/2.81 GB 5:17/4.17 GB Filter 0 arrival: 1s644ms Filter 9 arrival: 1s960ms Filter 8 arrival: 21s864ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 120.10 MB, 358.34 MB, 364.01 MB, 381.05 MB, 381.05 MB, 381.05 MB, 381.05 MB, 381.05 MB, 381.05 MB, 381.05 MB, 381.05 MB, 379.86 MB, 378.39 MB, 378.37 MB, 378.43 MB, 378.47 MB, 378.40 MB, 378.33 MB, 372.47 MB, 349.07 MB, 346.59 MB, 346.49 MB, 346.48 MB, 346.58 MB, 346.58 MB, 346.42 MB, 346.58 MB, 346.47 MB, 346.58 MB, 332.26 MB, 302.72 MB, 290.81 MB, 289.27 MB, 289.20 MB, 289.14 MB, 289.24 MB, 289.36 MB, 283.81 MB, 281.24 MB, 281.42 MB, 281.26 MB, 229.46 MB, 73.58 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.61 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.69 MB (400232909) - PerHostPeakMemUsage: 1.38 GB (1481371800) - RowsProduced: 19.61M (19614556) - TotalNetworkReceiveTime: 22s548ms - TotalNetworkSendTime: 4m35s - TotalStorageWaitTime: 208.610ms - TotalThreadsInvoluntaryContextSwitches: 7.84K (7840) - TotalThreadsTotalWallClockTime: 26m33s - TotalThreadsSysTime: 4s608ms - TotalThreadsUserTime: 55s697ms - TotalThreadsVoluntaryContextSwitches: 293.65K (293655) Fragment Instance Lifecycle Timings: - ExecTime: 5m23s - ExecTreeExecTime: 4s337ms - OpenTime: 21s874ms - ExecTreeOpenTime: 21s406ms - PrepareTime: 47.561ms - ExecTreePrepareTime: 1.392ms DataStreamSender (dst_id=19):(Total: 23s561ms, non-child: 23s561ms, % non-child: 100.00%) - BytesSent: 2.67 GB (2864922483) - OverallThroughput: 115.96 MB/sec - PeakMemoryUsage: 7.96 MB (8343584) - RowsReturned: 19.61M (19614556) - SerializeBatchTime: 23s540ms - UncompressedRowBatchSize: 2.67 GB (2864922483) CodeGen:(Total: 496.307ms, non-child: 496.307ms, % non-child: 100.00%) - CodegenTime: 2.010ms - CompileTime: 142.162ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 324.233ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.430ms HASH_JOIN_NODE (id=9):(Total: 25s722ms, non-child: 3s705ms, % non-child: 14.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 281.077ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 19.61M (19614556) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s361ms - RowsReturned: 19.61M (19614556) - RowsReturnedRate: 762.55 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 229.358ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 484.858us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.845ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s112ms, non-child: 18.615ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.346ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.88 K/sec RecvrSide: BytesReceived(8s000ms): 3.07 MB, 27.26 MB, 32.71 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s813ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s097ms - DataArrivalTimer: 21s094ms SenderSide: - DeserializeRowBatchTimer: 295.433ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s495ms, non-child: 741.268ms, % non-child: 13.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 633.206us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 19.61M (19614556) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 693.591ms - RowsReturned: 19.61M (19614556) - RowsReturnedRate: 3.57 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 68.387us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 107.055us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 101.027us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s450ms, non-child: 12.600us, % non-child: 0.00%) - ConvertRowBatchTime: 3.522us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 62.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s450ms - DataArrivalTimer: 1s450ms SenderSide: - DeserializeRowBatchTimer: 78.548us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s303ms, non-child: 3s303ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:12/2.97 GB 7:11/2.72 GB 2:16/3.63 GB 1:23/5.44 GB 0:20/4.95 GB 3:14/3.47 GB 4:12/2.81 GB 5:17/4.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s111ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:20 BytesRead(8s000ms): 67.45 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB, 179.85 MB - FooterProcessingTime: (Avg: 584.457us ; Min: 151.278us ; Max: 904.582us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.61 - BytesRead: 179.85 MB (188590393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.85 MB (188590393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.85 MB (188590393) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 953.068ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.39 MB (230044168) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.543ms - RowBatchQueuePutWaitTime: 20m10s - RowsRead: 19.62M (19616115) - RowsReturned: 19.61M (19614556) - RowsReturnedRate: 5.94 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 1.51K (1508) - ScannerThreadsTotalWallClockTime: 20m25s - MaterializeTupleTime(*): 3s236ms - ScannerThreadsSysTime: 2s848ms - ScannerThreadsUserTime: 10s826ms - ScannerThreadsVoluntaryContextSwitches: 275.95K (275946) - TotalRawHdfsReadTime(*): 164.888ms - TotalReadThroughput: 542.47 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.09K (67095) - Rows rejected: 1.56K (1559) - Rows total: 19.62M (19616115) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.61M (19614556) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.61M (19614556) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 19.61M (19614556) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 19.61M (19614556) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 121 (121) - Files total: 125 (125) - RowGroups processed: 19.16K (19155) - RowGroups rejected: 0 (0) - RowGroups total: 19.16K (19155) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.61M (19614556) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000ca (host=foo.221.33:22000):(Total: 5m29s, non-child: 4m41s, % non-child: 85.49%) Hdfs split stats (:<# splits>/): 1:15/3.58 GB 2:15/3.04 GB 0:13/3.22 GB 6:17/3.97 GB 5:23/5.47 GB 4:19/4.11 GB 3:13/3.05 GB 7:18/3.97 GB Filter 0 arrival: 1s743ms Filter 9 arrival: 2s509ms Filter 8 arrival: 20s111ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 120.48 MB, 362.19 MB, 371.40 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 380.58 MB, 381.83 MB, 382.21 MB, 382.27 MB, 382.20 MB, 382.22 MB, 382.23 MB, 382.24 MB, 363.35 MB, 350.45 MB, 350.45 MB, 350.31 MB, 350.42 MB, 350.40 MB, 350.53 MB, 350.48 MB, 350.37 MB, 350.52 MB, 344.35 MB, 325.43 MB, 318.54 MB, 318.50 MB, 303.38 MB, 291.16 MB, 291.07 MB, 287.70 MB, 283.22 MB, 278.74 MB, 273.07 MB, 239.93 MB, 104.87 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.74 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 385.45 MB (404174305) - PerHostPeakMemUsage: 1.40 GB (1500362839) - RowsProduced: 19.54M (19539077) - TotalNetworkReceiveTime: 21s263ms - TotalNetworkSendTime: 4m21s - TotalStorageWaitTime: 138.744ms - TotalThreadsInvoluntaryContextSwitches: 9.36K (9364) - TotalThreadsTotalWallClockTime: 26m - TotalThreadsSysTime: 2s526ms - TotalThreadsUserTime: 1m - TotalThreadsVoluntaryContextSwitches: 72.89K (72888) Fragment Instance Lifecycle Timings: - ExecTime: 5m8s - ExecTreeExecTime: 4s227ms - OpenTime: 20s113ms - ExecTreeOpenTime: 19s602ms - PrepareTime: 53.086ms - ExecTreePrepareTime: 1.291ms DataStreamSender (dst_id=19):(Total: 23s389ms, non-child: 23s389ms, % non-child: 100.00%) - BytesSent: 2.66 GB (2857081336) - OverallThroughput: 116.49 MB/sec - PeakMemoryUsage: 7.86 MB (8245280) - RowsReturned: 19.54M (19539077) - SerializeBatchTime: 23s369ms - UncompressedRowBatchSize: 2.66 GB (2857081336) CodeGen:(Total: 544.408ms, non-child: 544.408ms, % non-child: 100.00%) - CodegenTime: 1.664ms - CompileTime: 162.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 346.307ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 35.178ms HASH_JOIN_NODE (id=9):(Total: 23s810ms, non-child: 3s594ms, % non-child: 15.10%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 264.673ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 19.54M (19539077) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s267ms - RowsReturned: 19.54M (19539077) - RowsReturnedRate: 820.60 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 215.216ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 469.747us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.589ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s325ms, non-child: 17.511ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.180ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.91 K/sec RecvrSide: BytesReceived(8s000ms): 2.46 MB, 26.65 MB, 32.68 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s866ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s310ms - DataArrivalTimer: 19s308ms SenderSide: - DeserializeRowBatchTimer: 177.770ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s421ms, non-child: 731.140ms, % non-child: 13.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 479.113us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 19.54M (19539077) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 684.616ms - RowsReturned: 19.54M (19539077) - RowsReturnedRate: 3.60 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 52.077us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 104.648us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.744us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s952ms, non-child: 10.674us, % non-child: 0.00%) - ConvertRowBatchTime: 3.344us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 46.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s952ms - DataArrivalTimer: 1s952ms SenderSide: - DeserializeRowBatchTimer: 31.259us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s737ms, non-child: 2s737ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/3.58 GB 2:15/3.04 GB 0:13/3.22 GB 6:17/3.97 GB 5:23/5.47 GB 4:19/4.11 GB 3:13/3.05 GB 7:18/3.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s548ms Hdfs Read Thread Concurrency Bucket: 0:99.85% 1:0.1543% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:129 PARQUET/SNAPPY:20 BytesRead(8s000ms): 67.43 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB, 183.59 MB - FooterProcessingTime: (Avg: 374.787us ; Min: 228.576us ; Max: 528.704us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.73 - BytesRead: 183.59 MB (192511471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.59 MB (192511471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.59 MB (192511471) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 965.643ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 223.16 MB (234005055) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.273ms - RowBatchQueuePutWaitTime: 19m49s - RowsRead: 19.54M (19540728) - RowsReturned: 19.54M (19539077) - RowsReturnedRate: 7.14 M/sec - ScanRangesComplete: 133 (133) - ScannerThreadsInvoluntaryContextSwitches: 2.87K (2874) - ScannerThreadsTotalWallClockTime: 20m10s - MaterializeTupleTime(*): 3s395ms - ScannerThreadsSysTime: 928.856ms - ScannerThreadsUserTime: 16s245ms - ScannerThreadsVoluntaryContextSwitches: 55.62K (55616) - TotalRawHdfsReadTime(*): 174.873ms - TotalReadThroughput: 579.35 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.19K (67187) - Rows rejected: 1.65K (1651) - Rows total: 19.54M (19540728) Filter 5 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 19.54M (19539077) Filter 6 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 19.54M (19539077) Filter 7 (2.00 MB): - Rows processed: 40.96K (40960) - Rows rejected: 0 (0) - Rows total: 19.54M (19539077) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 19.54M (19539077) Filter 9 (8.00 KB): - Files processed: 133 (133) - Files rejected: 129 (129) - Files total: 133 (133) - RowGroups processed: 19.08K (19080) - RowGroups rejected: 0 (0) - RowGroups total: 19.08K (19080) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.54M (19539077) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000b2 (host=foo.232.18:22000):(Total: 5m25s, non-child: 4m44s, % non-child: 87.19%) Hdfs split stats (:<# splits>/): 2:21/4.84 GB 0:15/3.36 GB 4:20/4.83 GB 3:11/2.37 GB 5:15/3.55 GB 7:15/3.44 GB 1:17/4.15 GB 6:16/3.84 GB Filter 9 arrival: 1s118ms Filter 0 arrival: 1s421ms Filter 8 arrival: 19s780ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 98.79 MB, 304.85 MB, 315.14 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.09 MB, 325.05 MB, 324.91 MB, 324.79 MB, 324.89 MB, 325.02 MB, 324.89 MB, 324.96 MB, 324.81 MB, 324.77 MB, 320.92 MB, 302.94 MB, 300.98 MB, 301.09 MB, 300.97 MB, 300.97 MB, 300.99 MB, 300.97 MB, 300.83 MB, 298.48 MB, 285.09 MB, 277.14 MB, 277.16 MB, 277.26 MB, 277.13 MB, 277.10 MB, 249.81 MB, 239.82 MB, 237.79 MB, 183.67 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.60 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 328.29 MB (344235590) - PerHostPeakMemUsage: 1.36 GB (1459405202) - RowsProduced: 15.32M (15319712) - TotalNetworkReceiveTime: 19s649ms - TotalNetworkSendTime: 4m27s - TotalStorageWaitTime: 123.942ms - TotalThreadsInvoluntaryContextSwitches: 32.18K (32182) - TotalThreadsTotalWallClockTime: 24m57s - TotalThreadsSysTime: 2s403ms - TotalThreadsUserTime: 4m43s - TotalThreadsVoluntaryContextSwitches: 94.64K (94640) Fragment Instance Lifecycle Timings: - ExecTime: 5m5s - ExecTreeExecTime: 3s300ms - OpenTime: 19s779ms - ExecTreeOpenTime: 19s318ms - PrepareTime: 56.872ms - ExecTreePrepareTime: 1.687ms DataStreamSender (dst_id=19):(Total: 18s629ms, non-child: 18s629ms, % non-child: 100.00%) - BytesSent: 2.08 GB (2235275298) - OverallThroughput: 114.43 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 15.32M (15319712) - SerializeBatchTime: 18s613ms - UncompressedRowBatchSize: 2.08 GB (2235275298) CodeGen:(Total: 493.162ms, non-child: 493.162ms, % non-child: 100.00%) - CodegenTime: 2.167ms - CompileTime: 143.847ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 315.808ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.750ms HASH_JOIN_NODE (id=9):(Total: 22s605ms, non-child: 2s865ms, % non-child: 12.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 256.053ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.32M (15319712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s564ms - RowsReturned: 15.32M (15319712) - RowsReturnedRate: 677.69 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 209.581ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 492.106us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.298ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s052ms, non-child: 19.313ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.707ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.25 K/sec RecvrSide: BytesReceived(8s000ms): 3.15 MB, 27.32 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s585ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s038ms - DataArrivalTimer: 19s033ms SenderSide: - DeserializeRowBatchTimer: 178.591ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s263ms, non-child: 555.361ms, % non-child: 10.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 377.290us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.32M (15319712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 516.760ms - RowsReturned: 15.32M (15319712) - RowsReturnedRate: 2.91 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.441us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 106.868us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.838us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 611.012ms, non-child: 13.740us, % non-child: 0.00%) - ConvertRowBatchTime: 4.176us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 148.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 611.001ms - DataArrivalTimer: 610.999ms SenderSide: - DeserializeRowBatchTimer: 20.597us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s097ms, non-child: 4s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:21/4.84 GB 0:15/3.36 GB 4:20/4.83 GB 3:11/2.37 GB 5:15/3.55 GB 7:15/3.44 GB 1:17/4.15 GB 6:16/3.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s938ms Hdfs Read Thread Concurrency Bucket: 0:99.84% 1:0.1565% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(8s000ms): 49.02 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB, 135.32 MB - FooterProcessingTime: (Avg: 1.050ms ; Min: 348.798us ; Max: 2.145ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.60 - BytesRead: 135.32 MB (141895268) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.32 MB (141895268) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.32 MB (141895268) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 688.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 165.83 MB (173888001) - PerReadThreadRawHdfsThroughput: 1016.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.405ms - RowBatchQueuePutWaitTime: 14m59s - RowsRead: 15.32M (15320861) - RowsReturned: 15.32M (15319712) - RowsReturnedRate: 3.74 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 26.79K (26788) - ScannerThreadsTotalWallClockTime: 19m11s - MaterializeTupleTime(*): 2s617ms - ScannerThreadsSysTime: 1s071ms - ScannerThreadsUserTime: 4m8s - ScannerThreadsVoluntaryContextSwitches: 79.17K (79166) - TotalRawHdfsReadTime(*): 133.148ms - TotalReadThroughput: 433.03 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.30K (50301) - Rows rejected: 1.15K (1149) - Rows total: 15.32M (15320861) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 15.32M (15319712) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 15.32M (15319712) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 15.32M (15319712) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.32M (15319712) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 14.96K (14960) - RowGroups rejected: 0 (0) - RowGroups total: 14.96K (14960) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.32M (15319712) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000c3 (host=foo.221.20:22000):(Total: 5m21s, non-child: 4m29s, % non-child: 83.99%) Hdfs split stats (:<# splits>/): 0:16/3.74 GB 6:18/4.26 GB 4:18/4.26 GB 3:13/3.00 GB 5:20/4.20 GB 7:15/3.52 GB 2:13/3.22 GB 1:17/3.97 GB Filter 9 arrival: 1s770ms Filter 0 arrival: 1s927ms Filter 8 arrival: 22s491ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 125.74 MB, 374.67 MB, 378.83 MB, 396.84 MB, 396.84 MB, 396.84 MB, 396.84 MB, 396.84 MB, 396.84 MB, 396.84 MB, 396.84 MB, 395.79 MB, 394.78 MB, 394.75 MB, 394.80 MB, 394.74 MB, 394.70 MB, 389.33 MB, 362.83 MB, 362.92 MB, 362.95 MB, 362.83 MB, 362.81 MB, 362.79 MB, 362.92 MB, 362.90 MB, 359.88 MB, 338.47 MB, 331.06 MB, 331.00 MB, 331.00 MB, 331.11 MB, 330.97 MB, 331.14 MB, 331.04 MB, 330.97 MB, 324.65 MB, 318.07 MB, 314.95 MB, 99.16 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 2 - AverageThreadTokens: 4.92 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.00 MB (417333024) - PerHostPeakMemUsage: 1.39 GB (1494618394) - RowsProduced: 21.57M (21573186) - TotalNetworkReceiveTime: 22s843ms - TotalNetworkSendTime: 4m7s - TotalStorageWaitTime: 206.910ms - TotalThreadsInvoluntaryContextSwitches: 7.65K (7654) - TotalThreadsTotalWallClockTime: 26m20s - TotalThreadsSysTime: 2s523ms - TotalThreadsUserTime: 53s727ms - TotalThreadsVoluntaryContextSwitches: 54.85K (54848) Fragment Instance Lifecycle Timings: - ExecTime: 4m58s - ExecTreeExecTime: 4s469ms - OpenTime: 22s494ms - ExecTreeOpenTime: 21s956ms - PrepareTime: 44.930ms - ExecTreePrepareTime: 1.271ms DataStreamSender (dst_id=19):(Total: 24s461ms, non-child: 24s461ms, % non-child: 100.00%) - BytesSent: 2.94 GB (3152605333) - OverallThroughput: 122.91 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 21.57M (21573186) - SerializeBatchTime: 24s436ms - UncompressedRowBatchSize: 2.94 GB (3152605333) CodeGen:(Total: 568.023ms, non-child: 568.023ms, % non-child: 100.00%) - CodegenTime: 1.988ms - CompileTime: 180.149ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 357.047ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.126ms HASH_JOIN_NODE (id=9):(Total: 26s403ms, non-child: 3s771ms, % non-child: 14.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 277.235ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.57M (21573186) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s432ms - RowsReturned: 21.57M (21573186) - RowsReturnedRate: 817.07 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.260ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 475.429us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.950ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s667ms, non-child: 18.806ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.300ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.32 K/sec RecvrSide: BytesReceived(8s000ms): 2.41 MB, 26.54 MB, 32.65 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s028ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s652ms - DataArrivalTimer: 21s649ms SenderSide: - DeserializeRowBatchTimer: 182.415ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s479ms, non-child: 803.977ms, % non-child: 14.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 598.304us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.57M (21573186) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 755.533ms - RowsReturned: 21.57M (21573186) - RowsReturnedRate: 3.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 55.284us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 107.346us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 95.115us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s189ms, non-child: 17.918us, % non-child: 0.00%) - ConvertRowBatchTime: 5.339us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 76.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s189ms - DataArrivalTimer: 1s189ms SenderSide: - DeserializeRowBatchTimer: 11.965us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s485ms, non-child: 3s485ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:16/3.74 GB 6:18/4.26 GB 4:18/4.26 GB 3:13/3.00 GB 5:20/4.20 GB 7:15/3.52 GB 2:13/3.22 GB 1:17/3.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s291ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:20 BytesRead(8s000ms): 71.84 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB, 191.56 MB - FooterProcessingTime: (Avg: 488.070us ; Min: 280.220us ; Max: 737.328us ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 191.56 MB (200868406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.56 MB (200868406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.56 MB (200868406) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 992.666ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.66 MB (247106126) - PerReadThreadRawHdfsThroughput: 817.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.547ms - RowBatchQueuePutWaitTime: 20m28s - RowsRead: 21.57M (21574717) - RowsReturned: 21.57M (21573186) - RowsReturnedRate: 6.19 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 946 (946) - ScannerThreadsTotalWallClockTime: 20m36s - MaterializeTupleTime(*): 3s569ms - ScannerThreadsSysTime: 834.871ms - ScannerThreadsUserTime: 6s834ms - ScannerThreadsVoluntaryContextSwitches: 36.09K (36091) - TotalRawHdfsReadTime(*): 234.281ms - TotalReadThroughput: 621.74 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.07K (67067) - Rows rejected: 1.53K (1531) - Rows total: 21.57M (21574717) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.57M (21573186) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.57M (21573186) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.57M (21573186) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.57M (21573186) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 126 (126) - Files total: 130 (130) - RowGroups processed: 21.07K (21068) - RowGroups rejected: 0 (0) - RowGroups total: 21.07K (21068) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.57M (21573186) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000ef (host=foo.232.51:22000):(Total: 5m19s, non-child: 4m37s, % non-child: 86.81%) Hdfs split stats (:<# splits>/): 7:11/2.56 GB 4:18/4.35 GB 1:20/4.95 GB 5:11/2.53 GB 3:21/4.74 GB 2:22/5.45 GB 0:11/2.71 GB 6:13/3.22 GB Filter 0 arrival: 520ms Filter 9 arrival: 835ms Filter 8 arrival: 19s020ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 130.96 MB, 319.01 MB, 332.13 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.99 MB, 339.29 MB, 338.93 MB, 338.95 MB, 338.98 MB, 338.94 MB, 339.08 MB, 338.90 MB, 336.25 MB, 315.00 MB, 315.16 MB, 315.15 MB, 315.19 MB, 315.15 MB, 315.15 MB, 315.09 MB, 315.18 MB, 295.63 MB, 291.17 MB, 291.13 MB, 291.10 MB, 291.12 MB, 286.15 MB, 283.02 MB, 283.19 MB, 283.13 MB, 276.97 MB, 275.14 MB, 252.86 MB ThreadUsage(8s000ms): 4, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 3.97 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 342.41 MB (359047506) - PerHostPeakMemUsage: 1.36 GB (1456006718) - RowsProduced: 15.93M (15930315) - TotalNetworkReceiveTime: 18s569ms - TotalNetworkSendTime: 4m20s - TotalStorageWaitTime: 96.510ms - TotalThreadsInvoluntaryContextSwitches: 6.82K (6821) - TotalThreadsTotalWallClockTime: 21m8s - TotalThreadsSysTime: 1s837ms - TotalThreadsUserTime: 47s416ms - TotalThreadsVoluntaryContextSwitches: 32.96K (32956) Fragment Instance Lifecycle Timings: - ExecTime: 5m - ExecTreeExecTime: 3s640ms - OpenTime: 19s026ms - ExecTreeOpenTime: 18s540ms - PrepareTime: 42.508ms - ExecTreePrepareTime: 2.183ms DataStreamSender (dst_id=19):(Total: 19s509ms, non-child: 19s509ms, % non-child: 100.00%) - BytesSent: 2.16 GB (2324558452) - OverallThroughput: 113.63 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 15.93M (15930315) - SerializeBatchTime: 19s490ms - UncompressedRowBatchSize: 2.16 GB (2324558452) CodeGen:(Total: 508.945ms, non-child: 508.945ms, % non-child: 100.00%) - CodegenTime: 1.996ms - CompileTime: 152.422ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 333.170ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.825ms HASH_JOIN_NODE (id=9):(Total: 22s165ms, non-child: 3s061ms, % non-child: 13.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 257.888ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.93M (15930315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s783ms - RowsReturned: 15.93M (15930315) - RowsReturnedRate: 718.71 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.041ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 506.817us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.415ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s271ms, non-child: 17.812ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.518ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.29 K/sec RecvrSide: BytesReceived(8s000ms): 6.16 MB, 29.07 MB, 32.86 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s674ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s257ms - DataArrivalTimer: 18s253ms SenderSide: - DeserializeRowBatchTimer: 268.693ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s376ms, non-child: 664.368ms, % non-child: 12.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 395.850us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.93M (15930315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 621.119ms - RowsReturned: 15.93M (15930315) - RowsReturnedRate: 2.96 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 52.886us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 107.310us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.505us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 311.420ms, non-child: 10.704us, % non-child: 0.00%) - ConvertRowBatchTime: 2.857us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 292.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 311.413ms - DataArrivalTimer: 311.411ms SenderSide: - DeserializeRowBatchTimer: 13.830us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s400ms, non-child: 4s400ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:11/2.56 GB 4:18/4.35 GB 1:20/4.95 GB 5:11/2.53 GB 3:21/4.74 GB 2:22/5.45 GB 0:11/2.71 GB 6:13/3.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s236ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 54.68 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB, 145.80 MB - FooterProcessingTime: (Avg: 1.403ms ; Min: 625.866us ; Max: 2.913ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.96 - BytesRead: 145.80 MB (152885574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.80 MB (152885574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.80 MB (152885574) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 765.962ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 179.97 MB (188707072) - PerReadThreadRawHdfsThroughput: 988.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.987ms - RowBatchQueuePutWaitTime: 15m14s - RowsRead: 15.93M (15931493) - RowsReturned: 15.93M (15930315) - RowsReturnedRate: 3.62 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1312) - ScannerThreadsTotalWallClockTime: 15m29s - MaterializeTupleTime(*): 2s567ms - ScannerThreadsSysTime: 432.932ms - ScannerThreadsUserTime: 9s883ms - ScannerThreadsVoluntaryContextSwitches: 16.01K (16008) - TotalRawHdfsReadTime(*): 147.513ms - TotalReadThroughput: 474.73 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.33K (50330) - Rows rejected: 1.18K (1178) - Rows total: 15.93M (15931493) Filter 5 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.93M (15930315) Filter 6 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.93M (15930315) Filter 7 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.93M (15930315) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.93M (15930315) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 15.56K (15556) - RowGroups rejected: 0 (0) - RowGroups total: 15.56K (15556) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.93M (15930315) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000091 (host=foo.232.24:22000):(Total: 5m12s, non-child: 4m29s, % non-child: 86.25%) Hdfs split stats (:<# splits>/): 1:10/2.26 GB 5:15/3.64 GB 3:21/5.03 GB 4:18/4.31 GB 6:14/3.47 GB 0:14/3.47 GB 7:19/3.95 GB 2:19/4.31 GB Filter 9 arrival: 1s295ms Filter 0 arrival: 1s461ms Filter 8 arrival: 22s105ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 105.31 MB, 296.45 MB, 302.01 MB, 318.72 MB, 318.72 MB, 318.72 MB, 318.72 MB, 318.72 MB, 318.72 MB, 318.72 MB, 318.72 MB, 317.82 MB, 316.46 MB, 316.44 MB, 316.35 MB, 316.40 MB, 316.45 MB, 316.38 MB, 316.60 MB, 315.00 MB, 298.57 MB, 292.77 MB, 292.58 MB, 292.64 MB, 292.58 MB, 292.56 MB, 292.70 MB, 292.62 MB, 288.99 MB, 254.22 MB, 247.46 MB, 247.33 MB, 247.36 MB, 247.32 MB, 247.39 MB, 247.35 MB, 227.05 MB, 205.89 MB, 115.41 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 4.40 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 319.77 MB (335298035) - PerHostPeakMemUsage: 1.32 GB (1416421510) - RowsProduced: 14.60M (14602355) - TotalNetworkReceiveTime: 22s070ms - TotalNetworkSendTime: 4m14s - TotalStorageWaitTime: 96.757ms - TotalThreadsInvoluntaryContextSwitches: 28.11K (28105) - TotalThreadsTotalWallClockTime: 22m52s - TotalThreadsSysTime: 1s726ms - TotalThreadsUserTime: 4m16s - TotalThreadsVoluntaryContextSwitches: 29.51K (29507) Fragment Instance Lifecycle Timings: - ExecTime: 4m50s - ExecTreeExecTime: 3s263ms - OpenTime: 22s105ms - ExecTreeOpenTime: 21s616ms - PrepareTime: 46.238ms - ExecTreePrepareTime: 1.313ms DataStreamSender (dst_id=19):(Total: 17s605ms, non-child: 17s605ms, % non-child: 100.00%) - BytesSent: 1.98 GB (2128744456) - OverallThroughput: 115.31 MB/sec - PeakMemoryUsage: 7.93 MB (8310816) - RowsReturned: 14.60M (14602355) - SerializeBatchTime: 17s589ms - UncompressedRowBatchSize: 1.98 GB (2128744456) CodeGen:(Total: 516.939ms, non-child: 516.939ms, % non-child: 100.00%) - CodegenTime: 2.393ms - CompileTime: 158.775ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 328.639ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.457ms HASH_JOIN_NODE (id=9):(Total: 24s865ms, non-child: 2s871ms, % non-child: 11.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 281.670ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 14.60M (14602355) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s545ms - RowsReturned: 14.60M (14602355) - RowsReturnedRate: 587.26 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 239.593ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 409.524us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.155ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s321ms, non-child: 18.133ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.633ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.67 K/sec RecvrSide: BytesReceived(8s000ms): 3.74 MB, 27.82 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s607ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s306ms - DataArrivalTimer: 21s303ms SenderSide: - DeserializeRowBatchTimer: 278.445ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s222ms, non-child: 536.655ms, % non-child: 10.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 558.818us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 14.60M (14602355) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 495.099ms - RowsReturned: 14.60M (14602355) - RowsReturnedRate: 2.80 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.071us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 166.764us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.480us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 764.319ms, non-child: 13.009us, % non-child: 0.00%) - ConvertRowBatchTime: 3.602us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 119.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 764.309ms - DataArrivalTimer: 764.306ms SenderSide: - DeserializeRowBatchTimer: 71.888us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s921ms, non-child: 3s921ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:10/2.26 GB 5:15/3.64 GB 3:21/5.03 GB 4:18/4.31 GB 6:14/3.47 GB 0:14/3.47 GB 7:19/3.95 GB 2:19/4.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s772ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(8s000ms): 46.29 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB, 123.45 MB - FooterProcessingTime: (Avg: 1.572ms ; Min: 456.616us ; Max: 3.531ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.36 - BytesRead: 123.45 MB (129449747) - BytesReadDataNodeCache: 0 - BytesReadLocal: 123.45 MB (129449747) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 123.45 MB (129449747) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 630.315ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.44 MB (165090057) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.714ms - RowBatchQueuePutWaitTime: 13m33s - RowsRead: 14.60M (14603605) - RowsReturned: 14.60M (14602355) - RowsReturnedRate: 3.72 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 23.24K (23242) - ScannerThreadsTotalWallClockTime: 17m17s - MaterializeTupleTime(*): 2s427ms - ScannerThreadsSysTime: 392.939ms - ScannerThreadsUserTime: 3m42s - ScannerThreadsVoluntaryContextSwitches: 14.46K (14461) - TotalRawHdfsReadTime(*): 115.411ms - TotalReadThroughput: 409.11 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.40K (50402) - Rows rejected: 1.25K (1250) - Rows total: 14.60M (14603605) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 14.60M (14602355) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 14.60M (14602355) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 14.60M (14602355) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 14.60M (14602355) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 14.26K (14261) - RowGroups rejected: 0 (0) - RowGroups total: 14.26K (14261) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 14.60M (14602355) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000093 (host=foo.232.14:22000):(Total: 5m8s, non-child: 4m28s, % non-child: 86.89%) Hdfs split stats (:<# splits>/): 0:14/3.05 GB 1:13/3.06 GB 7:12/2.66 GB 5:15/3.46 GB 2:13/3.03 GB 6:20/4.42 GB 4:27/6.19 GB 3:17/4.21 GB Filter 9 arrival: 1s124ms Filter 0 arrival: 1s212ms Filter 8 arrival: 19s926ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 107.57 MB, 302.47 MB, 312.84 MB, 323.05 MB, 323.05 MB, 323.05 MB, 323.05 MB, 323.05 MB, 323.05 MB, 323.05 MB, 323.05 MB, 322.64 MB, 322.52 MB, 322.46 MB, 322.49 MB, 322.48 MB, 322.44 MB, 322.72 MB, 322.48 MB, 322.59 MB, 322.53 MB, 306.56 MB, 298.69 MB, 298.63 MB, 298.64 MB, 298.60 MB, 298.61 MB, 298.68 MB, 298.63 MB, 298.64 MB, 290.19 MB, 274.70 MB, 261.27 MB, 247.34 MB, 247.25 MB, 247.29 MB, 247.27 MB, 229.11 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.67 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 325.73 MB (341556915) - PerHostPeakMemUsage: 1.35 GB (1446295791) - RowsProduced: 14.74M (14742017) - TotalNetworkReceiveTime: 19s774ms - TotalNetworkSendTime: 4m13s - TotalStorageWaitTime: 109.105ms - TotalThreadsInvoluntaryContextSwitches: 33.19K (33187) - TotalThreadsTotalWallClockTime: 24m2s - TotalThreadsSysTime: 1s709ms - TotalThreadsUserTime: 4m56s - TotalThreadsVoluntaryContextSwitches: 42.99K (42994) Fragment Instance Lifecycle Timings: - ExecTime: 4m48s - ExecTreeExecTime: 3s108ms - OpenTime: 19s939ms - ExecTreeOpenTime: 19s468ms - PrepareTime: 44.736ms - ExecTreePrepareTime: 1.858ms DataStreamSender (dst_id=19):(Total: 17s402ms, non-child: 17s402ms, % non-child: 100.00%) - BytesSent: 2.00 GB (2150105363) - OverallThroughput: 117.83 MB/sec - PeakMemoryUsage: 7.87 MB (8253472) - RowsReturned: 14.74M (14742017) - SerializeBatchTime: 17s387ms - UncompressedRowBatchSize: 2.00 GB (2150105363) CodeGen:(Total: 499.974ms, non-child: 499.974ms, % non-child: 100.00%) - CodegenTime: 1.747ms - CompileTime: 150.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 320.634ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.719ms HASH_JOIN_NODE (id=9):(Total: 22s564ms, non-child: 2s693ms, % non-child: 11.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 277.054ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 14.74M (14742017) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s381ms - RowsReturned: 14.74M (14742017) - RowsReturnedRate: 653.33 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.987ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 837.672us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.104ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s179ms, non-child: 17.356ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.801ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.09 K/sec RecvrSide: BytesReceived(8s000ms): 4.14 MB, 28.12 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s377ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s164ms - DataArrivalTimer: 19s162ms SenderSide: - DeserializeRowBatchTimer: 178.398ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s250ms, non-child: 556.126ms, % non-child: 10.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 511.770us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 14.74M (14742017) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 517.496ms - RowsReturned: 14.74M (14742017) - RowsReturnedRate: 2.81 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.047us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 171.912us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.260us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 609.740ms, non-child: 15.652us, % non-child: 0.00%) - ConvertRowBatchTime: 5.516us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 149.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 609.728ms - DataArrivalTimer: 609.725ms SenderSide: - DeserializeRowBatchTimer: 37.841us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s084ms, non-child: 4s084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:14/3.05 GB 1:13/3.06 GB 7:12/2.66 GB 5:15/3.46 GB 2:13/3.03 GB 6:20/4.42 GB 4:27/6.19 GB 3:17/4.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:15 BytesRead(8s000ms): 49.54 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB, 132.11 MB - FooterProcessingTime: (Avg: 483.473us ; Min: 350.580us ; Max: 669.875us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.65 - BytesRead: 132.11 MB (138529638) - BytesReadDataNodeCache: 0 - BytesReadLocal: 132.11 MB (138529638) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 132.11 MB (138529638) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 663.808ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 163.46 MB (171396132) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.915ms - RowBatchQueuePutWaitTime: 14m8s - RowsRead: 14.74M (14743208) - RowsReturned: 14.74M (14742017) - RowsReturnedRate: 3.61 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 28.28K (28281) - ScannerThreadsTotalWallClockTime: 18m33s - MaterializeTupleTime(*): 2s463ms - ScannerThreadsSysTime: 497.922ms - ScannerThreadsUserTime: 4m23s - ScannerThreadsVoluntaryContextSwitches: 27.37K (27372) - TotalRawHdfsReadTime(*): 127.759ms - TotalReadThroughput: 442.82 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.34K (50343) - Rows rejected: 1.19K (1191) - Rows total: 14.74M (14743208) Filter 5 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 14.74M (14742017) Filter 6 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 14.74M (14742017) Filter 7 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 14.74M (14742017) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 14.74M (14742017) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 128 (128) - Files total: 131 (131) - RowGroups processed: 14.40K (14396) - RowGroups rejected: 0 (0) - RowGroups total: 14.40K (14396) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 14.74M (14742017) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000105 (host=foo.221.36:22000):(Total: 5m6s, non-child: 4m22s, % non-child: 85.57%) Hdfs split stats (:<# splits>/): 1:13/2.76 GB 0:18/4.46 GB 2:19/4.54 GB 6:17/4.21 GB 5:9/2.07 GB 4:19/4.13 GB 3:17/4.10 GB 7:19/4.37 GB Filter 0 arrival: 1s749ms Filter 9 arrival: 1s908ms Filter 8 arrival: 20s967ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 104.61 MB, 317.03 MB, 324.12 MB, 335.67 MB, 335.67 MB, 335.67 MB, 335.67 MB, 335.67 MB, 335.67 MB, 335.67 MB, 335.67 MB, 336.53 MB, 337.01 MB, 337.03 MB, 337.13 MB, 337.03 MB, 337.22 MB, 336.99 MB, 330.69 MB, 313.15 MB, 313.19 MB, 313.21 MB, 313.19 MB, 313.19 MB, 313.11 MB, 313.23 MB, 306.27 MB, 292.38 MB, 289.52 MB, 289.45 MB, 289.24 MB, 289.44 MB, 282.46 MB, 281.42 MB, 281.30 MB, 277.13 MB, 247.06 MB, 210.95 MB ThreadUsage(8s000ms): 4, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.41 MB (356942731) - PerHostPeakMemUsage: 1.36 GB (1456874272) - RowsProduced: 16.57M (16572436) - TotalNetworkReceiveTime: 21s504ms - TotalNetworkSendTime: 4m5s - TotalStorageWaitTime: 34.113ms - TotalThreadsInvoluntaryContextSwitches: 8.34K (8337) - TotalThreadsTotalWallClockTime: 20m35s - TotalThreadsSysTime: 1s878ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 37.84K (37841) Fragment Instance Lifecycle Timings: - ExecTime: 4m45s - ExecTreeExecTime: 3s482ms - OpenTime: 20s961ms - ExecTreeOpenTime: 20s433ms - PrepareTime: 62.363ms - ExecTreePrepareTime: 1.861ms DataStreamSender (dst_id=19):(Total: 19s809ms, non-child: 19s809ms, % non-child: 100.00%) - BytesSent: 2.25 GB (2416939701) - OverallThroughput: 116.36 MB/sec - PeakMemoryUsage: 7.99 MB (8376352) - RowsReturned: 16.57M (16572436) - SerializeBatchTime: 19s792ms - UncompressedRowBatchSize: 2.25 GB (2416939701) CodeGen:(Total: 562.188ms, non-child: 562.188ms, % non-child: 100.00%) - CodegenTime: 1.898ms - CompileTime: 140.772ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 386.475ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 34.404ms HASH_JOIN_NODE (id=9):(Total: 23s900ms, non-child: 2s952ms, % non-child: 12.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 236.980ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.00 MB (161485568) - ProbeRows: 16.57M (16572436) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s662ms - RowsReturned: 16.57M (16572436) - RowsReturnedRate: 693.39 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 195.216ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 404.875us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.927ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s185ms, non-child: 16.955ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.975ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.89 K/sec RecvrSide: BytesReceived(8s000ms): 2.99 MB, 27.24 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s838ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s171ms - DataArrivalTimer: 20s168ms SenderSide: - DeserializeRowBatchTimer: 174.018ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s316ms, non-child: 627.434ms, % non-child: 11.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 373.100us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.57M (16572436) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 587.722ms - RowsReturned: 16.57M (16572436) - RowsReturnedRate: 3.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.307us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 100.703us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.459us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s333ms, non-child: 14.272us, % non-child: 0.00%) - ConvertRowBatchTime: 4.116us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 68.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s333ms - DataArrivalTimer: 1s333ms SenderSide: - DeserializeRowBatchTimer: 41.779us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s356ms, non-child: 3s356ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:13/2.76 GB 0:18/4.46 GB 2:19/4.54 GB 6:17/4.21 GB 5:9/2.07 GB 4:19/4.13 GB 3:17/4.10 GB 7:19/4.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s153ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:15 BytesRead(8s000ms): 53.45 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB, 142.53 MB - FooterProcessingTime: (Avg: 507.152us ; Min: 309.156us ; Max: 638.969us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.99 - BytesRead: 142.53 MB (149455670) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.53 MB (149455670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.53 MB (149455670) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 737.765ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.01 MB (186660919) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 77.604ms - RowBatchQueuePutWaitTime: 14m32s - RowsRead: 16.57M (16573599) - RowsReturned: 16.57M (16572436) - RowsReturnedRate: 4.94 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 2.69K (2689) - ScannerThreadsTotalWallClockTime: 15m6s - MaterializeTupleTime(*): 2s637ms - ScannerThreadsSysTime: 440.932ms - ScannerThreadsUserTime: 24s234ms - ScannerThreadsVoluntaryContextSwitches: 21.72K (21721) - TotalRawHdfsReadTime(*): 124.451ms - TotalReadThroughput: 480.90 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.31K (50315) - Rows rejected: 1.16K (1163) - Rows total: 16.57M (16573599) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.57M (16572436) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.57M (16572436) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.57M (16572436) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.57M (16572436) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 128 (128) - Files total: 131 (131) - RowGroups processed: 16.18K (16184) - RowGroups rejected: 0 (0) - RowGroups total: 16.18K (16184) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.57M (16572436) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000009c (host=foo.232.26:22000):(Total: 5m6s, non-child: 4m25s, % non-child: 86.53%) Hdfs split stats (:<# splits>/): 0:14/3.28 GB 3:14/3.47 GB 5:11/2.43 GB 2:18/4.35 GB 4:18/4.33 GB 7:18/4.45 GB 6:15/3.67 GB 1:17/4.20 GB Filter 9 arrival: 1s120ms Filter 0 arrival: 1s416ms Filter 8 arrival: 19s615ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 113.59 MB, 318.48 MB, 330.09 MB, 339.16 MB, 339.16 MB, 339.16 MB, 339.16 MB, 339.16 MB, 339.16 MB, 339.16 MB, 339.16 MB, 338.82 MB, 338.46 MB, 338.51 MB, 338.46 MB, 338.53 MB, 338.48 MB, 338.54 MB, 330.56 MB, 314.64 MB, 314.62 MB, 314.75 MB, 314.60 MB, 314.76 MB, 314.68 MB, 314.59 MB, 310.14 MB, 296.80 MB, 290.80 MB, 290.84 MB, 290.81 MB, 290.92 MB, 290.77 MB, 289.87 MB, 282.86 MB, 282.80 MB, 282.68 MB, 202.27 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.66 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 341.81 MB (358417471) - PerHostPeakMemUsage: 1.35 GB (1451386358) - RowsProduced: 15.67M (15670103) - TotalNetworkReceiveTime: 19s466ms - TotalNetworkSendTime: 4m9s - TotalStorageWaitTime: 100.980ms - TotalThreadsInvoluntaryContextSwitches: 28.14K (28145) - TotalThreadsTotalWallClockTime: 23m47s - TotalThreadsSysTime: 2s723ms - TotalThreadsUserTime: 4m8s - TotalThreadsVoluntaryContextSwitches: 68.26K (68259) Fragment Instance Lifecycle Timings: - ExecTime: 4m47s - ExecTreeExecTime: 3s392ms - OpenTime: 19s634ms - ExecTreeOpenTime: 19s159ms - PrepareTime: 36.957ms - ExecTreePrepareTime: 1.599ms DataStreamSender (dst_id=19):(Total: 18s300ms, non-child: 18s300ms, % non-child: 100.00%) - BytesSent: 2.13 GB (2286877312) - OverallThroughput: 119.17 MB/sec - PeakMemoryUsage: 7.93 MB (8319008) - RowsReturned: 15.67M (15670103) - SerializeBatchTime: 18s280ms - UncompressedRowBatchSize: 2.13 GB (2286877312) CodeGen:(Total: 496.057ms, non-child: 496.057ms, % non-child: 100.00%) - CodegenTime: 1.677ms - CompileTime: 143.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 329.390ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.367ms HASH_JOIN_NODE (id=9):(Total: 22s538ms, non-child: 2s941ms, % non-child: 13.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 279.599ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 15.67M (15670103) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s624ms - RowsReturned: 15.67M (15670103) - RowsReturnedRate: 695.26 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 225.921ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 453.018us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.744ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s870ms, non-child: 19.116ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.379ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.48 K/sec RecvrSide: BytesReceived(8s000ms): 3.72 MB, 27.83 MB, 32.78 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s586ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s855ms - DataArrivalTimer: 18s851ms SenderSide: - DeserializeRowBatchTimer: 170.854ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s313ms, non-child: 594.151ms, % non-child: 11.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 478.243us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.67M (15670103) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 555.617ms - RowsReturned: 15.67M (15670103) - RowsReturnedRate: 2.95 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.524us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 145.018us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.467us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 611.006ms, non-child: 20.140us, % non-child: 0.00%) - ConvertRowBatchTime: 6.232us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 148.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 610.992ms - DataArrivalTimer: 610.987ms SenderSide: - DeserializeRowBatchTimer: 53.349us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s108ms, non-child: 4s108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:14/3.28 GB 3:14/3.47 GB 5:11/2.43 GB 2:18/4.35 GB 4:18/4.33 GB 7:18/4.45 GB 6:15/3.67 GB 1:17/4.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s958ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:15 BytesRead(8s000ms): 54.78 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB, 146.07 MB - FooterProcessingTime: (Avg: 596.880us ; Min: 352.382us ; Max: 736.430us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.64 - BytesRead: 146.07 MB (153163967) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.07 MB (153163967) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.07 MB (153163967) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 754.589ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 179.46 MB (188174968) - PerReadThreadRawHdfsThroughput: 975.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.478ms - RowBatchQueuePutWaitTime: 14m41s - RowsRead: 15.67M (15671300) - RowsReturned: 15.67M (15670103) - RowsReturnedRate: 3.81 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 22.90K (22901) - ScannerThreadsTotalWallClockTime: 18m20s - MaterializeTupleTime(*): 2s486ms - ScannerThreadsSysTime: 1s463ms - ScannerThreadsUserTime: 3m33s - ScannerThreadsVoluntaryContextSwitches: 52.61K (52613) - TotalRawHdfsReadTime(*): 149.814ms - TotalReadThroughput: 492.83 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.35K (50349) - Rows rejected: 1.20K (1197) - Rows total: 15.67M (15671300) Filter 5 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 15.67M (15670103) Filter 6 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 15.67M (15670103) Filter 7 (2.00 MB): - Rows processed: 27.65K (27648) - Rows rejected: 0 (0) - Rows total: 15.67M (15670103) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.67M (15670103) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 122 (122) - Files total: 125 (125) - RowGroups processed: 15.30K (15303) - RowGroups rejected: 0 (0) - RowGroups total: 15.30K (15303) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.67M (15670103) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000cc (host=foo.232.27:22000):(Total: 5m5s, non-child: 4m21s, % non-child: 85.69%) Hdfs split stats (:<# splits>/): 7:12/2.97 GB 2:21/5.04 GB 4:14/3.24 GB 6:12/2.97 GB 3:16/3.84 GB 5:22/5.42 GB 0:15/3.05 GB 1:15/3.46 GB Filter 0 arrival: 1s322ms Filter 9 arrival: 1s635ms Filter 8 arrival: 21s379ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 113.51 MB, 317.85 MB, 324.35 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.65 MB, 338.27 MB, 337.90 MB, 337.97 MB, 337.87 MB, 337.82 MB, 337.96 MB, 337.80 MB, 337.80 MB, 317.03 MB, 313.95 MB, 314.01 MB, 314.00 MB, 314.09 MB, 314.15 MB, 313.98 MB, 314.01 MB, 294.54 MB, 290.17 MB, 290.18 MB, 290.17 MB, 290.04 MB, 290.13 MB, 290.10 MB, 284.64 MB, 274.61 MB, 265.96 MB, 142.08 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.69 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 341.22 MB (357799851) - PerHostPeakMemUsage: 1.34 GB (1442870921) - RowsProduced: 16.11M (16105655) - TotalNetworkReceiveTime: 21s637ms - TotalNetworkSendTime: 4m5s - TotalStorageWaitTime: 107.435ms - TotalThreadsInvoluntaryContextSwitches: 29.48K (29484) - TotalThreadsTotalWallClockTime: 23m50s - TotalThreadsSysTime: 3s394ms - TotalThreadsUserTime: 4m22s - TotalThreadsVoluntaryContextSwitches: 123.22K (123216) Fragment Instance Lifecycle Timings: - ExecTime: 4m43s - ExecTreeExecTime: 3s422ms - OpenTime: 21s382ms - ExecTreeOpenTime: 20s856ms - PrepareTime: 44.172ms - ExecTreePrepareTime: 1.887ms DataStreamSender (dst_id=19):(Total: 18s878ms, non-child: 18s878ms, % non-child: 100.00%) - BytesSent: 2.19 GB (2348250883) - OverallThroughput: 118.62 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 16.11M (16105655) - SerializeBatchTime: 18s860ms - UncompressedRowBatchSize: 2.19 GB (2348250883) CodeGen:(Total: 551.205ms, non-child: 551.205ms, % non-child: 100.00%) - CodegenTime: 1.959ms - CompileTime: 157.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 367.457ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.776ms HASH_JOIN_NODE (id=9):(Total: 24s262ms, non-child: 2s916ms, % non-child: 12.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.897ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 16.11M (16105655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s611ms - RowsReturned: 16.11M (16105655) - RowsReturnedRate: 663.79 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 219.467ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 430.394us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.517ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s583ms, non-child: 17.848ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.512ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.45 K/sec RecvrSide: BytesReceived(8s000ms): 3.85 MB, 27.97 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s431ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s568ms - DataArrivalTimer: 20s565ms SenderSide: - DeserializeRowBatchTimer: 167.480ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s290ms, non-child: 621.842ms, % non-child: 11.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 524.382us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.11M (16105655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 580.882ms - RowsReturned: 16.11M (16105655) - RowsReturnedRate: 3.04 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 63.296us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 98.517us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 101.602us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s069ms, non-child: 13.197us, % non-child: 0.00%) - ConvertRowBatchTime: 3.228us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 85.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s069ms - DataArrivalTimer: 1s069ms SenderSide: - DeserializeRowBatchTimer: 25.199us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s598ms, non-child: 3s598ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:12/2.97 GB 2:21/5.04 GB 4:14/3.24 GB 6:12/2.97 GB 3:16/3.84 GB 5:22/5.42 GB 0:15/3.05 GB 1:15/3.46 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s431ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 54.11 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB, 144.29 MB - FooterProcessingTime: (Avg: 643.505us ; Min: 544.673us ; Max: 773.321us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.66 - BytesRead: 144.29 MB (151301728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.29 MB (151301728) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.29 MB (151301728) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 755.083ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.83 MB (187512197) - PerReadThreadRawHdfsThroughput: 937.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.408ms - RowBatchQueuePutWaitTime: 14m31s - RowsRead: 16.11M (16106768) - RowsReturned: 16.11M (16105655) - RowsReturnedRate: 4.48 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 24.30K (24298) - ScannerThreadsTotalWallClockTime: 18m22s - MaterializeTupleTime(*): 2s544ms - ScannerThreadsSysTime: 2s091ms - ScannerThreadsUserTime: 3m46s - ScannerThreadsVoluntaryContextSwitches: 107.78K (107783) - TotalRawHdfsReadTime(*): 153.968ms - TotalReadThroughput: 489.26 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.27K (50265) - Rows rejected: 1.11K (1113) - Rows total: 16.11M (16106768) Filter 5 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.11M (16105655) Filter 6 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.11M (16105655) Filter 7 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.11M (16105655) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.11M (16105655) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 15.73K (15727) - RowGroups rejected: 0 (0) - RowGroups total: 15.73K (15727) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.11M (16105655) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000f6 (host=foo.232.48:22000):(Total: 5m3s, non-child: 4m19s, % non-child: 85.48%) Hdfs split stats (:<# splits>/): 1:11/2.38 GB 6:19/4.64 GB 7:21/5.09 GB 4:15/3.72 GB 3:19/4.30 GB 0:13/3.15 GB 2:14/3.22 GB 5:17/3.93 GB Filter 0 arrival: 910ms Filter 9 arrival: 1s260ms Filter 8 arrival: 20s955ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 121.76 MB, 317.33 MB, 326.34 MB, 339.05 MB, 339.05 MB, 339.05 MB, 339.05 MB, 339.05 MB, 339.05 MB, 339.05 MB, 339.05 MB, 338.07 MB, 337.39 MB, 337.31 MB, 337.37 MB, 337.43 MB, 337.32 MB, 332.44 MB, 317.41 MB, 313.54 MB, 313.50 MB, 313.56 MB, 313.51 MB, 313.54 MB, 313.54 MB, 313.55 MB, 304.59 MB, 289.47 MB, 289.62 MB, 289.51 MB, 289.63 MB, 286.56 MB, 281.67 MB, 281.54 MB, 260.24 MB, 247.30 MB, 247.32 MB ThreadUsage(8s000ms): 3, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3 - AverageThreadTokens: 3.91 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.70 MB (357247837) - PerHostPeakMemUsage: 1.35 GB (1451278507) - RowsProduced: 16.14M (16144421) - TotalNetworkReceiveTime: 20s903ms - TotalNetworkSendTime: 4m2s - TotalStorageWaitTime: 114.481ms - TotalThreadsInvoluntaryContextSwitches: 6.92K (6925) - TotalThreadsTotalWallClockTime: 19m47s - TotalThreadsSysTime: 1s791ms - TotalThreadsUserTime: 49s395ms - TotalThreadsVoluntaryContextSwitches: 31.35K (31350) Fragment Instance Lifecycle Timings: - ExecTime: 4m42s - ExecTreeExecTime: 3s699ms - OpenTime: 20s956ms - ExecTreeOpenTime: 20s462ms - PrepareTime: 42.005ms - ExecTreePrepareTime: 1.353ms DataStreamSender (dst_id=19):(Total: 19s385ms, non-child: 19s385ms, % non-child: 100.00%) - BytesSent: 2.20 GB (2358772366) - OverallThroughput: 116.04 MB/sec - PeakMemoryUsage: 7.96 MB (8351776) - RowsReturned: 16.14M (16144421) - SerializeBatchTime: 19s368ms - UncompressedRowBatchSize: 2.20 GB (2358772366) CodeGen:(Total: 520.847ms, non-child: 520.847ms, % non-child: 100.00%) - CodegenTime: 2.240ms - CompileTime: 148.632ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 344.448ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.133ms HASH_JOIN_NODE (id=9):(Total: 24s146ms, non-child: 3s153ms, % non-child: 13.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 259.161ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.14M (16144421) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s854ms - RowsReturned: 16.14M (16144421) - RowsReturnedRate: 668.60 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 216.688ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 1.063ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.502ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s192ms, non-child: 17.509ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.945ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.88 K/sec RecvrSide: BytesReceived(8s000ms): 5.20 MB, 28.68 MB, 32.85 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s058ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s178ms - DataArrivalTimer: 20s175ms SenderSide: - DeserializeRowBatchTimer: 177.142ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s345ms, non-child: 651.431ms, % non-child: 12.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 388.462us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.14M (16144421) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 614.554ms - RowsReturned: 16.14M (16144421) - RowsReturnedRate: 3.02 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.534us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 103.322us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.737us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 725.361ms, non-child: 14.751us, % non-child: 0.00%) - ConvertRowBatchTime: 3.565us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 125.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 725.350ms - DataArrivalTimer: 725.347ms SenderSide: - DeserializeRowBatchTimer: 166.885us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s968ms, non-child: 3s968ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.38 GB 6:19/4.64 GB 7:21/5.09 GB 4:15/3.72 GB 3:19/4.30 GB 0:13/3.15 GB 2:14/3.22 GB 5:17/3.93 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s813ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:15 BytesRead(8s000ms): 52.94 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB, 141.16 MB - FooterProcessingTime: (Avg: 5.398ms ; Min: 357.453us ; Max: 14.476ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.89 - BytesRead: 141.16 MB (148019607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.16 MB (148019607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.16 MB (148019607) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 745.371ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.33 MB (186987969) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.081ms - RowBatchQueuePutWaitTime: 14m10s - RowsRead: 16.15M (16145623) - RowsReturned: 16.14M (16144421) - RowsReturnedRate: 4.07 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.69K (1689) - ScannerThreadsTotalWallClockTime: 14m22s - MaterializeTupleTime(*): 2s676ms - ScannerThreadsSysTime: 432.932ms - ScannerThreadsUserTime: 11s505ms - ScannerThreadsVoluntaryContextSwitches: 15.91K (15906) - TotalRawHdfsReadTime(*): 125.908ms - TotalReadThroughput: 483.45 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.35K (50354) - Rows rejected: 1.20K (1202) - Rows total: 16.15M (16145623) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.14M (16144421) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.14M (16144421) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.14M (16144421) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.14M (16144421) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 126 (126) - Files total: 129 (129) - RowGroups processed: 15.77K (15766) - RowGroups rejected: 0 (0) - RowGroups total: 15.77K (15766) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.14M (16144421) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000f2 (host=foo.221.21:22000):(Total: 5m2s, non-child: 4m12s, % non-child: 83.48%) Hdfs split stats (:<# splits>/): 7:5/1.24 GB 2:15/3.39 GB 0:21/5.18 GB 1:10/2.48 GB 6:21/5.14 GB 4:13/3.13 GB 3:23/5.25 GB 5:20/4.55 GB Filter 0 arrival: 1s923ms Filter 9 arrival: 2s661ms Filter 8 arrival: 22s125ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 114.67 MB, 373.42 MB, 377.54 MB, 395.39 MB, 395.39 MB, 395.39 MB, 395.39 MB, 395.39 MB, 395.39 MB, 395.39 MB, 395.39 MB, 394.62 MB, 393.52 MB, 393.49 MB, 393.57 MB, 393.56 MB, 393.37 MB, 378.47 MB, 361.54 MB, 361.53 MB, 361.53 MB, 361.66 MB, 361.58 MB, 358.18 MB, 332.31 MB, 329.82 MB, 329.92 MB, 329.82 MB, 329.77 MB, 329.77 MB, 329.81 MB, 329.94 MB, 288.60 MB, 288.56 MB, 288.41 MB, 288.56 MB, 236.86 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.80 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.83 MB (416103488) - PerHostPeakMemUsage: 1.40 GB (1500370086) - RowsProduced: 21.10M (21102833) - TotalNetworkReceiveTime: 23s469ms - TotalNetworkSendTime: 3m52s - TotalStorageWaitTime: 152.714ms - TotalThreadsInvoluntaryContextSwitches: 8.42K (8419) - TotalThreadsTotalWallClockTime: 24m10s - TotalThreadsSysTime: 2s702ms - TotalThreadsUserTime: 59s232ms - TotalThreadsVoluntaryContextSwitches: 78.40K (78401) Fragment Instance Lifecycle Timings: - ExecTime: 4m40s - ExecTreeExecTime: 4s459ms - OpenTime: 22s127ms - ExecTreeOpenTime: 21s633ms - PrepareTime: 63.766ms - ExecTreePrepareTime: 1.476ms DataStreamSender (dst_id=19):(Total: 23s393ms, non-child: 23s393ms, % non-child: 100.00%) - BytesSent: 2.87 GB (3084328040) - OverallThroughput: 125.74 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 21.10M (21102833) - SerializeBatchTime: 23s374ms - UncompressedRowBatchSize: 2.87 GB (3084328040) CodeGen:(Total: 525.167ms, non-child: 525.167ms, % non-child: 100.00%) - CodegenTime: 1.946ms - CompileTime: 165.949ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 326.469ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.063ms HASH_JOIN_NODE (id=9):(Total: 26s074ms, non-child: 3s797ms, % non-child: 14.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 262.297ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.10M (21102833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s470ms - RowsReturned: 21.10M (21102833) - RowsReturnedRate: 809.32 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 212.095ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 401.240us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.412ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s360ms, non-child: 16.675ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.630ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.63 K/sec RecvrSide: BytesReceived(8s000ms): 2.11 MB, 26.29 MB, 32.65 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s050ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s346ms - DataArrivalTimer: 21s344ms SenderSide: - DeserializeRowBatchTimer: 166.288ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s461ms, non-child: 765.866ms, % non-child: 14.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 606.451us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.10M (21102833) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 722.072ms - RowsReturned: 21.10M (21102833) - RowsReturnedRate: 3.86 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.360us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 152.196us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 83.612us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s122ms, non-child: 14.597us, % non-child: 0.00%) - ConvertRowBatchTime: 5.323us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 42.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s122ms - DataArrivalTimer: 2s122ms SenderSide: - DeserializeRowBatchTimer: 42.765us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s573ms, non-child: 2s573ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:5/1.24 GB 2:15/3.39 GB 0:21/5.18 GB 1:10/2.48 GB 6:21/5.14 GB 4:13/3.13 GB 3:23/5.25 GB 5:20/4.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s390ms Hdfs Read Thread Concurrency Bucket: 0:99.83% 1:0% 2:0.1681% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(8s000ms): 65.88 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB, 184.42 MB - FooterProcessingTime: (Avg: 1.071ms ; Min: 549.522us ; Max: 2.123ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.78 - BytesRead: 184.42 MB (193373835) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.42 MB (193373835) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.42 MB (193373835) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 975.163ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.42 MB (245804714) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.784ms - RowBatchQueuePutWaitTime: 18m29s - RowsRead: 21.10M (21104339) - RowsReturned: 21.10M (21102833) - RowsReturnedRate: 8.20 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 2.17K (2169) - ScannerThreadsTotalWallClockTime: 18m44s - MaterializeTupleTime(*): 3s373ms - ScannerThreadsSysTime: 1s101ms - ScannerThreadsUserTime: 13s831ms - ScannerThreadsVoluntaryContextSwitches: 60.08K (60083) - TotalRawHdfsReadTime(*): 175.396ms - TotalReadThroughput: 633.70 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.04K (67042) - Rows rejected: 1.51K (1506) - Rows total: 21.10M (21104339) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21102833) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21102833) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21102833) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.10M (21102833) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 20.61K (20608) - RowGroups rejected: 0 (0) - RowGroups total: 20.61K (20608) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.10M (21102833) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000096 (host=foo.232.40:22000):(Total: 4m59s, non-child: 4m16s, % non-child: 85.84%) Hdfs split stats (:<# splits>/): 5:13/3.20 GB 4:15/3.26 GB 3:20/4.95 GB 2:12/2.96 GB 6:15/3.55 GB 0:13/2.97 GB 7:13/3.22 GB 1:25/5.99 GB Filter 0 arrival: 868ms Filter 9 arrival: 1s182ms Filter 8 arrival: 19s227ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 104.30 MB, 317.45 MB, 328.44 MB, 336.48 MB, 336.48 MB, 336.48 MB, 336.48 MB, 336.48 MB, 336.48 MB, 336.48 MB, 336.48 MB, 337.14 MB, 337.55 MB, 337.47 MB, 337.48 MB, 337.52 MB, 337.45 MB, 335.98 MB, 316.15 MB, 313.69 MB, 313.61 MB, 313.72 MB, 313.60 MB, 313.69 MB, 313.60 MB, 308.67 MB, 289.74 MB, 289.67 MB, 289.76 MB, 289.66 MB, 289.74 MB, 289.76 MB, 289.53 MB, 287.15 MB, 281.79 MB, 281.70 MB, 245.93 MB ThreadUsage(8s000ms): 3, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 3.99 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.76 MB (357309619) - PerHostPeakMemUsage: 1.36 GB (1459154958) - RowsProduced: 16.36M (16357620) - TotalNetworkReceiveTime: 19s218ms - TotalNetworkSendTime: 4m - TotalStorageWaitTime: 126.547ms - TotalThreadsInvoluntaryContextSwitches: 6.73K (6732) - TotalThreadsTotalWallClockTime: 19m52s - TotalThreadsSysTime: 1s811ms - TotalThreadsUserTime: 47s486ms - TotalThreadsVoluntaryContextSwitches: 31.98K (31975) Fragment Instance Lifecycle Timings: - ExecTime: 4m39s - ExecTreeExecTime: 3s519ms - OpenTime: 19s237ms - ExecTreeOpenTime: 18s806ms - PrepareTime: 40.376ms - ExecTreePrepareTime: 1.084ms DataStreamSender (dst_id=19):(Total: 19s612ms, non-child: 19s612ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2389436643) - OverallThroughput: 116.19 MB/sec - PeakMemoryUsage: 7.90 MB (8286240) - RowsReturned: 16.36M (16357620) - SerializeBatchTime: 19s594ms - UncompressedRowBatchSize: 2.23 GB (2389436643) CodeGen:(Total: 457.317ms, non-child: 457.317ms, % non-child: 100.00%) - CodegenTime: 2.006ms - CompileTime: 133.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 296.631ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.479ms HASH_JOIN_NODE (id=9):(Total: 22s309ms, non-child: 3s033ms, % non-child: 13.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.159ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.36M (16357620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s726ms - RowsReturned: 16.36M (16357620) - RowsReturnedRate: 733.21 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.452ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 757.269us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.729ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s519ms, non-child: 17.433ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.852ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.95 K/sec RecvrSide: BytesReceived(8s000ms): 4.38 MB, 28.26 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s076ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s505ms - DataArrivalTimer: 18s502ms SenderSide: - DeserializeRowBatchTimer: 278.089ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s378ms, non-child: 601.699ms, % non-child: 11.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 416.239us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 16.36M (16357620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 564.034ms - RowsReturned: 16.36M (16357620) - RowsReturnedRate: 3.04 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.027us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 117.758us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.306us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 712.204ms, non-child: 11.910us, % non-child: 0.00%) - ConvertRowBatchTime: 3.565us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 127.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 712.195ms - DataArrivalTimer: 712.193ms SenderSide: - DeserializeRowBatchTimer: 70.138us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s065ms, non-child: 4s065ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:13/3.20 GB 4:15/3.26 GB 3:20/4.95 GB 2:12/2.96 GB 6:15/3.55 GB 0:13/2.97 GB 7:13/3.22 GB 1:25/5.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s896ms Hdfs Read Thread Concurrency Bucket: 0:99.83% 1:0% 2:0.1675% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:15 BytesRead(8s000ms): 44.70 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB, 141.05 MB - FooterProcessingTime: (Avg: 642.687us ; Min: 400.622us ; Max: 1.044ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 141.05 MB (147898841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.05 MB (147898841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.05 MB (147898841) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 743.232ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.45 MB (187117920) - PerReadThreadRawHdfsThroughput: 945.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.547ms - RowBatchQueuePutWaitTime: 14m22s - RowsRead: 16.36M (16358795) - RowsReturned: 16.36M (16357620) - RowsReturnedRate: 4.02 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1190) - ScannerThreadsTotalWallClockTime: 14m34s - MaterializeTupleTime(*): 2s627ms - ScannerThreadsSysTime: 396.938ms - ScannerThreadsUserTime: 9s985ms - ScannerThreadsVoluntaryContextSwitches: 16.24K (16244) - TotalRawHdfsReadTime(*): 149.179ms - TotalReadThroughput: 483.05 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.33K (50327) - Rows rejected: 1.18K (1175) - Rows total: 16.36M (16358795) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.36M (16357620) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.36M (16357620) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.36M (16357620) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.36M (16357620) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 123 (123) - Files total: 126 (126) - RowGroups processed: 15.97K (15975) - RowGroups rejected: 0 (0) - RowGroups total: 15.97K (15975) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.36M (16357620) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000dd (host=foo.232.37:22000):(Total: 4m59s, non-child: 4m15s, % non-child: 85.27%) Hdfs split stats (:<# splits>/): 0:20/4.71 GB 6:14/3.22 GB 4:19/4.43 GB 2:10/2.44 GB 3:17/4.16 GB 7:12/2.91 GB 5:20/4.75 GB 1:16/3.79 GB Filter 0 arrival: 904ms Filter 9 arrival: 1s219ms Filter 8 arrival: 21s687ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(8s000ms): 121.80 MB, 317.48 MB, 324.48 MB, 339.85 MB, 339.85 MB, 339.85 MB, 339.85 MB, 339.85 MB, 339.85 MB, 339.85 MB, 339.85 MB, 338.64 MB, 337.46 MB, 337.52 MB, 337.47 MB, 337.51 MB, 337.41 MB, 334.98 MB, 313.57 MB, 313.60 MB, 313.58 MB, 313.61 MB, 313.64 MB, 313.62 MB, 313.61 MB, 313.16 MB, 294.24 MB, 289.75 MB, 289.64 MB, 289.64 MB, 289.75 MB, 286.68 MB, 281.71 MB, 281.65 MB, 281.62 MB, 274.04 MB, 195.79 MB ThreadUsage(8s000ms): 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 2 - AverageThreadTokens: 4.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.79 MB (357348087) - PerHostPeakMemUsage: 1.34 GB (1437776842) - RowsProduced: 15.69M (15690495) - TotalNetworkReceiveTime: 21s570ms - TotalNetworkSendTime: 3m59s - TotalStorageWaitTime: 77.738ms - TotalThreadsInvoluntaryContextSwitches: 6.82K (6819) - TotalThreadsTotalWallClockTime: 20m1s - TotalThreadsSysTime: 1s698ms - TotalThreadsUserTime: 50s260ms - TotalThreadsVoluntaryContextSwitches: 30.97K (30971) Fragment Instance Lifecycle Timings: - ExecTime: 4m37s - ExecTreeExecTime: 3s411ms - OpenTime: 21s697ms - ExecTreeOpenTime: 21s193ms - PrepareTime: 44.640ms - ExecTreePrepareTime: 1.635ms DataStreamSender (dst_id=19):(Total: 18s951ms, non-child: 18s951ms, % non-child: 100.00%) - BytesSent: 2.13 GB (2289623722) - OverallThroughput: 115.22 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 15.69M (15690495) - SerializeBatchTime: 18s934ms - UncompressedRowBatchSize: 2.13 GB (2289623722) CodeGen:(Total: 531.965ms, non-child: 531.965ms, % non-child: 100.00%) - CodegenTime: 2.241ms - CompileTime: 156.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 346.095ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.338ms HASH_JOIN_NODE (id=9):(Total: 24s589ms, non-child: 2s906ms, % non-child: 11.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 270.362ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.69M (15690495) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s601ms - RowsReturned: 15.69M (15690495) - RowsReturnedRate: 638.09 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.559ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 758.452us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.902ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s912ms, non-child: 18.354ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.047ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.09 K/sec RecvrSide: BytesReceived(8s000ms): 5.16 MB, 28.69 MB, 32.82 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s040ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s897ms - DataArrivalTimer: 20s894ms SenderSide: - DeserializeRowBatchTimer: 273.223ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s305ms, non-child: 624.717ms, % non-child: 11.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 421.580us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.69M (15690495) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 585.067ms - RowsReturned: 15.69M (15690495) - RowsReturnedRate: 2.96 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 41.499us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 115.312us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.334us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 672.268ms, non-child: 12.381us, % non-child: 0.00%) - ConvertRowBatchTime: 3.922us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 135.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 672.259ms - DataArrivalTimer: 672.256ms SenderSide: - DeserializeRowBatchTimer: 76.769us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s008ms, non-child: 4s008ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:20/4.71 GB 6:14/3.22 GB 4:19/4.43 GB 2:10/2.44 GB 3:17/4.16 GB 7:12/2.91 GB 5:20/4.75 GB 1:16/3.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s854ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:15 BytesRead(8s000ms): 53.27 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB, 142.05 MB - FooterProcessingTime: (Avg: 1.213ms ; Min: 684.873us ; Max: 2.249ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.97 - BytesRead: 142.05 MB (148948833) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.05 MB (148948833) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.05 MB (148948833) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 737.412ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.46 MB (187126998) - PerReadThreadRawHdfsThroughput: 965.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.450ms - RowBatchQueuePutWaitTime: 14m11s - RowsRead: 15.69M (15691662) - RowsReturned: 15.69M (15690495) - RowsReturnedRate: 3.91 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 1.59K (1587) - ScannerThreadsTotalWallClockTime: 14m40s - MaterializeTupleTime(*): 2s488ms - ScannerThreadsSysTime: 373.941ms - ScannerThreadsUserTime: 13s946ms - ScannerThreadsVoluntaryContextSwitches: 16.19K (16186) - TotalRawHdfsReadTime(*): 147.128ms - TotalReadThroughput: 490.58 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.32K (50319) - Rows rejected: 1.17K (1167) - Rows total: 15.69M (15691662) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.69M (15690495) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.69M (15690495) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.69M (15690495) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.69M (15690495) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 125 (125) - Files total: 128 (128) - RowGroups processed: 15.32K (15323) - RowGroups rejected: 0 (0) - RowGroups total: 15.32K (15323) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.69M (15690495) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000ed (host=foo.232.35:22000):(Total: 4m52s, non-child: 4m13s, % non-child: 86.55%) Hdfs split stats (:<# splits>/): 0:14/3.23 GB 6:22/4.94 GB 1:8/1.98 GB 7:16/3.96 GB 5:25/6.18 GB 4:14/3.36 GB 3:17/4.09 GB 2:11/2.63 GB Filter 9 arrival: 787ms Filter 0 arrival: 1s158ms Filter 8 arrival: 20s758ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 107.52 MB, 301.89 MB, 310.29 MB, 324.32 MB, 324.32 MB, 324.32 MB, 324.32 MB, 324.32 MB, 324.32 MB, 324.32 MB, 324.32 MB, 323.03 MB, 321.99 MB, 321.90 MB, 321.83 MB, 321.90 MB, 321.73 MB, 321.95 MB, 321.80 MB, 321.92 MB, 312.37 MB, 298.04 MB, 298.00 MB, 298.07 MB, 297.98 MB, 298.10 MB, 287.80 MB, 264.69 MB, 264.65 MB, 249.63 MB, 248.57 MB, 243.12 MB, 240.67 MB, 240.76 MB, 240.72 MB, 209.58 MB ThreadUsage(8s000ms): 4, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 4.50 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 325.20 MB (340996339) - PerHostPeakMemUsage: 1.30 GB (1400725701) - RowsProduced: 13.52M (13519542) - TotalNetworkReceiveTime: 20s311ms - TotalNetworkSendTime: 3m59s - TotalStorageWaitTime: 95.048ms - TotalThreadsInvoluntaryContextSwitches: 29.50K (29496) - TotalThreadsTotalWallClockTime: 21m54s - TotalThreadsSysTime: 1s502ms - TotalThreadsUserTime: 4m22s - TotalThreadsVoluntaryContextSwitches: 26.76K (26759) Fragment Instance Lifecycle Timings: - ExecTime: 4m31s - ExecTreeExecTime: 2s741ms - OpenTime: 20s770ms - ExecTreeOpenTime: 20s313ms - PrepareTime: 44.165ms - ExecTreePrepareTime: 1.279ms DataStreamSender (dst_id=19):(Total: 15s827ms, non-child: 15s827ms, % non-child: 100.00%) - BytesSent: 1.83 GB (1966298326) - OverallThroughput: 118.48 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 13.52M (13519542) - SerializeBatchTime: 15s813ms - UncompressedRowBatchSize: 1.83 GB (1966298326) CodeGen:(Total: 481.815ms, non-child: 481.815ms, % non-child: 100.00%) - CodegenTime: 1.825ms - CompileTime: 137.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 317.628ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.760ms HASH_JOIN_NODE (id=9):(Total: 23s043ms, non-child: 2s390ms, % non-child: 10.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 268.660ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 13.52M (13519542) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s089ms - RowsReturned: 13.52M (13519542) - RowsReturnedRate: 586.70 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 218.722ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 403.446us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.922ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s033ms, non-child: 18.277ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.562ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.06 K/sec RecvrSide: BytesReceived(8s000ms): 4.02 MB, 28.03 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s340ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s018ms - DataArrivalTimer: 20s015ms SenderSide: - DeserializeRowBatchTimer: 171.199ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s191ms, non-child: 501.794ms, % non-child: 9.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 349.929us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 13.52M (13519542) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 469.370ms - RowsReturned: 13.52M (13519542) - RowsReturnedRate: 2.60 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.140us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 106.069us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.639us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 292.709ms, non-child: 11.934us, % non-child: 0.00%) - ConvertRowBatchTime: 3.137us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 310.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 292.700ms - DataArrivalTimer: 292.697ms SenderSide: - DeserializeRowBatchTimer: 17.349us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s396ms, non-child: 4s396ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:14/3.23 GB 6:22/4.94 GB 1:8/1.98 GB 7:16/3.96 GB 5:25/6.18 GB 4:14/3.36 GB 3:17/4.09 GB 2:11/2.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s274ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 47.25 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB, 125.99 MB - FooterProcessingTime: (Avg: 991.087us ; Min: 272.260us ; Max: 2.375ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.48 - BytesRead: 125.99 MB (132108023) - BytesReadDataNodeCache: 0 - BytesReadLocal: 125.99 MB (132108023) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125.99 MB (132108023) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 622.751ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 162.84 MB (170745148) - PerReadThreadRawHdfsThroughput: 925.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.086ms - RowBatchQueuePutWaitTime: 12m44s - RowsRead: 13.52M (13520720) - RowsReturned: 13.52M (13519542) - RowsReturnedRate: 3.08 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 25.08K (25077) - ScannerThreadsTotalWallClockTime: 16m40s - MaterializeTupleTime(*): 2s029ms - ScannerThreadsSysTime: 330.947ms - ScannerThreadsUserTime: 3m52s - ScannerThreadsVoluntaryContextSwitches: 13.50K (13499) - TotalRawHdfsReadTime(*): 136.151ms - TotalReadThroughput: 447.18 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.33K (50330) - Rows rejected: 1.18K (1178) - Rows total: 13.52M (13520720) Filter 5 (2.00 MB): - Rows processed: 24.58K (24576) - Rows rejected: 0 (0) - Rows total: 13.52M (13519542) Filter 6 (2.00 MB): - Rows processed: 24.58K (24576) - Rows rejected: 0 (0) - Rows total: 13.52M (13519542) Filter 7 (2.00 MB): - Rows processed: 24.58K (24576) - Rows rejected: 0 (0) - Rows total: 13.52M (13519542) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 13.52M (13519542) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 13.20K (13203) - RowGroups rejected: 0 (0) - RowGroups total: 13.20K (13203) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 13.52M (13519542) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000bc (host=foo.221.50:22000):(Total: 4m41s, non-child: 3m57s, % non-child: 84.29%) Hdfs split stats (:<# splits>/): 2:16/3.72 GB 3:13/2.98 GB 0:21/5.19 GB 5:19/4.70 GB 4:10/2.39 GB 6:16/3.60 GB 7:18/4.10 GB 1:14/3.47 GB Filter 9 arrival: 1s277ms Filter 0 arrival: 1s584ms Filter 8 arrival: 22s041ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 93.02 MB, 316.06 MB, 320.23 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 338.31 MB, 337.28 MB, 336.00 MB, 336.06 MB, 336.19 MB, 336.12 MB, 331.22 MB, 312.24 MB, 312.28 MB, 312.28 MB, 312.38 MB, 312.21 MB, 312.21 MB, 304.82 MB, 288.40 MB, 288.44 MB, 288.50 MB, 288.45 MB, 288.41 MB, 288.35 MB, 288.40 MB, 288.40 MB, 288.45 MB, 286.33 MB, 233.38 MB ThreadUsage(8s000ms): 3, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.33 MB (355816522) - PerHostPeakMemUsage: 1.35 GB (1445681303) - RowsProduced: 16.42M (16418803) - TotalNetworkReceiveTime: 22s047ms - TotalNetworkSendTime: 3m41s - TotalStorageWaitTime: 71.023ms - TotalThreadsInvoluntaryContextSwitches: 7.57K (7573) - TotalThreadsTotalWallClockTime: 18m56s - TotalThreadsSysTime: 2s228ms - TotalThreadsUserTime: 54s188ms - TotalThreadsVoluntaryContextSwitches: 127.05K (127050) Fragment Instance Lifecycle Timings: - ExecTime: 4m19s - ExecTreeExecTime: 3s396ms - OpenTime: 22s057ms - ExecTreeOpenTime: 21s577ms - PrepareTime: 50.184ms - ExecTreePrepareTime: 1.422ms DataStreamSender (dst_id=19):(Total: 18s812ms, non-child: 18s812ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2394727815) - OverallThroughput: 121.40 MB/sec - PeakMemoryUsage: 7.87 MB (8253472) - RowsReturned: 16.42M (16418803) - SerializeBatchTime: 18s796ms - UncompressedRowBatchSize: 2.23 GB (2394727815) CodeGen:(Total: 506.328ms, non-child: 506.328ms, % non-child: 100.00%) - CodegenTime: 1.731ms - CompileTime: 146.717ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 331.824ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.305ms HASH_JOIN_NODE (id=9):(Total: 24s959ms, non-child: 2s876ms, % non-child: 11.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 264.632ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 16.42M (16418803) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s569ms - RowsReturned: 16.42M (16418803) - RowsReturnedRate: 657.82 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 209.388ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 423.223us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.006ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s302ms, non-child: 18.074ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.215ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.69 K/sec RecvrSide: BytesReceived(8s000ms): 2.65 MB, 26.84 MB, 32.70 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s766ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s288ms - DataArrivalTimer: 21s284ms SenderSide: - DeserializeRowBatchTimer: 271.485ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s327ms, non-child: 651.376ms, % non-child: 12.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 383.214us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.42M (16418803) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 612.510ms - RowsReturned: 16.42M (16418803) - RowsReturnedRate: 3.08 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.702us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 143.997us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.847us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 758.521ms, non-child: 9.816us, % non-child: 0.00%) - ConvertRowBatchTime: 3.110us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 119.00 /sec RecvrSide: BytesReceived(8s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 758.514ms - DataArrivalTimer: 758.512ms SenderSide: - DeserializeRowBatchTimer: 40.483us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s918ms, non-child: 3s918ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:16/3.72 GB 3:13/2.98 GB 0:21/5.19 GB 5:19/4.70 GB 4:10/2.39 GB 6:16/3.60 GB 7:18/4.10 GB 1:14/3.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s773ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(8s000ms): 44.26 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB, 141.63 MB - FooterProcessingTime: (Avg: 495.521us ; Min: 334.063us ; Max: 625.378us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.96 - BytesRead: 141.63 MB (148509909) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.63 MB (148509909) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.63 MB (148509909) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 754.012ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.08 MB (185677894) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.149ms - RowBatchQueuePutWaitTime: 13m30s - RowsRead: 16.42M (16419976) - RowsReturned: 16.42M (16418803) - RowsReturnedRate: 4.19 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.34K (2337) - ScannerThreadsTotalWallClockTime: 13m52s - MaterializeTupleTime(*): 2s759ms - ScannerThreadsSysTime: 922.858ms - ScannerThreadsUserTime: 18s066ms - ScannerThreadsVoluntaryContextSwitches: 111.51K (111506) - TotalRawHdfsReadTime(*): 117.582ms - TotalReadThroughput: 515.20 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.33K (50325) - Rows rejected: 1.17K (1173) - Rows total: 16.42M (16419976) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.42M (16418803) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.42M (16418803) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.42M (16418803) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.42M (16418803) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 16.03K (16034) - RowGroups rejected: 0 (0) - RowGroups total: 16.03K (16034) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.42M (16418803) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000b6 (host=foo.221.35:22000):(Total: 4m39s, non-child: 3m55s, % non-child: 84.56%) Hdfs split stats (:<# splits>/): 1:15/3.50 GB 3:14/3.45 GB 2:14/3.39 GB 6:18/4.38 GB 7:15/3.51 GB 0:19/4.54 GB 5:9/2.20 GB 4:22/5.05 GB Filter 0 arrival: 1s769ms Filter 9 arrival: 1s908ms Filter 8 arrival: 19s917ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 83.82 MB, 313.29 MB, 323.80 MB, 334.14 MB, 334.14 MB, 334.14 MB, 334.14 MB, 334.14 MB, 334.14 MB, 334.14 MB, 334.14 MB, 333.62 MB, 333.28 MB, 333.36 MB, 333.50 MB, 333.30 MB, 329.01 MB, 309.53 MB, 309.59 MB, 309.48 MB, 309.52 MB, 309.51 MB, 307.53 MB, 293.15 MB, 285.63 MB, 285.72 MB, 285.71 MB, 285.66 MB, 285.73 MB, 285.78 MB, 285.76 MB, 282.71 MB, 269.51 MB, 243.89 MB ThreadUsage(8s000ms): 3, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 3, 3 - AverageThreadTokens: 4.67 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 336.67 MB (353025148) - PerHostPeakMemUsage: 1.34 GB (1442599544) - RowsProduced: 16.97M (16968479) - TotalNetworkReceiveTime: 20s538ms - TotalNetworkSendTime: 3m40s - TotalStorageWaitTime: 93.270ms - TotalThreadsInvoluntaryContextSwitches: 27.76K (27760) - TotalThreadsTotalWallClockTime: 21m44s - TotalThreadsSysTime: 2s340ms - TotalThreadsUserTime: 4m5s - TotalThreadsVoluntaryContextSwitches: 31.81K (31809) Fragment Instance Lifecycle Timings: - ExecTime: 4m19s - ExecTreeExecTime: 3s518ms - OpenTime: 19s936ms - ExecTreeOpenTime: 19s457ms - PrepareTime: 41.202ms - ExecTreePrepareTime: 1.214ms DataStreamSender (dst_id=19):(Total: 19s623ms, non-child: 19s623ms, % non-child: 100.00%) - BytesSent: 2.31 GB (2478189456) - OverallThroughput: 120.43 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 16.97M (16968479) - SerializeBatchTime: 19s602ms - UncompressedRowBatchSize: 2.31 GB (2478189456) CodeGen:(Total: 501.372ms, non-child: 501.372ms, % non-child: 100.00%) - CodegenTime: 1.715ms - CompileTime: 161.198ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 316.819ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.764ms HASH_JOIN_NODE (id=9):(Total: 22s959ms, non-child: 2s935ms, % non-child: 12.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 285.583ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 16.97M (16968479) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s599ms - RowsReturned: 16.97M (16968479) - RowsReturnedRate: 739.06 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 230.682ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 633.535us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.914ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s159ms, non-child: 18.065ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.402ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.11 K/sec RecvrSide: BytesReceived(8s000ms): 2.26 MB, 26.45 MB, 32.67 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s971ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s144ms - DataArrivalTimer: 19s141ms SenderSide: - DeserializeRowBatchTimer: 279.245ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s448ms, non-child: 653.862ms, % non-child: 12.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 347.828us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.97M (16968479) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 614.785ms - RowsReturned: 16.97M (16968479) - RowsReturnedRate: 3.11 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.140us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.549us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.340us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s393ms, non-child: 13.329us, % non-child: 0.00%) - ConvertRowBatchTime: 3.628us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 65.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s393ms - DataArrivalTimer: 1s393ms SenderSide: - DeserializeRowBatchTimer: 32.825us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s400ms, non-child: 3s400ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/3.50 GB 3:14/3.45 GB 2:14/3.39 GB 6:18/4.38 GB 7:15/3.51 GB 0:19/4.54 GB 5:9/2.20 GB 4:22/5.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s171ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:15 BytesRead(8s000ms): 43.86 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB, 140.36 MB - FooterProcessingTime: (Avg: 767.794us ; Min: 740.398us ; Max: 787.216us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.62 - BytesRead: 140.36 MB (147179225) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.36 MB (147179225) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.36 MB (147179225) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 734.648ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 174.31 MB (182781096) - PerReadThreadRawHdfsThroughput: 987.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.208ms - RowBatchQueuePutWaitTime: 13m14s - RowsRead: 16.97M (16969723) - RowsReturned: 16.97M (16968479) - RowsReturnedRate: 4.99 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 22.39K (22391) - ScannerThreadsTotalWallClockTime: 16m44s - MaterializeTupleTime(*): 2s700ms - ScannerThreadsSysTime: 1s064ms - ScannerThreadsUserTime: 3m28s - ScannerThreadsVoluntaryContextSwitches: 16.79K (16787) - TotalRawHdfsReadTime(*): 142.186ms - TotalReadThroughput: 517.01 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.40K (50396) - Rows rejected: 1.24K (1244) - Rows total: 16.97M (16969723) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.97M (16968479) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.97M (16968479) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.97M (16968479) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.97M (16968479) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 123 (123) - Files total: 126 (126) - RowGroups processed: 16.57K (16571) - RowGroups rejected: 0 (0) - RowGroups total: 16.57K (16571) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.97M (16968479) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000fe (host=foo.221.25:22000):(Total: 4m36s, non-child: 3m52s, % non-child: 84.00%) Hdfs split stats (:<# splits>/): 4:15/3.62 GB 7:18/4.43 GB 1:17/4.21 GB 2:16/3.58 GB 6:12/2.74 GB 5:15/3.48 GB 3:21/4.90 GB 0:14/3.41 GB Filter 0 arrival: 1s923ms Filter 9 arrival: 2s244ms Filter 8 arrival: 21s997ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 96.21 MB, 317.31 MB, 322.89 MB, 339.68 MB, 339.68 MB, 339.68 MB, 339.68 MB, 339.68 MB, 339.68 MB, 339.68 MB, 339.68 MB, 338.87 MB, 337.35 MB, 337.38 MB, 337.33 MB, 337.35 MB, 323.89 MB, 313.63 MB, 313.50 MB, 313.47 MB, 313.54 MB, 313.47 MB, 312.04 MB, 294.63 MB, 289.61 MB, 289.57 MB, 289.64 MB, 289.58 MB, 289.55 MB, 289.70 MB, 284.72 MB, 281.56 MB, 256.42 MB, 208.15 MB ThreadUsage(8s000ms): 3, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 3.98 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.68 MB (357223887) - PerHostPeakMemUsage: 1.32 GB (1416696524) - RowsProduced: 16.72M (16718942) - TotalNetworkReceiveTime: 22s806ms - TotalNetworkSendTime: 3m36s - TotalStorageWaitTime: 78.609ms - TotalThreadsInvoluntaryContextSwitches: 7.92K (7919) - TotalThreadsTotalWallClockTime: 18m18s - TotalThreadsSysTime: 4s994ms - TotalThreadsUserTime: 54s288ms - TotalThreadsVoluntaryContextSwitches: 487.57K (487568) Fragment Instance Lifecycle Timings: - ExecTime: 4m14s - ExecTreeExecTime: 3s391ms - OpenTime: 21s997ms - ExecTreeOpenTime: 21s436ms - PrepareTime: 42.122ms - ExecTreePrepareTime: 987.985us DataStreamSender (dst_id=19):(Total: 18s845ms, non-child: 18s845ms, % non-child: 100.00%) - BytesSent: 2.27 GB (2439603009) - OverallThroughput: 123.45 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 16.72M (16718942) - SerializeBatchTime: 18s824ms - UncompressedRowBatchSize: 2.27 GB (2439603009) CodeGen:(Total: 586.568ms, non-child: 586.568ms, % non-child: 100.00%) - CodegenTime: 1.896ms - CompileTime: 198.633ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 360.463ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.916ms HASH_JOIN_NODE (id=9):(Total: 24s812ms, non-child: 2s864ms, % non-child: 11.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 249.620ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.72M (16718942) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s563ms - RowsReturned: 16.72M (16718942) - RowsReturnedRate: 673.81 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 208.840ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 444.670us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.949ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s177ms, non-child: 17.162ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.621ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.82 K/sec RecvrSide: BytesReceived(8s000ms): 2.21 MB, 26.41 MB, 32.67 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s004ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s163ms - DataArrivalTimer: 21s160ms SenderSide: - DeserializeRowBatchTimer: 206.622ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s266ms, non-child: 645.888ms, % non-child: 12.26%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 402.659us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.72M (16718942) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 607.773ms - RowsReturned: 16.72M (16718942) - RowsReturnedRate: 3.17 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.200us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 120.819us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.291us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s643ms, non-child: 12.205us, % non-child: 0.00%) - ConvertRowBatchTime: 3.401us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 55.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s643ms - DataArrivalTimer: 1s643ms SenderSide: - DeserializeRowBatchTimer: 63.978us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s977ms, non-child: 2s977ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.62 GB 7:18/4.43 GB 1:17/4.21 GB 2:16/3.58 GB 6:12/2.74 GB 5:15/3.48 GB 3:21/4.90 GB 0:14/3.41 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s829ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:15 BytesRead(8s000ms): 52.95 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB, 141.20 MB - FooterProcessingTime: (Avg: 932.794us ; Min: 320.570us ; Max: 1.907ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 141.20 MB (148060682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.20 MB (148060682) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.20 MB (148060682) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 727.628ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.32 MB (186980956) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.008ms - RowBatchQueuePutWaitTime: 12m55s - RowsRead: 16.72M (16720097) - RowsReturned: 16.72M (16718942) - RowsReturnedRate: 5.61 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 2.69K (2694) - ScannerThreadsTotalWallClockTime: 13m18s - MaterializeTupleTime(*): 2s811ms - ScannerThreadsSysTime: 3s700ms - ScannerThreadsUserTime: 18s189ms - ScannerThreadsVoluntaryContextSwitches: 472.42K (472422) - TotalRawHdfsReadTime(*): 132.679ms - TotalReadThroughput: 526.74 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.31K (50307) - Rows rejected: 1.16K (1155) - Rows total: 16.72M (16720097) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.72M (16718942) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.72M (16718942) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 16.72M (16718942) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.72M (16718942) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 125 (125) - Files total: 128 (128) - RowGroups processed: 16.33K (16327) - RowGroups rejected: 0 (0) - RowGroups total: 16.33K (16327) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.72M (16718942) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000fd (host=foo.221.30:22000):(Total: 4m24s, non-child: 3m43s, % non-child: 84.45%) Hdfs split stats (:<# splits>/): 5:19/4.67 GB 0:17/3.72 GB 7:19/4.46 GB 6:11/2.68 GB 1:16/3.67 GB 3:20/4.48 GB 4:17/4.17 GB 2:9/2.12 GB Filter 9 arrival: 1s553ms Filter 0 arrival: 1s848ms Filter 8 arrival: 20s195ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(8s000ms): 79.90 MB, 301.29 MB, 310.18 MB, 320.63 MB, 320.63 MB, 320.63 MB, 320.63 MB, 320.63 MB, 320.63 MB, 320.63 MB, 320.63 MB, 321.33 MB, 321.23 MB, 321.34 MB, 321.39 MB, 321.42 MB, 321.39 MB, 304.47 MB, 297.56 MB, 297.58 MB, 297.53 MB, 297.50 MB, 297.64 MB, 288.48 MB, 254.52 MB, 247.27 MB, 247.22 MB, 247.24 MB, 247.08 MB, 247.19 MB, 247.20 MB, 244.64 MB, 150.98 MB ThreadUsage(8s000ms): 2, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 1 - AverageThreadTokens: 3.85 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 324.58 MB (340348245) - PerHostPeakMemUsage: 1.32 GB (1419515909) - RowsProduced: 15.22M (15218831) - TotalNetworkReceiveTime: 20s509ms - TotalNetworkSendTime: 3m29s - TotalStorageWaitTime: 96.535ms - TotalThreadsInvoluntaryContextSwitches: 9.66K (9656) - TotalThreadsTotalWallClockTime: 16m58s - TotalThreadsSysTime: 1s541ms - TotalThreadsUserTime: 1m14s - TotalThreadsVoluntaryContextSwitches: 29.46K (29463) Fragment Instance Lifecycle Timings: - ExecTime: 4m4s - ExecTreeExecTime: 3s081ms - OpenTime: 20s200ms - ExecTreeOpenTime: 19s747ms - PrepareTime: 43.962ms - ExecTreePrepareTime: 1.018ms DataStreamSender (dst_id=19):(Total: 17s838ms, non-child: 17s838ms, % non-child: 100.00%) - BytesSent: 2.07 GB (2220176053) - OverallThroughput: 118.70 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 15.22M (15218831) - SerializeBatchTime: 17s819ms - UncompressedRowBatchSize: 2.07 GB (2220176053) CodeGen:(Total: 480.297ms, non-child: 480.297ms, % non-child: 100.00%) - CodegenTime: 1.736ms - CompileTime: 149.039ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 302.873ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.816ms HASH_JOIN_NODE (id=9):(Total: 22s815ms, non-child: 2s657ms, % non-child: 11.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.732ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.22M (15218831) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s339ms - RowsReturned: 15.22M (15218831) - RowsReturnedRate: 667.05 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.809ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 503.581us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.978ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s465ms, non-child: 17.587ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.866ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.73 K/sec RecvrSide: BytesReceived(8s000ms): 2.06 MB, 26.26 MB, 32.63 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s032ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s450ms - DataArrivalTimer: 19s447ms SenderSide: - DeserializeRowBatchTimer: 188.953ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s302ms, non-child: 577.084ms, % non-child: 10.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 627.890us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.22M (15218831) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 540.321ms - RowsReturned: 15.22M (15218831) - RowsReturnedRate: 2.87 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.833us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 130.267us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.599us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s058ms, non-child: 9.690us, % non-child: 0.00%) - ConvertRowBatchTime: 2.689us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 85.00 /sec RecvrSide: BytesReceived(8s000ms): 1.07 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s058ms - DataArrivalTimer: 1s058ms SenderSide: - DeserializeRowBatchTimer: 48.127us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s666ms, non-child: 3s666ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.67 GB 0:17/3.72 GB 7:19/4.46 GB 6:11/2.68 GB 1:16/3.67 GB 3:20/4.48 GB 4:17/4.17 GB 2:9/2.12 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s516ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:15 BytesRead(8s000ms): 39.90 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB, 127.67 MB - FooterProcessingTime: (Avg: 1.603ms ; Min: 280.454us ; Max: 2.310ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.80 - BytesRead: 127.67 MB (133868694) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.67 MB (133868694) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.67 MB (133868694) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 649.435ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 162.32 MB (170202031) - PerReadThreadRawHdfsThroughput: 881.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.701ms - RowBatchQueuePutWaitTime: 11m30s - RowsRead: 15.22M (15220053) - RowsReturned: 15.22M (15218831) - RowsReturnedRate: 4.15 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 4.84K (4843) - ScannerThreadsTotalWallClockTime: 12m12s - MaterializeTupleTime(*): 2s519ms - ScannerThreadsSysTime: 336.947ms - ScannerThreadsUserTime: 41s700ms - ScannerThreadsVoluntaryContextSwitches: 14.99K (14992) - TotalRawHdfsReadTime(*): 144.852ms - TotalReadThroughput: 498.97 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.37K (50374) - Rows rejected: 1.22K (1222) - Rows total: 15.22M (15220053) Filter 5 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 15.22M (15218831) Filter 6 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 15.22M (15218831) Filter 7 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 15.22M (15218831) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 15.22M (15218831) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 125 (125) - Files total: 128 (128) - RowGroups processed: 14.86K (14862) - RowGroups rejected: 0 (0) - RowGroups total: 14.86K (14862) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.22M (15218831) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000a4 (host=foo.221.48:22000):(Total: 4m14s, non-child: 3m30s, % non-child: 82.70%) Hdfs split stats (:<# splits>/): 6:10/2.44 GB 7:17/4.13 GB 1:21/5.06 GB 3:22/5.34 GB 4:11/2.35 GB 2:14/3.06 GB 0:14/2.87 GB 5:21/5.04 GB Filter 9 arrival: 1s450ms Filter 0 arrival: 1s617ms Filter 8 arrival: 21s837ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.53 MB, 207.94 MB, 317.56 MB, 317.56 MB, 317.56 MB, 330.77 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.43 MB, 338.96 MB, 337.68 MB, 337.49 MB, 337.65 MB, 337.44 MB, 337.72 MB, 337.62 MB, 337.63 MB, 335.62 MB, 318.77 MB, 313.90 MB, 313.75 MB, 313.84 MB, 313.57 MB, 313.75 MB, 313.81 MB, 313.72 MB, 313.64 MB, 313.64 MB, 313.86 MB, 305.65 MB, 304.83 MB, 289.78 MB, 289.78 MB, 289.84 MB, 289.79 MB, 289.80 MB, 289.89 MB, 289.70 MB, 289.79 MB, 289.89 MB, 281.86 MB, 281.91 MB, 281.74 MB, 281.82 MB, 273.43 MB, 247.56 MB, 247.52 MB, 247.31 MB, 232.11 MB, 123.12 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 3, 3, 3, 3, 1 - AverageThreadTokens: 4.80 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.85 MB (357405909) - PerHostPeakMemUsage: 1.32 GB (1419969646) - RowsProduced: 16.82M (16819887) - TotalNetworkReceiveTime: 21s936ms - TotalNetworkSendTime: 3m15s - TotalStorageWaitTime: 88.429ms - TotalThreadsInvoluntaryContextSwitches: 29.23K (29229) - TotalThreadsTotalWallClockTime: 20m18s - TotalThreadsSysTime: 2s207ms - TotalThreadsUserTime: 4m17s - TotalThreadsVoluntaryContextSwitches: 30.67K (30667) Fragment Instance Lifecycle Timings: - ExecTime: 3m52s - ExecTreeExecTime: 3s195ms - OpenTime: 21s838ms - ExecTreeOpenTime: 21s326ms - PrepareTime: 40.499ms - ExecTreePrepareTime: 1.271ms DataStreamSender (dst_id=19):(Total: 18s904ms, non-child: 18s904ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2454931536) - OverallThroughput: 123.84 MB/sec - PeakMemoryUsage: 7.89 MB (8269856) - RowsReturned: 16.82M (16819887) - SerializeBatchTime: 18s888ms - UncompressedRowBatchSize: 2.29 GB (2454931536) CodeGen:(Total: 535.917ms, non-child: 535.917ms, % non-child: 100.00%) - CodegenTime: 2.162ms - CompileTime: 160.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 350.304ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.804ms HASH_JOIN_NODE (id=9):(Total: 24s506ms, non-child: 2s751ms, % non-child: 11.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 264.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.82M (16819887) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s444ms - RowsReturned: 16.82M (16819887) - RowsReturnedRate: 686.33 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 225.406ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 775.887us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.516ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s049ms, non-child: 17.847ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.780ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.95 K/sec RecvrSide: BytesReceived(4s000ms): 0, 6.46 MB, 24.92 MB, 30.00 MB, 32.60 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s748ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s035ms - DataArrivalTimer: 21s032ms SenderSide: - DeserializeRowBatchTimer: 174.260ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s238ms, non-child: 583.513ms, % non-child: 11.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 356.089us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.82M (16819887) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 548.377ms - RowsReturned: 16.82M (16819887) - RowsReturnedRate: 3.21 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.609us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 133.543us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.472us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 900.869ms, non-child: 12.600us, % non-child: 0.00%) - ConvertRowBatchTime: 3.354us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 101.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 900.859ms - DataArrivalTimer: 900.857ms SenderSide: - DeserializeRowBatchTimer: 38.275us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s753ms, non-child: 3s753ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:10/2.44 GB 7:17/4.13 GB 1:21/5.06 GB 3:22/5.34 GB 4:11/2.35 GB 2:14/3.06 GB 0:14/2.87 GB 5:21/5.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s612ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.27 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB, 141.69 MB - FooterProcessingTime: (Avg: 550.012us ; Min: 546.433us ; Max: 552.705us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.76 - BytesRead: 141.69 MB (148576157) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.69 MB (148576157) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.69 MB (148576157) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 730.786ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.57 MB (187240709) - PerReadThreadRawHdfsThroughput: 960.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.621ms - RowBatchQueuePutWaitTime: 11m47s - RowsRead: 16.82M (16821100) - RowsReturned: 16.82M (16819887) - RowsReturnedRate: 4.48 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 24.20K (24204) - ScannerThreadsTotalWallClockTime: 15m42s - MaterializeTupleTime(*): 2s605ms - ScannerThreadsSysTime: 1s080ms - ScannerThreadsUserTime: 3m41s - ScannerThreadsVoluntaryContextSwitches: 17.10K (17103) - TotalRawHdfsReadTime(*): 147.518ms - TotalReadThroughput: 578.06 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.37K (50365) - Rows rejected: 1.21K (1213) - Rows total: 16.82M (16821100) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.82M (16819887) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.82M (16819887) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 16.82M (16819887) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.82M (16819887) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 16.43K (16426) - RowGroups rejected: 0 (0) - RowGroups total: 16.43K (16426) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.82M (16819887) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000e3 (host=foo.221.43:22000):(Total: 4m1s, non-child: 3m18s, % non-child: 82.24%) Hdfs split stats (:<# splits>/): 7:16/3.79 GB 4:15/3.61 GB 2:12/2.97 GB 0:10/2.23 GB 6:19/4.70 GB 3:11/2.50 GB 1:21/5.00 GB 5:24/5.62 GB Filter 9 arrival: 1s574ms Filter 0 arrival: 1s713ms Filter 8 arrival: 22s274ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 201.62 MB, 309.36 MB, 309.34 MB, 309.35 MB, 317.33 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.63 MB, 330.90 MB, 329.05 MB, 329.35 MB, 329.36 MB, 329.45 MB, 329.40 MB, 329.37 MB, 329.45 MB, 329.33 MB, 329.32 MB, 329.48 MB, 324.48 MB, 305.63 MB, 305.54 MB, 305.40 MB, 305.45 MB, 305.45 MB, 305.43 MB, 305.48 MB, 305.58 MB, 305.45 MB, 305.48 MB, 305.62 MB, 303.46 MB, 285.52 MB, 281.56 MB, 281.85 MB, 281.59 MB, 281.63 MB, 277.55 MB, 248.63 MB, 248.20 MB, 248.15 MB, 248.22 MB, 245.02 MB, 240.32 MB, 240.26 MB, 186.84 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 3.99 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 332.60 MB (348759322) - PerHostPeakMemUsage: 1.29 GB (1384844262) - RowsProduced: 15.07M (15066708) - TotalNetworkReceiveTime: 22s516ms - TotalNetworkSendTime: 3m4s - TotalStorageWaitTime: 86.112ms - TotalThreadsInvoluntaryContextSwitches: 8.90K (8899) - TotalThreadsTotalWallClockTime: 16m5s - TotalThreadsSysTime: 2s132ms - TotalThreadsUserTime: 1m9s - TotalThreadsVoluntaryContextSwitches: 105.93K (105931) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 3s221ms - OpenTime: 22s281ms - ExecTreeOpenTime: 21s790ms - PrepareTime: 46.478ms - ExecTreePrepareTime: 1.265ms DataStreamSender (dst_id=19):(Total: 17s460ms, non-child: 17s460ms, % non-child: 100.00%) - BytesSent: 2.05 GB (2198160769) - OverallThroughput: 120.06 MB/sec - PeakMemoryUsage: 7.86 MB (8237088) - RowsReturned: 15.07M (15066708) - SerializeBatchTime: 17s442ms - UncompressedRowBatchSize: 2.05 GB (2198160769) CodeGen:(Total: 521.735ms, non-child: 521.735ms, % non-child: 100.00%) - CodegenTime: 1.779ms - CompileTime: 148.210ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 341.725ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 31.239ms HASH_JOIN_NODE (id=9):(Total: 24s997ms, non-child: 2s816ms, % non-child: 11.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 274.480ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.07M (15066708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s484ms - RowsReturned: 15.07M (15066708) - RowsReturnedRate: 602.74 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.564ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 446.823us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.243ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s490ms, non-child: 17.241ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.459ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.50 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.22 MB, 24.10 MB, 29.64 MB, 32.45 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s855ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s476ms - DataArrivalTimer: 21s473ms SenderSide: - DeserializeRowBatchTimer: 176.699ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s243ms, non-child: 568.141ms, % non-child: 10.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 608.990us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.07M (15066708) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 531.207ms - RowsReturned: 15.07M (15066708) - RowsReturnedRate: 2.87 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 45.715us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 174.109us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.676us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s039ms, non-child: 17.648us, % non-child: 0.00%) - ConvertRowBatchTime: 3.929us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 87.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s039ms - DataArrivalTimer: 1s039ms SenderSide: - DeserializeRowBatchTimer: 16.472us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s635ms, non-child: 3s635ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:16/3.79 GB 4:15/3.61 GB 2:12/2.97 GB 0:10/2.23 GB 6:19/4.70 GB 3:11/2.50 GB 1:21/5.00 GB 5:24/5.62 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s491ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 100.07 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB, 133.43 MB - FooterProcessingTime: (Avg: 519.118us ; Min: 358.543us ; Max: 605.521us ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 133.43 MB (139912359) - BytesReadDataNodeCache: 0 - BytesReadLocal: 133.43 MB (139912359) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 133.43 MB (139912359) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 673.857ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 170.33 MB (178605190) - PerReadThreadRawHdfsThroughput: 1002.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.714ms - RowBatchQueuePutWaitTime: 11m3s - RowsRead: 15.07M (15067863) - RowsReturned: 15.07M (15066708) - RowsReturnedRate: 4.14 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 4.16K (4159) - ScannerThreadsTotalWallClockTime: 11m40s - MaterializeTupleTime(*): 2s390ms - ScannerThreadsSysTime: 846.871ms - ScannerThreadsUserTime: 35s520ms - ScannerThreadsVoluntaryContextSwitches: 91.91K (91914) - TotalRawHdfsReadTime(*): 133.136ms - TotalReadThroughput: 569.30 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.31K (50307) - Rows rejected: 1.16K (1155) - Rows total: 15.07M (15067863) Filter 5 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.07M (15066708) Filter 6 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.07M (15066708) Filter 7 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 15.07M (15066708) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 15.07M (15066708) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 125 (125) - Files total: 128 (128) - RowGroups processed: 14.71K (14712) - RowGroups rejected: 0 (0) - RowGroups total: 14.71K (14712) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.07M (15066708) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000a3 (host=foo.221.23:22000):(Total: 3m51s, non-child: 3m7s, % non-child: 80.77%) Hdfs split stats (:<# splits>/): 3:20/4.95 GB 1:10/2.41 GB 7:19/4.61 GB 2:17/4.09 GB 0:20/4.85 GB 6:17/3.67 GB 4:15/3.66 GB 5:9/2.16 GB Filter 9 arrival: 1s655ms Filter 0 arrival: 1s948ms Filter 8 arrival: 22s738ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 189.71 MB, 316.16 MB, 316.17 MB, 316.15 MB, 322.43 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 338.32 MB, 336.55 MB, 336.16 MB, 336.34 MB, 336.18 MB, 336.13 MB, 336.24 MB, 336.23 MB, 336.15 MB, 336.25 MB, 321.28 MB, 312.35 MB, 312.23 MB, 312.30 MB, 312.37 MB, 312.28 MB, 312.38 MB, 312.29 MB, 305.17 MB, 290.34 MB, 288.27 MB, 288.21 MB, 288.35 MB, 288.31 MB, 288.31 MB, 288.26 MB, 288.20 MB, 288.28 MB, 288.27 MB, 288.34 MB, 288.32 MB, 288.44 MB, 286.29 MB, 259.86 MB, 214.02 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 3 - AverageThreadTokens: 4.95 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.44 MB (355924006) - PerHostPeakMemUsage: 1.32 GB (1417043785) - RowsProduced: 16.67M (16674180) - TotalNetworkReceiveTime: 23s141ms - TotalNetworkSendTime: 2m52s - TotalStorageWaitTime: 114.973ms - TotalThreadsInvoluntaryContextSwitches: 29.60K (29598) - TotalThreadsTotalWallClockTime: 19m5s - TotalThreadsSysTime: 2s933ms - TotalThreadsUserTime: 4m21s - TotalThreadsVoluntaryContextSwitches: 196.76K (196759) Fragment Instance Lifecycle Timings: - ExecTime: 3m28s - ExecTreeExecTime: 3s292ms - OpenTime: 22s744ms - ExecTreeOpenTime: 22s289ms - PrepareTime: 47.407ms - ExecTreePrepareTime: 1.302ms DataStreamSender (dst_id=19):(Total: 18s502ms, non-child: 18s502ms, % non-child: 100.00%) - BytesSent: 2.27 GB (2433669013) - OverallThroughput: 125.44 MB/sec - PeakMemoryUsage: 7.87 MB (8253472) - RowsReturned: 16.67M (16674180) - SerializeBatchTime: 18s482ms - UncompressedRowBatchSize: 2.27 GB (2433669013) CodeGen:(Total: 482.243ms, non-child: 482.243ms, % non-child: 100.00%) - CodegenTime: 1.807ms - CompileTime: 137.331ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 315.706ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.639ms HASH_JOIN_NODE (id=9):(Total: 25s568ms, non-child: 2s834ms, % non-child: 11.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 280.038ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.67M (16674180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s505ms - RowsReturned: 16.67M (16674180) - RowsReturnedRate: 652.14 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.072ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 553.338us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.193ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s997ms, non-child: 18.879ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.969ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.00 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.58 MB, 23.46 MB, 29.45 MB, 32.38 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s135ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s981ms - DataArrivalTimer: 21s978ms SenderSide: - DeserializeRowBatchTimer: 173.930ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s337ms, non-child: 583.063ms, % non-child: 10.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 428.100us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.67M (16674180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 546.431ms - RowsReturned: 16.67M (16674180) - RowsReturnedRate: 3.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.330us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 126.796us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.022us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s159ms, non-child: 12.596us, % non-child: 0.00%) - ConvertRowBatchTime: 3.203us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 78.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s159ms - DataArrivalTimer: 1s159ms SenderSide: - DeserializeRowBatchTimer: 65.679us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s594ms, non-child: 3s594ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:20/4.95 GB 1:10/2.41 GB 7:19/4.61 GB 2:17/4.09 GB 0:20/4.85 GB 6:17/3.67 GB 4:15/3.66 GB 5:9/2.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s412ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.16 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB, 141.55 MB - FooterProcessingTime: (Avg: 1.457ms ; Min: 603.584us ; Max: 2.555ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 141.55 MB (148421786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.55 MB (148421786) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.55 MB (148421786) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 750.291ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.15 MB (185750995) - PerReadThreadRawHdfsThroughput: 1022.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.767ms - RowBatchQueuePutWaitTime: 10m55s - RowsRead: 16.68M (16675395) - RowsReturned: 16.67M (16674180) - RowsReturnedRate: 4.64 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 24.77K (24768) - ScannerThreadsTotalWallClockTime: 14m50s - MaterializeTupleTime(*): 2s801ms - ScannerThreadsSysTime: 1s644ms - ScannerThreadsUserTime: 3m46s - ScannerThreadsVoluntaryContextSwitches: 182.63K (182631) - TotalRawHdfsReadTime(*): 138.403ms - TotalReadThroughput: 631.56 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.37K (50367) - Rows rejected: 1.22K (1215) - Rows total: 16.68M (16675395) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.67M (16674180) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.67M (16674180) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.67M (16674180) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.67M (16674180) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 16.28K (16283) - RowGroups rejected: 0 (0) - RowGroups total: 16.28K (16283) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.67M (16674180) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000a0 (host=foo.221.38:22000):(Total: 3m45s, non-child: 3m2s, % non-child: 81.10%) Hdfs split stats (:<# splits>/): 4:12/2.73 GB 5:17/3.99 GB 0:16/3.81 GB 7:16/3.71 GB 1:21/4.32 GB 2:15/3.53 GB 3:19/4.41 GB 6:19/4.31 GB Filter 9 arrival: 1s557ms Filter 0 arrival: 1s721ms Filter 8 arrival: 22s153ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 202.77 MB, 310.85 MB, 310.87 MB, 310.85 MB, 321.58 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 333.57 MB, 331.06 MB, 330.84 MB, 330.88 MB, 331.09 MB, 330.89 MB, 330.96 MB, 330.88 MB, 330.87 MB, 331.05 MB, 321.00 MB, 306.94 MB, 307.01 MB, 307.06 MB, 306.91 MB, 306.99 MB, 307.19 MB, 306.83 MB, 307.07 MB, 307.00 MB, 306.01 MB, 290.12 MB, 283.10 MB, 283.18 MB, 283.16 MB, 283.06 MB, 283.05 MB, 283.17 MB, 270.79 MB, 237.81 MB, 233.77 MB, 233.69 MB, 221.01 MB, 64.63 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.97 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 334.26 MB (350494759) - PerHostPeakMemUsage: 1.31 GB (1403689644) - RowsProduced: 14.79M (14794055) - TotalNetworkReceiveTime: 22s337ms - TotalNetworkSendTime: 2m48s - TotalStorageWaitTime: 129.356ms - TotalThreadsInvoluntaryContextSwitches: 7.25K (7251) - TotalThreadsTotalWallClockTime: 14m52s - TotalThreadsSysTime: 1s987ms - TotalThreadsUserTime: 54s494ms - TotalThreadsVoluntaryContextSwitches: 40.73K (40733) Fragment Instance Lifecycle Timings: - ExecTime: 3m22s - ExecTreeExecTime: 3s057ms - OpenTime: 22s155ms - ExecTreeOpenTime: 21s658ms - PrepareTime: 50.169ms - ExecTreePrepareTime: 1.495ms DataStreamSender (dst_id=19):(Total: 17s301ms, non-child: 17s301ms, % non-child: 100.00%) - BytesSent: 2.01 GB (2159115246) - OverallThroughput: 119.01 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 14.79M (14794055) - SerializeBatchTime: 17s286ms - UncompressedRowBatchSize: 2.01 GB (2159115246) CodeGen:(Total: 524.676ms, non-child: 524.676ms, % non-child: 100.00%) - CodegenTime: 2.542ms - CompileTime: 162.905ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 331.811ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.315ms HASH_JOIN_NODE (id=9):(Total: 24s701ms, non-child: 2s714ms, % non-child: 10.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 306.172ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 14.79M (14794055) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s372ms - RowsReturned: 14.79M (14794055) - RowsReturnedRate: 598.91 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 255.985ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 377.435us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.334ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s339ms, non-child: 18.990ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.847ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.65 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.47 MB, 24.18 MB, 29.70 MB, 32.46 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s855ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s324ms - DataArrivalTimer: 21s320ms SenderSide: - DeserializeRowBatchTimer: 289.788ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s211ms, non-child: 515.013ms, % non-child: 9.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 408.177us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 14.79M (14794055) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 480.572ms - RowsReturned: 14.79M (14794055) - RowsReturnedRate: 2.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 42.945us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 111.113us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.190us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s013ms, non-child: 14.277us, % non-child: 0.00%) - ConvertRowBatchTime: 3.665us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 89.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s013ms - DataArrivalTimer: 1s013ms SenderSide: - DeserializeRowBatchTimer: 37.489us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s682ms, non-child: 3s682ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:12/2.73 GB 5:17/3.99 GB 0:16/3.81 GB 7:16/3.71 GB 1:21/4.32 GB 2:15/3.53 GB 3:19/4.41 GB 6:19/4.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s512ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:132 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.14 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB, 141.52 MB - FooterProcessingTime: (Avg: 1.905ms ; Min: 1.380ms ; Max: 2.605ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 141.52 MB (148397999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.52 MB (148397999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.52 MB (148397999) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 760.834ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 171.84 MB (180187586) - PerReadThreadRawHdfsThroughput: 963.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.531ms - RowBatchQueuePutWaitTime: 10m22s - RowsRead: 14.80M (14795301) - RowsReturned: 14.79M (14794055) - RowsReturnedRate: 4.02 M/sec - ScanRangesComplete: 135 (135) - ScannerThreadsInvoluntaryContextSwitches: 2.82K (2818) - ScannerThreadsTotalWallClockTime: 10m44s - MaterializeTupleTime(*): 2s548ms - ScannerThreadsSysTime: 748.885ms - ScannerThreadsUserTime: 21s659ms - ScannerThreadsVoluntaryContextSwitches: 27.69K (27691) - TotalRawHdfsReadTime(*): 146.810ms - TotalReadThroughput: 654.27 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.40K (50398) - Rows rejected: 1.25K (1246) - Rows total: 14.80M (14795301) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 14.79M (14794055) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 14.79M (14794055) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 14.79M (14794055) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 14.79M (14794055) Filter 9 (8.00 KB): - Files processed: 135 (135) - Files rejected: 132 (132) - Files total: 135 (135) - RowGroups processed: 14.45K (14447) - RowGroups rejected: 0 (0) - RowGroups total: 14.45K (14447) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 14.79M (14794055) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000af (host=foo.221.51:22000):(Total: 3m44s, non-child: 3m1s, % non-child: 80.85%) Hdfs split stats (:<# splits>/): 4:21/4.97 GB 6:16/3.74 GB 5:19/4.58 GB 2:17/3.91 GB 1:11/2.44 GB 3:19/4.35 GB 7:14/3.28 GB 0:12/2.97 GB Filter 9 arrival: 1s199ms Filter 0 arrival: 1s576ms Filter 8 arrival: 21s624ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.53 MB, 222.73 MB, 315.91 MB, 315.91 MB, 315.90 MB, 328.68 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.34 MB, 336.77 MB, 335.89 MB, 335.90 MB, 336.03 MB, 335.88 MB, 336.01 MB, 335.98 MB, 336.09 MB, 335.99 MB, 335.94 MB, 330.12 MB, 312.05 MB, 312.07 MB, 312.00 MB, 312.04 MB, 312.15 MB, 311.95 MB, 306.06 MB, 288.21 MB, 287.93 MB, 288.13 MB, 288.15 MB, 288.13 MB, 288.16 MB, 288.18 MB, 288.08 MB, 288.08 MB, 288.11 MB, 288.05 MB, 288.12 MB, 288.03 MB, 285.99 MB, 231.90 MB, 102.84 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.97 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.31 MB (355797396) - PerHostPeakMemUsage: 1.34 GB (1434765277) - RowsProduced: 16.36M (16360453) - TotalNetworkReceiveTime: 21s580ms - TotalNetworkSendTime: 2m46s - TotalStorageWaitTime: 81.957ms - TotalThreadsInvoluntaryContextSwitches: 6.09K (6088) - TotalThreadsTotalWallClockTime: 14m51s - TotalThreadsSysTime: 2s547ms - TotalThreadsUserTime: 41s947ms - TotalThreadsVoluntaryContextSwitches: 143.85K (143851) Fragment Instance Lifecycle Timings: - ExecTime: 3m23s - ExecTreeExecTime: 3s154ms - OpenTime: 21s633ms - ExecTreeOpenTime: 21s164ms - PrepareTime: 44.192ms - ExecTreePrepareTime: 1.525ms DataStreamSender (dst_id=19):(Total: 18s236ms, non-child: 18s236ms, % non-child: 100.00%) - BytesSent: 2.22 GB (2386771793) - OverallThroughput: 124.82 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 16.36M (16360453) - SerializeBatchTime: 18s220ms - UncompressedRowBatchSize: 2.22 GB (2386771793) CodeGen:(Total: 490.876ms, non-child: 490.876ms, % non-child: 100.00%) - CodegenTime: 1.827ms - CompileTime: 152.092ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 316.220ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 22.083ms HASH_JOIN_NODE (id=9):(Total: 24s305ms, non-child: 2s702ms, % non-child: 11.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 252.646ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 16.36M (16360453) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s406ms - RowsReturned: 16.36M (16360453) - RowsReturnedRate: 673.11 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 207.970ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 347.636us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.864ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s899ms, non-child: 16.432ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.533ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.11 K/sec RecvrSide: BytesReceived(4s000ms): 0, 6.90 MB, 25.09 MB, 29.96 MB, 32.60 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s778ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s886ms - DataArrivalTimer: 20s883ms SenderSide: - DeserializeRowBatchTimer: 176.758ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s285ms, non-child: 577.844ms, % non-child: 10.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 821.770us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.36M (16360453) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 541.742ms - RowsReturned: 16.36M (16360453) - RowsReturnedRate: 3.10 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.972us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 446.909us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.791us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 693.975ms, non-child: 9.267us, % non-child: 0.00%) - ConvertRowBatchTime: 2.134us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 131.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 693.968ms - DataArrivalTimer: 693.966ms SenderSide: - DeserializeRowBatchTimer: 228.591us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s013ms, non-child: 4s013ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/4.97 GB 6:16/3.74 GB 5:19/4.58 GB 2:17/3.91 GB 1:11/2.44 GB 3:19/4.35 GB 7:14/3.28 GB 0:12/2.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s855ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.38 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB, 141.84 MB - FooterProcessingTime: (Avg: 2.268ms ; Min: 1.978ms ; Max: 2.499ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 141.84 MB (148725574) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.84 MB (148725574) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.84 MB (148725574) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 734.125ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 176.92 MB (185517673) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.810ms - RowBatchQueuePutWaitTime: 10m35s - RowsRead: 16.36M (16361608) - RowsReturned: 16.36M (16360453) - RowsReturnedRate: 4.08 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1386) - ScannerThreadsTotalWallClockTime: 10m45s - MaterializeTupleTime(*): 2s875ms - ScannerThreadsSysTime: 1s287ms - ScannerThreadsUserTime: 7s763ms - ScannerThreadsVoluntaryContextSwitches: 129.11K (129111) - TotalRawHdfsReadTime(*): 126.807ms - TotalReadThroughput: 652.76 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.31K (50307) - Rows rejected: 1.16K (1155) - Rows total: 16.36M (16361608) Filter 5 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.36M (16360453) Filter 6 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.36M (16360453) Filter 7 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.36M (16360453) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.36M (16360453) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 126 (126) - Files total: 129 (129) - RowGroups processed: 15.98K (15976) - RowGroups rejected: 0 (0) - RowGroups total: 15.98K (15976) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.36M (16360453) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000e8 (host=foo.221.24:22000):(Total: 3m37s, non-child: 2m57s, % non-child: 81.91%) Hdfs split stats (:<# splits>/): 3:9/2.03 GB 0:20/4.95 GB 1:20/4.63 GB 5:14/3.19 GB 2:19/4.61 GB 6:19/4.70 GB 7:16/3.90 GB 4:12/2.67 GB Filter 0 arrival: 1s900ms Filter 9 arrival: 2s012ms Filter 8 arrival: 20s278ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.53 MB, 194.86 MB, 300.32 MB, 300.34 MB, 300.34 MB, 321.81 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.62 MB, 321.12 MB, 320.24 MB, 320.27 MB, 320.42 MB, 320.26 MB, 320.24 MB, 320.32 MB, 320.36 MB, 320.47 MB, 320.42 MB, 314.60 MB, 296.45 MB, 296.56 MB, 296.53 MB, 296.52 MB, 296.36 MB, 296.54 MB, 296.65 MB, 296.62 MB, 296.35 MB, 293.51 MB, 253.30 MB, 246.70 MB, 246.74 MB, 246.50 MB, 246.70 MB, 246.79 MB, 246.63 MB, 246.75 MB, 246.92 MB, 246.74 MB, 108.83 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.97 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 323.81 MB (339534939) - PerHostPeakMemUsage: 1.29 GB (1390088687) - RowsProduced: 14.50M (14497737) - TotalNetworkReceiveTime: 20s957ms - TotalNetworkSendTime: 2m45s - TotalStorageWaitTime: 101.086ms - TotalThreadsInvoluntaryContextSwitches: 9.25K (9247) - TotalThreadsTotalWallClockTime: 14m22s - TotalThreadsSysTime: 2s034ms - TotalThreadsUserTime: 1m13s - TotalThreadsVoluntaryContextSwitches: 108.67K (108667) Fragment Instance Lifecycle Timings: - ExecTime: 3m16s - ExecTreeExecTime: 2s834ms - OpenTime: 20s291ms - ExecTreeOpenTime: 19s781ms - PrepareTime: 47.255ms - ExecTreePrepareTime: 1.500ms DataStreamSender (dst_id=19):(Total: 16s165ms, non-child: 16s165ms, % non-child: 100.00%) - BytesSent: 1.97 GB (2114251084) - OverallThroughput: 124.73 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 14.50M (14497737) - SerializeBatchTime: 16s152ms - UncompressedRowBatchSize: 1.97 GB (2114251084) CodeGen:(Total: 534.400ms, non-child: 534.400ms, % non-child: 100.00%) - CodegenTime: 2.374ms - CompileTime: 157.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 351.033ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.641ms HASH_JOIN_NODE (id=9):(Total: 22s603ms, non-child: 2s454ms, % non-child: 10.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.411ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 14.50M (14497737) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s147ms - RowsReturned: 14.50M (14497737) - RowsReturnedRate: 641.40 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 209.033ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 401.504us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.529ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s508ms, non-child: 17.417ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.551ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.68 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.28 MB, 24.19 MB, 29.74 MB, 32.52 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s023ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s493ms - DataArrivalTimer: 19s490ms SenderSide: - DeserializeRowBatchTimer: 283.158ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s173ms, non-child: 536.283ms, % non-child: 10.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 425.493us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 14.50M (14497737) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 503.750ms - RowsReturned: 14.50M (14497737) - RowsReturnedRate: 2.80 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.703us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 157.970us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.216us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s463ms, non-child: 11.439us, % non-child: 0.00%) - ConvertRowBatchTime: 3.535us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 62.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s463ms - DataArrivalTimer: 1s463ms SenderSide: - DeserializeRowBatchTimer: 27.580us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s174ms, non-child: 3s174ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:9/2.03 GB 0:20/4.95 GB 1:20/4.63 GB 5:14/3.19 GB 2:19/4.61 GB 6:19/4.70 GB 7:16/3.90 GB 4:12/2.67 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s050ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 97.93 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB, 130.57 MB - FooterProcessingTime: (Avg: 1.459ms ; Min: 348.113us ; Max: 2.134ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.92 - BytesRead: 130.57 MB (136912373) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.57 MB (136912373) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.57 MB (136912373) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 678.466ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 161.34 MB (169172831) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.032ms - RowBatchQueuePutWaitTime: 9m39s - RowsRead: 14.50M (14498922) - RowsReturned: 14.50M (14497737) - RowsReturnedRate: 4.57 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 4.98K (4982) - ScannerThreadsTotalWallClockTime: 10m23s - MaterializeTupleTime(*): 2s368ms - ScannerThreadsSysTime: 852.868ms - ScannerThreadsUserTime: 43s494ms - ScannerThreadsVoluntaryContextSwitches: 96.38K (96376) - TotalRawHdfsReadTime(*): 116.288ms - TotalReadThroughput: 624.78 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.34K (50337) - Rows rejected: 1.19K (1185) - Rows total: 14.50M (14498922) Filter 5 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 14.50M (14497737) Filter 6 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 14.50M (14497737) Filter 7 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 14.50M (14497737) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 14.50M (14497737) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 126 (126) - Files total: 129 (129) - RowGroups processed: 14.16K (14157) - RowGroups rejected: 0 (0) - RowGroups total: 14.16K (14157) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 14.50M (14497737) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000b9 (host=foo.221.13:22000):(Total: 3m36s, non-child: 2m53s, % non-child: 80.17%) Hdfs split stats (:<# splits>/): 2:18/3.80 GB 4:17/4.06 GB 3:14/3.16 GB 7:18/4.23 GB 5:11/2.57 GB 1:22/4.69 GB 0:13/2.81 GB 6:21/5.01 GB Filter 0 arrival: 2s102ms Filter 9 arrival: 2s420ms Filter 8 arrival: 22s842ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 189.55 MB, 315.95 MB, 315.95 MB, 315.94 MB, 321.24 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 337.10 MB, 336.25 MB, 331.60 MB, 330.43 MB, 330.30 MB, 330.49 MB, 330.39 MB, 330.42 MB, 330.47 MB, 330.45 MB, 330.44 MB, 323.37 MB, 306.52 MB, 306.56 MB, 306.60 MB, 306.55 MB, 306.51 MB, 306.48 MB, 303.62 MB, 282.59 MB, 282.65 MB, 282.62 MB, 277.53 MB, 274.68 MB, 274.60 MB, 251.89 MB, 243.33 MB, 240.22 MB, 240.30 MB, 240.24 MB, 214.95 MB, 68.50 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 1 - AverageThreadTokens: 4.92 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.30 MB (355781364) - PerHostPeakMemUsage: 1.24 GB (1326661336) - RowsProduced: 15.33M (15328958) - TotalNetworkReceiveTime: 23s912ms - TotalNetworkSendTime: 2m40s - TotalStorageWaitTime: 83.182ms - TotalThreadsInvoluntaryContextSwitches: 19.57K (19573) - TotalThreadsTotalWallClockTime: 17m45s - TotalThreadsSysTime: 7s644ms - TotalThreadsUserTime: 2m45s - TotalThreadsVoluntaryContextSwitches: 373.59K (373588) Fragment Instance Lifecycle Timings: - ExecTime: 3m13s - ExecTreeExecTime: 2s945ms - OpenTime: 22s849ms - ExecTreeOpenTime: 22s339ms - PrepareTime: 44.193ms - ExecTreePrepareTime: 1.412ms DataStreamSender (dst_id=19):(Total: 17s133ms, non-child: 17s133ms, % non-child: 100.00%) - BytesSent: 2.08 GB (2237152060) - OverallThroughput: 124.52 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 15.33M (15328958) - SerializeBatchTime: 17s115ms - UncompressedRowBatchSize: 2.08 GB (2237152060) CodeGen:(Total: 537.362ms, non-child: 537.362ms, % non-child: 100.00%) - CodegenTime: 1.880ms - CompileTime: 164.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 343.630ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.261ms HASH_JOIN_NODE (id=9):(Total: 25s273ms, non-child: 2s545ms, % non-child: 10.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.075ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.33M (15328958) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s225ms - RowsReturned: 15.33M (15328958) - RowsReturnedRate: 606.53 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.417ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 707.961us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.767ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 22s058ms, non-child: 17.330ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.542ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 20.94 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.40 MB, 23.20 MB, 29.39 MB, 32.35 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s230ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 22s044ms - DataArrivalTimer: 22s041ms SenderSide: - DeserializeRowBatchTimer: 185.943ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s197ms, non-child: 538.647ms, % non-child: 10.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 414.808us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.33M (15328958) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 502.283ms - RowsReturned: 15.33M (15328958) - RowsReturnedRate: 2.95 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.885us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 117.742us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.523us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s868ms, non-child: 13.080us, % non-child: 0.00%) - ConvertRowBatchTime: 3.010us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 48.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s868ms - DataArrivalTimer: 1s868ms SenderSide: - DeserializeRowBatchTimer: 23.637us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s790ms, non-child: 2s790ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:18/3.80 GB 4:17/4.06 GB 3:14/3.16 GB 7:18/4.23 GB 5:11/2.57 GB 1:22/4.69 GB 0:13/2.81 GB 6:21/5.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s649ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:130 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 106.45 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB, 141.93 MB - FooterProcessingTime: (Avg: 992.683us ; Min: 412.535us ; Max: 2.542ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 141.93 MB (148821040) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.93 MB (148821040) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.93 MB (148821040) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 707.530ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 176.87 MB (185462261) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.663ms - RowBatchQueuePutWaitTime: 11m24s - RowsRead: 15.33M (15330602) - RowsReturned: 15.33M (15328958) - RowsReturnedRate: 5.49 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 15.21K (15207) - ScannerThreadsTotalWallClockTime: 13m45s - MaterializeTupleTime(*): 2s445ms - ScannerThreadsSysTime: 6s521ms - ScannerThreadsUserTime: 2m13s - ScannerThreadsVoluntaryContextSwitches: 360.09K (360090) - TotalRawHdfsReadTime(*): 131.789ms - TotalReadThroughput: 680.72 KB/sec Filter 0 (8.00 KB): - Rows processed: 67.18K (67180) - Rows rejected: 1.64K (1644) - Rows total: 15.33M (15330602) Filter 5 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 15.33M (15328958) Filter 6 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 15.33M (15328958) Filter 7 (2.00 MB): - Rows processed: 31.74K (31744) - Rows rejected: 0 (0) - Rows total: 15.33M (15328958) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 15.33M (15328958) Filter 9 (8.00 KB): - Files processed: 134 (134) - Files rejected: 130 (130) - Files total: 134 (134) - RowGroups processed: 14.97K (14969) - RowGroups rejected: 0 (0) - RowGroups total: 14.97K (14969) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 15.33M (15328958) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000009b (host=foo.232.46:22000):(Total: 3m28s, non-child: 2m55s, % non-child: 83.86%) Hdfs split stats (:<# splits>/): 2:12/2.93 GB 6:16/3.52 GB 3:16/3.96 GB 5:20/4.88 GB 4:16/3.77 GB 1:18/4.41 GB 7:19/4.70 GB 0:11/2.56 GB Filter 9 arrival: 650ms Filter 0 arrival: 951ms Filter 8 arrival: 19s312ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 1.85 MB, 166.22 MB, 259.28 MB, 259.29 MB, 261.60 MB, 279.07 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.18 MB, 279.20 MB, 279.38 MB, 279.36 MB, 279.50 MB, 279.21 MB, 279.19 MB, 279.37 MB, 279.45 MB, 279.31 MB, 279.19 MB, 278.32 MB, 263.35 MB, 263.35 MB, 263.48 MB, 263.36 MB, 263.30 MB, 263.33 MB, 263.36 MB, 250.32 MB, 247.61 MB, 247.71 MB, 247.52 MB, 247.47 MB, 247.59 MB, 247.51 MB, 247.38 MB, 247.45 MB, 242.46 MB, 216.85 MB, 83.71 MB ThreadUsage(4s000ms): 2, 5, 5, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1 - AverageThreadTokens: 3.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.69 MB (296417149) - PerHostPeakMemUsage: 1.27 GB (1359098584) - RowsProduced: 10.71M (10708300) - TotalNetworkReceiveTime: 18s597ms - TotalNetworkSendTime: 2m45s - TotalStorageWaitTime: 90.511ms - TotalThreadsInvoluntaryContextSwitches: 5.05K (5051) - TotalThreadsTotalWallClockTime: 10m36s - TotalThreadsSysTime: 2s258ms - TotalThreadsUserTime: 36s432ms - TotalThreadsVoluntaryContextSwitches: 118.25K (118250) Fragment Instance Lifecycle Timings: - ExecTime: 3m9s - ExecTreeExecTime: 2s106ms - OpenTime: 19s321ms - ExecTreeOpenTime: 18s839ms - PrepareTime: 39.214ms - ExecTreePrepareTime: 1.147ms DataStreamSender (dst_id=19):(Total: 12s296ms, non-child: 12s296ms, % non-child: 100.00%) - BytesSent: 1.45 GB (1561201705) - OverallThroughput: 121.08 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 10.71M (10708300) - SerializeBatchTime: 12s286ms - UncompressedRowBatchSize: 1.45 GB (1561201705) CodeGen:(Total: 505.000ms, non-child: 505.000ms, % non-child: 100.00%) - CodegenTime: 2.025ms - CompileTime: 155.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 325.287ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 23.781ms HASH_JOIN_NODE (id=9):(Total: 20s937ms, non-child: 1s978ms, % non-child: 9.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 246.836ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.71M (10708300) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s609ms - RowsReturned: 10.71M (10708300) - RowsReturnedRate: 511.43 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 199.448ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 313.324us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.555ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s479ms, non-child: 16.185ms, % non-child: 0.09%) - ConvertRowBatchTime: 11.319ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.00 K/sec RecvrSide: BytesReceived(4s000ms): 0, 8.12 MB, 25.80 MB, 30.27 MB, 32.70 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s108ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s466ms - DataArrivalTimer: 18s463ms SenderSide: - DeserializeRowBatchTimer: 176.167ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s050ms, non-child: 382.850ms, % non-child: 7.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 499.309us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 10.71M (10708300) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 356.831ms - RowsReturned: 10.71M (10708300) - RowsReturnedRate: 2.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 49.221us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 142.517us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.678us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 130.453ms, non-child: 11.616us, % non-child: 0.01%) - ConvertRowBatchTime: 3.404us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 697.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 130.444ms - DataArrivalTimer: 130.442ms SenderSide: - DeserializeRowBatchTimer: 39.642us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s537ms, non-child: 4s537ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:12/2.93 GB 6:16/3.52 GB 3:16/3.96 GB 5:20/4.88 GB 4:16/3.77 GB 1:18/4.41 GB 7:19/4.70 GB 0:11/2.56 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s414ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 59.30 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB, 94.88 MB - FooterProcessingTime: (Avg: 2.433ms ; Min: 2.267ms ; Max: 2.599ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.99 - BytesRead: 94.88 MB (99493602) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.88 MB (99493602) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.88 MB (99493602) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 465.757ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.25 MB (126093476) - PerReadThreadRawHdfsThroughput: 730.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.345ms - RowBatchQueuePutWaitTime: 6m32s - RowsRead: 10.71M (10709089) - RowsReturned: 10.71M (10708300) - RowsReturnedRate: 2.36 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1757) - ScannerThreadsTotalWallClockTime: 6m48s - MaterializeTupleTime(*): 1s715ms - ScannerThreadsSysTime: 1s395ms - ScannerThreadsUserTime: 13s604ms - ScannerThreadsVoluntaryContextSwitches: 108.28K (108280) - TotalRawHdfsReadTime(*): 129.957ms - TotalReadThroughput: 471.66 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.56K (33557) - Rows rejected: 789 (789) - Rows total: 10.71M (10709089) Filter 5 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 10.71M (10708300) Filter 6 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 10.71M (10708300) Filter 7 (2.00 MB): - Rows processed: 22.53K (22528) - Rows rejected: 0 (0) - Rows total: 10.71M (10708300) Filter 8 (256.00 KB): - Rows processed: 5.12K (5120) - Rows rejected: 0 (0) - Rows total: 10.71M (10708300) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 10.46K (10457) - RowGroups rejected: 0 (0) - RowGroups total: 10.46K (10457) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.71M (10708300) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000d8 (host=foo.232.36:22000):(Total: 3m25s, non-child: 2m49s, % non-child: 82.77%) Hdfs split stats (:<# splits>/): 0:16/3.86 GB 6:17/4.21 GB 3:19/4.39 GB 5:9/2.23 GB 4:17/3.97 GB 1:17/4.05 GB 2:19/4.25 GB 7:15/3.59 GB Filter 0 arrival: 883ms Filter 9 arrival: 1s458ms Filter 8 arrival: 21s524ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 2.71 MB, 198.93 MB, 261.57 MB, 261.55 MB, 261.54 MB, 275.26 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.49 MB, 283.38 MB, 281.73 MB, 281.47 MB, 281.47 MB, 281.49 MB, 281.39 MB, 281.52 MB, 281.74 MB, 281.43 MB, 278.68 MB, 265.83 MB, 265.62 MB, 265.71 MB, 265.55 MB, 265.69 MB, 265.77 MB, 265.66 MB, 265.60 MB, 253.88 MB, 249.79 MB, 249.73 MB, 249.75 MB, 249.63 MB, 245.80 MB, 241.77 MB, 241.71 MB, 233.71 MB, 225.12 MB, 68.63 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1 - AverageThreadTokens: 4.94 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 284.90 MB (298735029) - PerHostPeakMemUsage: 1.26 GB (1351808176) - RowsProduced: 10.45M (10446561) - TotalNetworkReceiveTime: 21s725ms - TotalNetworkSendTime: 2m41s - TotalStorageWaitTime: 60.124ms - TotalThreadsInvoluntaryContextSwitches: 44.74K (44737) - TotalThreadsTotalWallClockTime: 16m53s - TotalThreadsSysTime: 39s926ms - TotalThreadsUserTime: 6m11s - TotalThreadsVoluntaryContextSwitches: 4.02M (4018487) Fragment Instance Lifecycle Timings: - ExecTime: 3m3s - ExecTreeExecTime: 1s974ms - OpenTime: 21s530ms - ExecTreeOpenTime: 21s042ms - PrepareTime: 43.099ms - ExecTreePrepareTime: 1.527ms DataStreamSender (dst_id=19):(Total: 11s832ms, non-child: 11s832ms, % non-child: 100.00%) - BytesSent: 1.42 GB (1521649526) - OverallThroughput: 122.65 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 10.45M (10446561) - SerializeBatchTime: 11s822ms - UncompressedRowBatchSize: 1.42 GB (1521649526) CodeGen:(Total: 513.482ms, non-child: 513.482ms, % non-child: 100.00%) - CodegenTime: 1.982ms - CompileTime: 152.142ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 334.098ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.756ms HASH_JOIN_NODE (id=9):(Total: 23s010ms, non-child: 1s742ms, % non-child: 7.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 225.744ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.45M (10446561) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s498ms - RowsReturned: 10.45M (10446561) - RowsReturnedRate: 454.00 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 179.506ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 489.307us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.384ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s806ms, non-child: 14.100ms, % non-child: 0.07%) - ConvertRowBatchTime: 10.281ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.20 K/sec RecvrSide: BytesReceived(4s000ms): 140.23 KB, 10.55 MB, 26.69 MB, 30.61 MB, 32.75 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s033ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s794ms - DataArrivalTimer: 20s792ms SenderSide: - DeserializeRowBatchTimer: 169.885ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s017ms, non-child: 364.684ms, % non-child: 7.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 580.903us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 10.45M (10446561) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 341.195ms - RowsReturned: 10.45M (10446561) - RowsReturnedRate: 2.08 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 50.359us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.623us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 124.451us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 930.413ms, non-child: 14.026us, % non-child: 0.00%) - ConvertRowBatchTime: 3.097us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 97.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 930.403ms - DataArrivalTimer: 930.400ms SenderSide: - DeserializeRowBatchTimer: 121.538us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s722ms, non-child: 3s722ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:16/3.86 GB 6:17/4.21 GB 3:19/4.39 GB 5:9/2.23 GB 4:17/3.97 GB 1:17/4.05 GB 2:19/4.25 GB 7:15/3.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s611ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 73.72 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB, 98.30 MB - FooterProcessingTime: (Avg: 2.614ms ; Min: 2.597ms ; Max: 2.632ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 98.30 MB (103074659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 98.30 MB (103074659) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 98.30 MB (103074659) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 492.487ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.51 MB (128461876) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.505ms - RowBatchQueuePutWaitTime: 6m27s - RowsRead: 10.45M (10447274) - RowsReturned: 10.45M (10446561) - RowsReturnedRate: 2.81 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 41.48K (41482) - ScannerThreadsTotalWallClockTime: 13m6s - MaterializeTupleTime(*): 1s666ms - ScannerThreadsSysTime: 39s097ms - ScannerThreadsUserTime: 5m49s - ScannerThreadsVoluntaryContextSwitches: 4.01M (4007856) - TotalRawHdfsReadTime(*): 92.104ms - TotalReadThroughput: 499.55 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.48K (33481) - Rows rejected: 713 (713) - Rows total: 10.45M (10447274) Filter 5 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.45M (10446561) Filter 6 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.45M (10446561) Filter 7 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.45M (10446561) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.45M (10446561) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 127 (127) - Files total: 129 (129) - RowGroups processed: 10.20K (10201) - RowGroups rejected: 0 (0) - RowGroups total: 10.20K (10201) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.45M (10446561) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000090 (host=foo.232.41:22000):(Total: 3m21s, non-child: 2m48s, % non-child: 83.96%) Hdfs split stats (:<# splits>/): 1:15/3.40 GB 0:17/3.90 GB 6:11/2.62 GB 5:16/3.85 GB 2:17/3.60 GB 3:23/5.23 GB 4:15/3.37 GB 7:18/4.42 GB Filter 9 arrival: 577ms Filter 0 arrival: 842ms Filter 8 arrival: 19s417ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 1.57 MB, 160.75 MB, 250.56 MB, 250.57 MB, 253.33 MB, 270.07 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 269.98 MB, 270.35 MB, 270.48 MB, 270.60 MB, 270.45 MB, 270.63 MB, 270.57 MB, 270.63 MB, 270.52 MB, 270.29 MB, 259.59 MB, 254.49 MB, 254.67 MB, 254.63 MB, 254.64 MB, 254.73 MB, 254.76 MB, 254.72 MB, 254.67 MB, 254.53 MB, 249.64 MB, 238.85 MB, 234.66 MB, 207.58 MB, 199.33 MB, 199.35 MB, 199.43 MB, 185.57 MB ThreadUsage(4s000ms): 1, 6, 5, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.09 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 273.93 MB (287240705) - PerHostPeakMemUsage: 1.23 GB (1321299606) - RowsProduced: 9.14M (9138612) - TotalNetworkReceiveTime: 18s586ms - TotalNetworkSendTime: 2m40s - TotalStorageWaitTime: 69.124ms - TotalThreadsInvoluntaryContextSwitches: 6.48K (6483) - TotalThreadsTotalWallClockTime: 10m23s - TotalThreadsSysTime: 2s526ms - TotalThreadsUserTime: 51s372ms - TotalThreadsVoluntaryContextSwitches: 77.99K (77993) Fragment Instance Lifecycle Timings: - ExecTime: 3m1s - ExecTreeExecTime: 1s915ms - OpenTime: 19s419ms - ExecTreeOpenTime: 18s886ms - PrepareTime: 45.635ms - ExecTreePrepareTime: 1.513ms DataStreamSender (dst_id=19):(Total: 10s901ms, non-child: 10s901ms, % non-child: 100.00%) - BytesSent: 1.24 GB (1330900858) - OverallThroughput: 116.43 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 9.14M (9138612) - SerializeBatchTime: 10s891ms - UncompressedRowBatchSize: 1.24 GB (1330900858) CodeGen:(Total: 560.962ms, non-child: 560.962ms, % non-child: 100.00%) - CodegenTime: 2.068ms - CompileTime: 164.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 367.470ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.698ms HASH_JOIN_NODE (id=9):(Total: 20s794ms, non-child: 1s738ms, % non-child: 8.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 271.897ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 9.14M (9138612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s451ms - RowsReturned: 9.14M (9138612) - RowsReturnedRate: 439.47 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 226.623ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 450.539us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.526ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s601ms, non-child: 18.010ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.575ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.84 K/sec RecvrSide: BytesReceived(4s000ms): 9.29 KB, 8.42 MB, 25.89 MB, 30.25 MB, 32.69 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s942ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s586ms - DataArrivalTimer: 18s583ms SenderSide: - DeserializeRowBatchTimer: 204.034ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s965ms, non-child: 363.296ms, % non-child: 7.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 453.713us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 9.14M (9138612) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 339.206ms - RowsReturned: 9.14M (9138612) - RowsReturnedRate: 1.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 17.187us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 136.916us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.689us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.823us, non-child: 12.823us, % non-child: 100.00%) - ConvertRowBatchTime: 3.375us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.10 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 3.701us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 53.764us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s601ms, non-child: 4s601ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:15/3.40 GB 0:17/3.90 GB 6:11/2.62 GB 5:16/3.85 GB 2:17/3.60 GB 3:23/5.23 GB 4:15/3.37 GB 7:18/4.42 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s500ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:130 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 55.65 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB, 89.03 MB - FooterProcessingTime: (Avg: 2.649ms ; Min: 2.592ms ; Max: 2.706ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.02 - BytesRead: 89.03 MB (93357657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 89.03 MB (93357657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 89.03 MB (93357657) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 453.678ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 111.52 MB (116932142) - PerReadThreadRawHdfsThroughput: 810.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.354ms - RowBatchQueuePutWaitTime: 6m5s - RowsRead: 9.14M (9139377) - RowsReturned: 9.14M (9138612) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 3.53K (3533) - ScannerThreadsTotalWallClockTime: 6m43s - MaterializeTupleTime(*): 1s432ms - ScannerThreadsSysTime: 1s738ms - ScannerThreadsUserTime: 30s480ms - ScannerThreadsVoluntaryContextSwitches: 67.64K (67637) - TotalRawHdfsReadTime(*): 109.850ms - TotalReadThroughput: 455.85 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.53K (33533) - Rows rejected: 765 (765) - Rows total: 9.14M (9139377) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 9.14M (9138612) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 9.14M (9138612) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 9.14M (9138612) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 9.14M (9138612) Filter 9 (8.00 KB): - Files processed: 132 (132) - Files rejected: 130 (130) - Files total: 132 (132) - RowGroups processed: 8.93K (8925) - RowGroups rejected: 0 (0) - RowGroups total: 8.93K (8925) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.14M (9138612) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000b3 (host=foo.221.14:22000):(Total: 3m16s, non-child: 2m39s, % non-child: 81.25%) Hdfs split stats (:<# splits>/): 0:20/4.48 GB 7:20/4.74 GB 3:12/2.59 GB 4:22/5.38 GB 5:17/4.21 GB 1:13/3.09 GB 6:12/2.75 GB 2:14/3.18 GB Filter 9 arrival: 1s813ms Filter 0 arrival: 2s105ms Filter 8 arrival: 22s848ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.53 MB, 163.88 MB, 259.10 MB, 259.05 MB, 259.04 MB, 267.35 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.18 MB, 281.31 MB, 279.17 MB, 278.96 MB, 279.13 MB, 278.96 MB, 279.11 MB, 279.11 MB, 279.07 MB, 272.01 MB, 263.05 MB, 263.56 MB, 263.15 MB, 263.22 MB, 263.19 MB, 263.14 MB, 263.04 MB, 256.15 MB, 247.16 MB, 247.17 MB, 247.05 MB, 247.22 MB, 247.17 MB, 247.05 MB, 247.10 MB, 243.16 MB, 225.64 MB, 63.97 MB ThreadUsage(4s000ms): 2, 3, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 3.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.43 MB (296148469) - PerHostPeakMemUsage: 1.25 GB (1338050302) - RowsProduced: 10.73M (10734997) - TotalNetworkReceiveTime: 23s366ms - TotalNetworkSendTime: 2m30s - TotalStorageWaitTime: 55.564ms - TotalThreadsInvoluntaryContextSwitches: 3.75K (3746) - TotalThreadsTotalWallClockTime: 9m55s - TotalThreadsSysTime: 1s041ms - TotalThreadsUserTime: 26s282ms - TotalThreadsVoluntaryContextSwitches: 20.48K (20476) Fragment Instance Lifecycle Timings: - ExecTime: 2m53s - ExecTreeExecTime: 2s021ms - OpenTime: 22s852ms - ExecTreeOpenTime: 22s382ms - PrepareTime: 47.202ms - ExecTreePrepareTime: 1.276ms DataStreamSender (dst_id=19):(Total: 11s966ms, non-child: 11s966ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1565815297) - OverallThroughput: 124.78 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 10.73M (10734997) - SerializeBatchTime: 11s955ms - UncompressedRowBatchSize: 1.46 GB (1565815297) CodeGen:(Total: 501.513ms, non-child: 501.513ms, % non-child: 100.00%) - CodegenTime: 1.903ms - CompileTime: 152.375ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 316.374ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.256ms HASH_JOIN_NODE (id=9):(Total: 24s396ms, non-child: 1s841ms, % non-child: 7.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 287.200ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.73M (10734997) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s516ms - RowsReturned: 10.73M (10734997) - RowsReturnedRate: 440.03 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 237.752ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 750.447us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.047ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 22s082ms, non-child: 19.798ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.608ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 20.92 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.95 MB, 23.69 MB, 29.52 MB, 32.41 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s275ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 22s066ms - DataArrivalTimer: 22s062ms SenderSide: - DeserializeRowBatchTimer: 184.232ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s047ms, non-child: 397.300ms, % non-child: 7.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 374.339us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 10.73M (10734997) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 373.316ms - RowsReturned: 10.73M (10734997) - RowsReturnedRate: 2.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.075us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 112.477us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 36.673us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s298ms, non-child: 24.241us, % non-child: 0.00%) - ConvertRowBatchTime: 3.478us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 70.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s298ms - DataArrivalTimer: 1s298ms SenderSide: - DeserializeRowBatchTimer: 147.225us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s351ms, non-child: 3s351ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:20/4.48 GB 7:20/4.74 GB 3:12/2.59 GB 4:22/5.38 GB 5:17/4.21 GB 1:13/3.09 GB 6:12/2.75 GB 2:14/3.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s252ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 71.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB, 95.98 MB - FooterProcessingTime: (Avg: 2.178ms ; Min: 2.172ms ; Max: 2.184ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.94 - BytesRead: 95.98 MB (100642157) - BytesReadDataNodeCache: 0 - BytesReadLocal: 95.98 MB (100642157) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 95.98 MB (100642157) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 474.810ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.01 MB (125837562) - PerReadThreadRawHdfsThroughput: 665.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.215ms - RowBatchQueuePutWaitTime: 6m10s - RowsRead: 10.74M (10735815) - RowsReturned: 10.73M (10734997) - RowsReturnedRate: 3.20 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 539 (539) - ScannerThreadsTotalWallClockTime: 6m14s - MaterializeTupleTime(*): 1s707ms - ScannerThreadsSysTime: 229.964ms - ScannerThreadsUserTime: 3s795ms - ScannerThreadsVoluntaryContextSwitches: 10.51K (10511) - TotalRawHdfsReadTime(*): 144.216ms - TotalReadThroughput: 507.92 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.59K (33586) - Rows rejected: 818 (818) - Rows total: 10.74M (10735815) Filter 5 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.73M (10734997) Filter 6 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.73M (10734997) Filter 7 (2.00 MB): - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 10.73M (10734997) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.73M (10734997) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 128 (128) - Files total: 130 (130) - RowGroups processed: 10.48K (10484) - RowGroups rejected: 0 (0) - RowGroups total: 10.48K (10484) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.73M (10734997) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000ee (host=foo.221.29:22000):(Total: 3m16s, non-child: 2m41s, % non-child: 82.19%) Hdfs split stats (:<# splits>/): 5:19/4.55 GB 4:10/2.26 GB 1:22/5.40 GB 2:19/4.58 GB 6:13/3.09 GB 7:13/3.17 GB 3:18/4.32 GB 0:14/3.16 GB Filter 0 arrival: 1s844ms Filter 9 arrival: 2s166ms Filter 8 arrival: 20s559ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 163.85 MB, 259.00 MB, 259.03 MB, 259.01 MB, 276.11 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 277.36 MB, 278.52 MB, 279.00 MB, 279.08 MB, 278.99 MB, 278.91 MB, 279.12 MB, 279.01 MB, 279.07 MB, 279.06 MB, 269.10 MB, 263.26 MB, 263.16 MB, 263.05 MB, 263.02 MB, 263.16 MB, 263.16 MB, 255.17 MB, 247.34 MB, 247.23 MB, 247.25 MB, 247.31 MB, 247.24 MB, 247.34 MB, 247.30 MB, 247.21 MB, 240.14 MB, 83.63 MB ThreadUsage(4s000ms): 2, 3, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 3.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.39 MB (296111455) - PerHostPeakMemUsage: 1.22 GB (1307896255) - RowsProduced: 10.77M (10773284) - TotalNetworkReceiveTime: 21s306ms - TotalNetworkSendTime: 2m31s - TotalStorageWaitTime: 54.269ms - TotalThreadsInvoluntaryContextSwitches: 3.84K (3839) - TotalThreadsTotalWallClockTime: 9m52s - TotalThreadsSysTime: 1s135ms - TotalThreadsUserTime: 26s043ms - TotalThreadsVoluntaryContextSwitches: 21.67K (21670) Fragment Instance Lifecycle Timings: - ExecTime: 2m55s - ExecTreeExecTime: 2s184ms - OpenTime: 20s559ms - ExecTreeOpenTime: 20s018ms - PrepareTime: 45.480ms - ExecTreePrepareTime: 2.049ms DataStreamSender (dst_id=19):(Total: 12s208ms, non-child: 12s208ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1570117795) - OverallThroughput: 122.65 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 10.77M (10773284) - SerializeBatchTime: 12s197ms - UncompressedRowBatchSize: 1.46 GB (1570117795) CodeGen:(Total: 569.218ms, non-child: 569.218ms, % non-child: 100.00%) - CodegenTime: 1.793ms - CompileTime: 184.224ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 355.483ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.986ms HASH_JOIN_NODE (id=9):(Total: 22s195ms, non-child: 1s971ms, % non-child: 8.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 267.004ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.77M (10773284) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s673ms - RowsReturned: 10.77M (10773284) - RowsReturnedRate: 485.38 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.303ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 442.223us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.725ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s739ms, non-child: 17.686ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.262ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.41 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.50 MB, 24.33 MB, 29.78 MB, 32.51 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s936ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s724ms - DataArrivalTimer: 19s721ms SenderSide: - DeserializeRowBatchTimer: 202.431ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s003ms, non-child: 402.468ms, % non-child: 8.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 597.594us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 10.77M (10773284) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 378.733ms - RowsReturned: 10.77M (10773284) - RowsReturnedRate: 2.15 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 58.261us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 108.828us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 150.538us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s581ms, non-child: 15.005us, % non-child: 0.00%) - ConvertRowBatchTime: 3.271us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 57.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s581ms - DataArrivalTimer: 1s581ms SenderSide: - DeserializeRowBatchTimer: 160.095us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s018ms, non-child: 3s018ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.55 GB 4:10/2.26 GB 1:22/5.40 GB 2:19/4.58 GB 6:13/3.09 GB 7:13/3.17 GB 3:18/4.32 GB 0:14/3.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s909ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 70.47 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB, 93.97 MB - FooterProcessingTime: (Avg: 2.712ms ; Min: 2.711ms ; Max: 2.714ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.93 - BytesRead: 93.97 MB (98530109) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.97 MB (98530109) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.97 MB (98530109) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 484.455ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.00 MB (125832017) - PerReadThreadRawHdfsThroughput: 465.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.158ms - RowBatchQueuePutWaitTime: 6m11s - RowsRead: 10.77M (10774076) - RowsReturned: 10.77M (10773284) - RowsReturnedRate: 3.57 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 513 (513) - ScannerThreadsTotalWallClockTime: 6m14s - MaterializeTupleTime(*): 1s721ms - ScannerThreadsSysTime: 252.960ms - ScannerThreadsUserTime: 2s687ms - ScannerThreadsVoluntaryContextSwitches: 10.58K (10578) - TotalRawHdfsReadTime(*): 201.773ms - TotalReadThroughput: 495.98 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.56K (33560) - Rows rejected: 792 (792) - Rows total: 10.77M (10774076) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.77M (10773284) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.77M (10773284) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.77M (10773284) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.77M (10773284) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 10.52K (10521) - RowGroups rejected: 0 (0) - RowGroups total: 10.52K (10521) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.77M (10773284) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000102 (host=foo.221.45:22000):(Total: 3m10s, non-child: 2m33s, % non-child: 80.75%) Hdfs split stats (:<# splits>/): 2:9/2.17 GB 7:14/3.19 GB 3:13/3.13 GB 1:15/3.64 GB 4:21/5.12 GB 5:17/4.21 GB 6:18/4.46 GB 0:18/4.37 GB Filter 0 arrival: 1s651ms Filter 9 arrival: 1s788ms Filter 8 arrival: 22s078ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.53 MB, 164.01 MB, 258.98 MB, 259.00 MB, 258.99 MB, 269.67 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.35 MB, 280.51 MB, 278.87 MB, 279.04 MB, 279.09 MB, 279.03 MB, 279.11 MB, 279.00 MB, 275.11 MB, 263.06 MB, 263.17 MB, 263.08 MB, 263.13 MB, 263.13 MB, 263.15 MB, 262.95 MB, 252.20 MB, 247.26 MB, 247.31 MB, 247.18 MB, 247.18 MB, 247.27 MB, 247.46 MB, 247.42 MB, 247.17 MB, 225.69 MB ThreadUsage(4s000ms): 2, 3, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.38 MB (296096443) - PerHostPeakMemUsage: 1.22 GB (1309290671) - RowsProduced: 11.21M (11205698) - TotalNetworkReceiveTime: 22s641ms - TotalNetworkSendTime: 2m24s - TotalStorageWaitTime: 55.725ms - TotalThreadsInvoluntaryContextSwitches: 4.43K (4431) - TotalThreadsTotalWallClockTime: 9m38s - TotalThreadsSysTime: 1s086ms - TotalThreadsUserTime: 26s370ms - TotalThreadsVoluntaryContextSwitches: 21.24K (21241) Fragment Instance Lifecycle Timings: - ExecTime: 2m48s - ExecTreeExecTime: 2s074ms - OpenTime: 22s079ms - ExecTreeOpenTime: 21s620ms - PrepareTime: 46.351ms - ExecTreePrepareTime: 1.629ms DataStreamSender (dst_id=19):(Total: 12s525ms, non-child: 12s525ms, % non-child: 100.00%) - BytesSent: 1.52 GB (1630324463) - OverallThroughput: 124.13 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 11.21M (11205698) - SerializeBatchTime: 12s515ms - UncompressedRowBatchSize: 1.52 GB (1630324463) CodeGen:(Total: 489.492ms, non-child: 489.492ms, % non-child: 100.00%) - CodegenTime: 1.755ms - CompileTime: 145.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 310.943ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 31.976ms HASH_JOIN_NODE (id=9):(Total: 23s687ms, non-child: 1s824ms, % non-child: 7.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 241.623ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 11.21M (11205698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s550ms - RowsReturned: 11.21M (11205698) - RowsReturnedRate: 473.07 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 195.383ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 365.729us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.078ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s368ms, non-child: 16.526ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.555ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.62 K/sec RecvrSide: BytesReceived(4s000ms): 0, 6.72 MB, 25.00 MB, 29.95 MB, 32.59 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s825ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s355ms - DataArrivalTimer: 21s352ms SenderSide: - DeserializeRowBatchTimer: 173.494ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s079ms, non-child: 409.103ms, % non-child: 8.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 673.499us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 11.21M (11205698) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 382.486ms - RowsReturned: 11.21M (11205698) - RowsReturnedRate: 2.21 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 55.244us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 119.643us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 84.556us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s285ms, non-child: 17.954us, % non-child: 0.00%) - ConvertRowBatchTime: 5.653us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 70.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s285ms - DataArrivalTimer: 1s285ms SenderSide: - DeserializeRowBatchTimer: 252.495us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s385ms, non-child: 3s385ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:9/2.17 GB 7:14/3.19 GB 3:13/3.13 GB 1:15/3.64 GB 4:21/5.12 GB 5:17/4.21 GB 6:18/4.46 GB 0:18/4.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s273ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 69.85 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB, 93.14 MB - FooterProcessingTime: (Avg: 2.597ms ; Min: 2.504ms ; Max: 2.690ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.94 - BytesRead: 93.14 MB (97661636) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.14 MB (97661636) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.14 MB (97661636) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 452.527ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.00 MB (125829451) - PerReadThreadRawHdfsThroughput: 1.00 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.271ms - RowBatchQueuePutWaitTime: 6m2s - RowsRead: 11.21M (11206470) - RowsReturned: 11.21M (11205698) - RowsReturnedRate: 3.31 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1161) - ScannerThreadsTotalWallClockTime: 6m5s - MaterializeTupleTime(*): 1s644ms - ScannerThreadsSysTime: 235.963ms - ScannerThreadsUserTime: 2s990ms - ScannerThreadsVoluntaryContextSwitches: 10.96K (10959) - TotalRawHdfsReadTime(*): 90.799ms - TotalReadThroughput: 504.62 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.54K (33540) - Rows rejected: 772 (772) - Rows total: 11.21M (11206470) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 11.21M (11205698) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 11.21M (11205698) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 11.21M (11205698) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 11.21M (11205698) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 123 (123) - Files total: 125 (125) - RowGroups processed: 10.94K (10943) - RowGroups rejected: 0 (0) - RowGroups total: 10.94K (10943) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 11.21M (11205698) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000df (host=foo.232.42:22000):(Total: 3m7s, non-child: 2m35s, % non-child: 82.65%) Hdfs split stats (:<# splits>/): 7:9/2.20 GB 2:12/2.90 GB 5:21/4.77 GB 4:17/3.56 GB 1:19/4.57 GB 3:18/4.27 GB 0:10/2.48 GB 6:22/5.29 GB Filter 9 arrival: 800ms Filter 0 arrival: 895ms Filter 8 arrival: 20s118ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 2.03 MB, 184.44 MB, 243.54 MB, 243.55 MB, 243.53 MB, 264.94 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.46 MB, 265.12 MB, 263.78 MB, 263.49 MB, 263.55 MB, 263.49 MB, 263.64 MB, 263.64 MB, 263.50 MB, 263.64 MB, 260.65 MB, 247.55 MB, 247.52 MB, 247.57 MB, 247.65 MB, 247.56 MB, 247.63 MB, 247.68 MB, 247.60 MB, 244.74 MB, 216.69 MB, 205.15 MB, 205.34 MB, 205.34 MB, 205.32 MB, 119.64 MB ThreadUsage(4s000ms): 2, 6, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2 - AverageThreadTokens: 4.04 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 267.01 MB (279981465) - PerHostPeakMemUsage: 1.21 GB (1303082323) - RowsProduced: 9.41M (9412580) - TotalNetworkReceiveTime: 19s707ms - TotalNetworkSendTime: 2m26s - TotalStorageWaitTime: 60.213ms - TotalThreadsInvoluntaryContextSwitches: 24.88K (24877) - TotalThreadsTotalWallClockTime: 12m37s - TotalThreadsSysTime: 6s416ms - TotalThreadsUserTime: 3m41s - TotalThreadsVoluntaryContextSwitches: 485.40K (485405) Fragment Instance Lifecycle Timings: - ExecTime: 2m47s - ExecTreeExecTime: 1s675ms - OpenTime: 20s124ms - ExecTreeOpenTime: 19s671ms - PrepareTime: 44.792ms - ExecTreePrepareTime: 2.061ms DataStreamSender (dst_id=19):(Total: 10s778ms, non-child: 10s778ms, % non-child: 100.00%) - BytesSent: 1.27 GB (1368799350) - OverallThroughput: 121.11 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 9.41M (9412580) - SerializeBatchTime: 10s768ms - UncompressedRowBatchSize: 1.27 GB (1368799350) CodeGen:(Total: 478.968ms, non-child: 478.968ms, % non-child: 100.00%) - CodegenTime: 1.797ms - CompileTime: 141.314ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 310.525ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.548ms HASH_JOIN_NODE (id=9):(Total: 21s342ms, non-child: 1s510ms, % non-child: 7.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 247.941ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 9.41M (9412580) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s248ms - RowsReturned: 9.41M (9412580) - RowsReturnedRate: 441.02 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 201.164ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 322.126us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.900ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s412ms, non-child: 15.822ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.844ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.80 K/sec RecvrSide: BytesReceived(4s000ms): 18.87 KB, 9.06 MB, 26.20 MB, 30.38 MB, 32.73 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s082ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s398ms - DataArrivalTimer: 19s396ms SenderSide: - DeserializeRowBatchTimer: 180.148ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s998ms, non-child: 328.072ms, % non-child: 6.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 418.802us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 9.41M (9412580) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 305.404ms - RowsReturned: 9.41M (9412580) - RowsReturnedRate: 1.88 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.686us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 107.057us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.512us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 307.968ms, non-child: 11.781us, % non-child: 0.00%) - ConvertRowBatchTime: 3.391us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 295.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 307.960ms - DataArrivalTimer: 307.958ms SenderSide: - DeserializeRowBatchTimer: 19.094us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s362ms, non-child: 4s362ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:9/2.20 GB 2:12/2.90 GB 5:21/4.77 GB 4:17/3.56 GB 1:19/4.57 GB 3:18/4.27 GB 0:10/2.48 GB 6:22/5.29 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s257ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 61.24 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB, 81.65 MB - FooterProcessingTime: (Avg: 2.136ms ; Min: 1.986ms ; Max: 2.286ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.96 - BytesRead: 81.65 MB (85612775) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.65 MB (85612775) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.65 MB (85612775) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 410.786ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.50 MB (109571368) - PerReadThreadRawHdfsThroughput: 924.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.613ms - RowBatchQueuePutWaitTime: 5m38s - RowsRead: 9.41M (9413367) - RowsReturned: 9.41M (9412580) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 22.01K (22010) - ScannerThreadsTotalWallClockTime: 9m9s - MaterializeTupleTime(*): 1s443ms - ScannerThreadsSysTime: 5s690ms - ScannerThreadsUserTime: 3m21s - ScannerThreadsVoluntaryContextSwitches: 476.27K (476268) - TotalRawHdfsReadTime(*): 88.332ms - TotalReadThroughput: 448.29 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.55K (33555) - Rows rejected: 787 (787) - Rows total: 9.41M (9413367) Filter 5 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 9.41M (9412580) Filter 6 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 9.41M (9412580) Filter 7 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 9.41M (9412580) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 9.41M (9412580) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 9.19K (9191) - RowGroups rejected: 0 (0) - RowGroups total: 9.19K (9191) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.41M (9412580) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000d4 (host=foo.234.37:22000):(Total: 3m5s, non-child: 2m5s, % non-child: 67.53%) Hdfs split stats (:<# splits>/): 2:6/1.49 GB 5:18/4.28 GB 1:19/4.31 GB 0:22/5.25 GB 3:11/2.57 GB 4:18/3.96 GB 7:17/3.60 GB 6:21/4.71 GB Filter 9 arrival: 552ms Filter 0 arrival: 727ms Filter 8 arrival: 19s137ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 2.71 MB, 277.60 MB, 366.45 MB, 366.46 MB, 371.95 MB, 386.24 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.34 MB, 386.38 MB, 386.24 MB, 386.48 MB, 386.49 MB, 386.52 MB, 386.61 MB, 386.54 MB, 385.58 MB, 354.57 MB, 354.55 MB, 354.61 MB, 354.60 MB, 354.48 MB, 346.55 MB, 319.77 MB, 321.94 MB, 322.00 MB, 331.33 MB, 315.13 MB, 301.67 MB, 268.59 MB, 263.55 MB, 251.78 MB, 245.78 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 389.79 MB (408727632) - PerHostPeakMemUsage: 1.30 GB (1398836132) - RowsProduced: 34.37M (34373182) - TotalNetworkReceiveTime: 18s371ms - TotalNetworkSendTime: 1m39s - TotalStorageWaitTime: 181.888ms - TotalThreadsInvoluntaryContextSwitches: 15.18K (15183) - TotalThreadsTotalWallClockTime: 15m32s - TotalThreadsSysTime: 8s668ms - TotalThreadsUserTime: 1m49s - TotalThreadsVoluntaryContextSwitches: 563.50K (563505) Fragment Instance Lifecycle Timings: - ExecTime: 2m46s - ExecTreeExecTime: 6s065ms - OpenTime: 19s256ms - ExecTreeOpenTime: 18s765ms - PrepareTime: 47.951ms - ExecTreePrepareTime: 2.050ms DataStreamSender (dst_id=19):(Total: 35s040ms, non-child: 35s040ms, % non-child: 100.00%) - BytesSent: 4.67 GB (5011738285) - OverallThroughput: 136.40 MB/sec - PeakMemoryUsage: 7.94 MB (8327200) - RowsReturned: 34.37M (34373182) - SerializeBatchTime: 35s004ms - UncompressedRowBatchSize: 4.67 GB (5011738285) CodeGen:(Total: 515.421ms, non-child: 515.421ms, % non-child: 100.00%) - CodegenTime: 2.087ms - CompileTime: 170.137ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 319.301ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.368ms HASH_JOIN_NODE (id=9):(Total: 24s803ms, non-child: 5s095ms, % non-child: 20.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 380.026ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 34.37M (34373182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s638ms - RowsReturned: 34.37M (34373182) - RowsReturnedRate: 1.39 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 220.863ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 617.720us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 157.934ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s363ms, non-child: 19.377ms, % non-child: 0.11%) - ConvertRowBatchTime: 12.673ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.16 K/sec RecvrSide: BytesReceived(4s000ms): 168.03 KB, 10.86 MB, 26.90 MB, 30.68 MB, 32.77 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s867ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s349ms - DataArrivalTimer: 18s344ms SenderSide: - DeserializeRowBatchTimer: 183.383ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s877ms, non-child: 1s107ms, % non-child: 18.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 360.740us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 34.37M (34373182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s036ms - RowsReturned: 34.37M (34373182) - RowsReturnedRate: 5.85 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 34.614us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 111.138us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.018us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 21.919ms, non-child: 13.193us, % non-child: 0.06%) - ConvertRowBatchTime: 3.475us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 4.15 K/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 21.909ms - DataArrivalTimer: 21.907ms SenderSide: - DeserializeRowBatchTimer: 484.282us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s748ms, non-child: 4s748ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:6/1.49 GB 5:18/4.28 GB 1:19/4.31 GB 0:22/5.25 GB 3:11/2.57 GB 4:18/3.96 GB 7:17/3.60 GB 6:21/4.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s517ms Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0.2703% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:35 BytesRead(4s000ms): 0, 138.29 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 184.39 MB, 207.71 MB, 207.71 MB, 244.92 MB, 302.56 MB, 302.56 MB, 302.56 MB, 302.56 MB, 302.56 MB, 302.56 MB - FooterProcessingTime: (Avg: 915.056us ; Min: 345.758us ; Max: 2.750ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.94 - BytesRead: 302.56 MB (317252481) - BytesReadDataNodeCache: 0 - BytesReadLocal: 302.56 MB (317252481) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 302.56 MB (317252481) - CachedFileHandlesHitCount: 61 (61) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s543ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 227.41 MB (238459079) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.437ms - RowBatchQueuePutWaitTime: 11m10s - RowsRead: 34.38M (34375923) - RowsReturned: 34.37M (34373182) - RowsReturnedRate: 7.24 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 7.25K (7255) - ScannerThreadsTotalWallClockTime: 12m7s - MaterializeTupleTime(*): 5s292ms - ScannerThreadsSysTime: 6s565ms - ScannerThreadsUserTime: 44s723ms - ScannerThreadsVoluntaryContextSwitches: 542.47K (542467) - TotalRawHdfsReadTime(*): 279.226ms - TotalReadThroughput: 1.63 MB/sec Filter 0 (8.00 KB): - Rows processed: 117.43K (117429) - Rows rejected: 2.74K (2741) - Rows total: 34.38M (34375923) Filter 5 (2.00 MB): - Rows processed: 74.75K (74752) - Rows rejected: 0 (0) - Rows total: 34.37M (34373182) Filter 6 (2.00 MB): - Rows processed: 74.75K (74752) - Rows rejected: 0 (0) - Rows total: 34.37M (34373182) Filter 7 (2.00 MB): - Rows processed: 74.75K (74752) - Rows rejected: 0 (0) - Rows total: 34.37M (34373182) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 34.37M (34373182) Filter 9 (8.00 KB): - Files processed: 132 (132) - Files rejected: 125 (125) - Files total: 132 (132) - RowGroups processed: 33.57K (33566) - RowGroups rejected: 0 (0) - RowGroups total: 33.57K (33566) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 34.37M (34373182) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 5f429df048b5534b:41bcce18000000d6 (host=foo.187.39:22000):(Total: 3m4s, non-child: 2m5s, % non-child: 68.05%) Hdfs split stats (:<# splits>/): 3:14/3.16 GB 6:14/3.35 GB 2:12/2.97 GB 5:20/4.84 GB 1:17/3.93 GB 4:18/4.40 GB 7:17/4.09 GB 0:16/3.96 GB Filter 0 arrival: 2s335ms Filter 9 arrival: 2s917ms Filter 8 arrival: 22s409ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.53 MB, 224.04 MB, 362.14 MB, 362.14 MB, 362.13 MB, 370.97 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 384.73 MB, 382.26 MB, 382.12 MB, 382.05 MB, 382.22 MB, 382.20 MB, 382.28 MB, 382.22 MB, 382.15 MB, 355.35 MB, 350.30 MB, 350.29 MB, 350.27 MB, 350.37 MB, 338.54 MB, 334.22 MB, 343.50 MB, 343.57 MB, 344.61 MB, 281.59 MB, 269.14 MB, 257.14 MB, 239.74 MB, 205.74 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 385.59 MB (404325360) - PerHostPeakMemUsage: 1.31 GB (1408008825) - RowsProduced: 31.65M (31650685) - TotalNetworkReceiveTime: 23s909ms - TotalNetworkSendTime: 1m42s - TotalStorageWaitTime: 146.856ms - TotalThreadsInvoluntaryContextSwitches: 14.29K (14285) - TotalThreadsTotalWallClockTime: 15m32s - TotalThreadsSysTime: 9s262ms - TotalThreadsUserTime: 1m42s - TotalThreadsVoluntaryContextSwitches: 727.19K (727191) Fragment Instance Lifecycle Timings: - ExecTime: 2m42s - ExecTreeExecTime: 5s482ms - OpenTime: 22s411ms - ExecTreeOpenTime: 21s884ms - PrepareTime: 54.868ms - ExecTreePrepareTime: 1.245ms DataStreamSender (dst_id=19):(Total: 31s178ms, non-child: 31s178ms, % non-child: 100.00%) - BytesSent: 4.30 GB (4616851603) - OverallThroughput: 141.22 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 31.65M (31650685) - SerializeBatchTime: 31s152ms - UncompressedRowBatchSize: 4.30 GB (4616851603) CodeGen:(Total: 560.503ms, non-child: 560.503ms, % non-child: 100.00%) - CodegenTime: 1.636ms - CompileTime: 196.150ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 330.331ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 33.484ms HASH_JOIN_NODE (id=9):(Total: 27s342ms, non-child: 4s533ms, % non-child: 16.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 290.182ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 31.65M (31650685) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s161ms - RowsReturned: 31.65M (31650685) - RowsReturnedRate: 1.16 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 241.890ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 1.061ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.351ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s580ms, non-child: 19.373ms, % non-child: 0.09%) - ConvertRowBatchTime: 14.188ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.41 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.03 MB, 22.66 MB, 29.29 MB, 32.31 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s440ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s564ms - DataArrivalTimer: 21s561ms SenderSide: - DeserializeRowBatchTimer: 277.052ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s747ms, non-child: 1s041ms, % non-child: 18.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 471.112us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 31.65M (31650685) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 984.015ms - RowsReturned: 31.65M (31650685) - RowsReturnedRate: 5.51 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.075us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 134.038us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 101.821us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s344ms, non-child: 12.718us, % non-child: 0.00%) - ConvertRowBatchTime: 2.796us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 38.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 97.751ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s344ms - DataArrivalTimer: 2s344ms SenderSide: - DeserializeRowBatchTimer: 10.984us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s361ms, non-child: 2s361ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/3.16 GB 6:14/3.35 GB 2:12/2.97 GB 5:20/4.84 GB 1:17/3.93 GB 4:18/4.40 GB 7:17/4.09 GB 0:16/3.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s147ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:30 BytesRead(4s000ms): 0, 134.84 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 179.79 MB, 210.29 MB, 228.59 MB, 228.59 MB, 245.89 MB, 274.74 MB, 274.74 MB, 274.74 MB, 274.74 MB, 274.74 MB - FooterProcessingTime: (Avg: 845.767us ; Min: 354.253us ; Max: 2.084ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 274.74 MB (288084116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 274.74 MB (288084116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 274.74 MB (288084116) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s440ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 223.15 MB (233989031) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.243ms - RowBatchQueuePutWaitTime: 11m4s - RowsRead: 31.65M (31653028) - RowsReturned: 31.65M (31650685) - RowsReturnedRate: 13.40 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 7.41K (7408) - ScannerThreadsTotalWallClockTime: 12m3s - MaterializeTupleTime(*): 4s998ms - ScannerThreadsSysTime: 7s360ms - ScannerThreadsUserTime: 44s618ms - ScannerThreadsVoluntaryContextSwitches: 705.05K (705053) - TotalRawHdfsReadTime(*): 244.548ms - TotalReadThroughput: 1.49 MB/sec Filter 0 (8.00 KB): - Rows processed: 100.65K (100647) - Rows rejected: 2.34K (2343) - Rows total: 31.65M (31653028) Filter 5 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 31.65M (31650685) Filter 6 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 31.65M (31650685) Filter 7 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 31.65M (31650685) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 31.65M (31650685) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 122 (122) - Files total: 128 (128) - RowGroups processed: 30.91K (30907) - RowGroups rejected: 0 (0) - RowGroups total: 30.91K (30907) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 31.65M (31650685) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce1800000108 (host=foo.246.35:22000):(Total: 3m4s, non-child: 2m2s, % non-child: 66.31%) Hdfs split stats (:<# splits>/): 1:11/2.63 GB 5:11/2.48 GB 7:17/3.82 GB 4:14/3.26 GB 6:16/3.83 GB 2:13/3.18 GB 3:22/5.42 GB 0:23/5.70 GB Filter 0 arrival: 470ms Filter 9 arrival: 573ms Filter 8 arrival: 18s834ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.22 MB, 284.00 MB, 374.97 MB, 375.00 MB, 380.06 MB, 395.10 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.98 MB, 394.88 MB, 395.00 MB, 394.92 MB, 394.99 MB, 395.03 MB, 394.98 MB, 395.00 MB, 393.18 MB, 363.06 MB, 363.17 MB, 363.15 MB, 363.22 MB, 338.33 MB, 331.32 MB, 332.40 MB, 340.06 MB, 372.81 MB, 341.36 MB, 329.98 MB, 315.06 MB, 313.17 MB, 302.24 MB, 274.79 MB, 241.56 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.36 MB (417706747) - PerHostPeakMemUsage: 1.32 GB (1421035445) - RowsProduced: 36.74M (36740483) - TotalNetworkReceiveTime: 17s996ms - TotalNetworkSendTime: 1m35s - TotalStorageWaitTime: 211.438ms - TotalThreadsInvoluntaryContextSwitches: 14.78K (14780) - TotalThreadsTotalWallClockTime: 15m26s - TotalThreadsSysTime: 4s188ms - TotalThreadsUserTime: 1m48s - TotalThreadsVoluntaryContextSwitches: 234.16K (234155) Fragment Instance Lifecycle Timings: - ExecTime: 2m45s - ExecTreeExecTime: 6s630ms - OpenTime: 18s845ms - ExecTreeOpenTime: 18s313ms - PrepareTime: 44.500ms - ExecTreePrepareTime: 1.370ms DataStreamSender (dst_id=19):(Total: 36s701ms, non-child: 36s701ms, % non-child: 100.00%) - BytesSent: 4.99 GB (5362461986) - OverallThroughput: 139.34 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 36.74M (36740483) - SerializeBatchTime: 36s664ms - UncompressedRowBatchSize: 4.99 GB (5362461986) CodeGen:(Total: 559.737ms, non-child: 559.737ms, % non-child: 100.00%) - CodegenTime: 2.252ms - CompileTime: 163.504ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 367.100ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.518ms HASH_JOIN_NODE (id=9):(Total: 24s915ms, non-child: 5s431ms, % non-child: 21.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 290.436ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 36.74M (36740483) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s083ms - RowsReturned: 36.74M (36740483) - RowsReturnedRate: 1.47 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 236.966ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 519.525us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.465ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s010ms, non-child: 18.452ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.297ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.65 K/sec RecvrSide: BytesReceived(4s000ms): 195.90 KB, 10.85 MB, 26.90 MB, 30.75 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s569ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s995ms - DataArrivalTimer: 17s992ms SenderSide: - DeserializeRowBatchTimer: 181.854ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s961ms, non-child: 1s227ms, % non-child: 20.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 374.332us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 36.74M (36740483) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s157ms - RowsReturned: 36.74M (36740483) - RowsReturnedRate: 6.16 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.724us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 141.900us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.637us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 10.117us, non-child: 10.117us, % non-child: 100.00%) - ConvertRowBatchTime: 3.067us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 8.99 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.098us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 15.689us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s734ms, non-child: 4s734ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.63 GB 5:11/2.48 GB 7:17/3.82 GB 4:14/3.26 GB 6:16/3.83 GB 2:13/3.18 GB 3:22/5.42 GB 0:23/5.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s494ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:120 PARQUET/SNAPPY:35 BytesRead(4s000ms): 0, 140.62 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 187.50 MB, 199.21 MB, 234.34 MB, 316.60 MB, 328.27 MB, 328.27 MB, 328.27 MB, 328.27 MB, 328.27 MB, 328.27 MB, 328.27 MB - FooterProcessingTime: (Avg: 1.066ms ; Min: 301.894us ; Max: 2.671ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 328.27 MB (344216721) - BytesReadDataNodeCache: 0 - BytesReadLocal: 328.27 MB (344216721) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 328.27 MB (344216721) - CachedFileHandlesHitCount: 62 (62) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s650ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.96 MB (247426101) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.136ms - RowBatchQueuePutWaitTime: 11m14s - RowsRead: 36.74M (36743325) - RowsReturned: 36.74M (36740483) - RowsReturnedRate: 7.76 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 6.59K (6592) - ScannerThreadsTotalWallClockTime: 12m4s - MaterializeTupleTime(*): 5s516ms - ScannerThreadsSysTime: 2s088ms - ScannerThreadsUserTime: 39s681ms - ScannerThreadsVoluntaryContextSwitches: 209.45K (209453) - TotalRawHdfsReadTime(*): 295.506ms - TotalReadThroughput: 1.78 MB/sec Filter 0 (8.00 KB): - Rows processed: 117.53K (117530) - Rows rejected: 2.84K (2842) - Rows total: 36.74M (36743325) Filter 5 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 36.74M (36740483) Filter 6 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 36.74M (36740483) Filter 7 (2.00 MB): - Rows processed: 93.18K (93184) - Rows rejected: 0 (0) - Rows total: 36.74M (36740483) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 36.74M (36740483) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 120 (120) - Files total: 127 (127) - RowGroups processed: 35.88K (35879) - RowGroups rejected: 0 (0) - RowGroups total: 35.88K (35879) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 36.74M (36740483) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 5f429df048b5534b:41bcce18000000ac (host=foo.246.37:22000):(Total: 3m3s, non-child: 2m, % non-child: 65.39%) Hdfs split stats (:<# splits>/): 6:14/3.38 GB 2:16/3.96 GB 7:16/3.85 GB 5:14/3.15 GB 4:23/5.16 GB 3:12/2.89 GB 1:16/3.81 GB 0:18/4.32 GB Filter 0 arrival: 462ms Filter 9 arrival: 803ms Filter 8 arrival: 21s407ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.22 MB, 283.43 MB, 374.17 MB, 374.18 MB, 374.17 MB, 387.63 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.70 MB, 395.62 MB, 394.29 MB, 394.24 MB, 394.22 MB, 394.28 MB, 394.27 MB, 394.26 MB, 394.29 MB, 368.47 MB, 362.32 MB, 362.37 MB, 362.24 MB, 352.43 MB, 330.55 MB, 330.60 MB, 330.50 MB, 332.52 MB, 317.62 MB, 312.49 MB, 299.71 MB, 288.54 MB, 288.64 MB, 264.18 MB, 196.60 MB ThreadUsage(4s000ms): 3, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.43 MB (416732753) - PerHostPeakMemUsage: 1.30 GB (1395155466) - RowsProduced: 35.40M (35404356) - TotalNetworkReceiveTime: 20s912ms - TotalNetworkSendTime: 1m33s - TotalStorageWaitTime: 240.658ms - TotalThreadsInvoluntaryContextSwitches: 14.01K (14006) - TotalThreadsTotalWallClockTime: 15m28s - TotalThreadsSysTime: 6s918ms - TotalThreadsUserTime: 1m42s - TotalThreadsVoluntaryContextSwitches: 476.87K (476867) Fragment Instance Lifecycle Timings: - ExecTime: 2m42s - ExecTreeExecTime: 6s262ms - OpenTime: 21s411ms - ExecTreeOpenTime: 20s934ms - PrepareTime: 50.839ms - ExecTreePrepareTime: 1.349ms DataStreamSender (dst_id=19):(Total: 35s969ms, non-child: 35s969ms, % non-child: 100.00%) - BytesSent: 4.81 GB (5167529012) - OverallThroughput: 137.01 MB/sec - PeakMemoryUsage: 7.86 MB (8237088) - RowsReturned: 35.40M (35404356) - SerializeBatchTime: 35s938ms - UncompressedRowBatchSize: 4.81 GB (5167529012) CodeGen:(Total: 508.575ms, non-child: 508.575ms, % non-child: 100.00%) - CodegenTime: 2.076ms - CompileTime: 140.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 334.807ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.560ms HASH_JOIN_NODE (id=9):(Total: 27s167ms, non-child: 5s112ms, % non-child: 18.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 275.772ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 35.40M (35404356) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s784ms - RowsReturned: 35.40M (35404356) - RowsReturnedRate: 1.30 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 226.278ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 957.195us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.555ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s647ms, non-child: 18.040ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.157ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.38 K/sec RecvrSide: BytesReceived(4s000ms): 233.29 KB, 10.94 MB, 26.97 MB, 30.69 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s610ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s632ms - DataArrivalTimer: 20s629ms SenderSide: - DeserializeRowBatchTimer: 285.278ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s933ms, non-child: 1s170ms, % non-child: 19.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 983.953us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 35.40M (35404356) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s108ms - RowsReturned: 35.40M (35404356) - RowsReturnedRate: 5.97 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 58.174us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 235.818us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.999us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 279.511ms, non-child: 12.836us, % non-child: 0.00%) - ConvertRowBatchTime: 3.338us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 325.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 279.502ms - DataArrivalTimer: 279.499ms SenderSide: - DeserializeRowBatchTimer: 33.741us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s483ms, non-child: 4s483ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:14/3.38 GB 2:16/3.96 GB 7:16/3.85 GB 5:14/3.15 GB 4:23/5.16 GB 3:12/2.89 GB 1:16/3.81 GB 0:18/4.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s257ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:35 BytesRead(4s000ms): 0, 142.76 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 190.34 MB, 224.27 MB, 313.32 MB, 313.32 MB, 313.32 MB, 313.32 MB, 313.32 MB, 313.32 MB - FooterProcessingTime: (Avg: 1.511ms ; Min: 318.734us ; Max: 2.706ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.96 - BytesRead: 313.32 MB (328543180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 313.32 MB (328543180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 313.32 MB (328543180) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s618ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.22 MB (246643760) - PerReadThreadRawHdfsThroughput: 834.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.555ms - RowBatchQueuePutWaitTime: 11m12s - RowsRead: 35.41M (35407202) - RowsReturned: 35.40M (35404356) - RowsReturnedRate: 7.90 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 6.01K (6008) - ScannerThreadsTotalWallClockTime: 12m3s - MaterializeTupleTime(*): 5s406ms - ScannerThreadsSysTime: 4s718ms - ScannerThreadsUserTime: 36s123ms - ScannerThreadsVoluntaryContextSwitches: 453.25K (453255) - TotalRawHdfsReadTime(*): 375.427ms - TotalReadThroughput: 1.71 MB/sec Filter 0 (8.00 KB): - Rows processed: 117.53K (117534) - Rows rejected: 2.85K (2846) - Rows total: 35.41M (35407202) Filter 5 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 35.40M (35404356) Filter 6 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 35.40M (35404356) Filter 7 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 35.40M (35404356) Filter 8 (256.00 KB): - Rows processed: 101.38K (101376) - Rows rejected: 0 (0) - Rows total: 35.40M (35404356) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 122 (122) - Files total: 129 (129) - RowGroups processed: 34.57K (34573) - RowGroups rejected: 0 (0) - RowGroups total: 34.57K (34573) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 35.40M (35404356) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 5f429df048b5534b:41bcce18000000de (host=foo.187.46:22000):(Total: 3m3s, non-child: 2m8s, % non-child: 69.79%) Hdfs split stats (:<# splits>/): 1:17/4.09 GB 0:16/3.88 GB 3:16/3.65 GB 4:15/3.11 GB 2:16/3.51 GB 7:13/2.97 GB 6:25/5.82 GB 5:13/3.19 GB Filter 0 arrival: 2s367ms Filter 9 arrival: 2s692ms Filter 8 arrival: 20s719ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 227.92 MB, 367.34 MB, 367.33 MB, 367.32 MB, 385.19 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.62 MB, 387.53 MB, 387.33 MB, 387.45 MB, 387.32 MB, 387.42 MB, 387.36 MB, 387.29 MB, 387.34 MB, 382.39 MB, 415.27 MB, 415.43 MB, 415.20 MB, 415.24 MB, 415.32 MB, 415.27 MB, 384.34 MB, 375.33 MB, 396.67 MB, 370.26 MB, 312.90 MB, 254.63 MB, 217.76 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5 - AverageThreadTokens: 5.26 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 416.17 MB (436390017) - PerHostPeakMemUsage: 1.36 GB (1457509964) - RowsProduced: 30.10M (30098817) - TotalNetworkReceiveTime: 22s047ms - TotalNetworkSendTime: 1m46s - TotalStorageWaitTime: 196.729ms - TotalThreadsInvoluntaryContextSwitches: 12.40K (12396) - TotalThreadsTotalWallClockTime: 16m6s - TotalThreadsSysTime: 16s597ms - TotalThreadsUserTime: 1m22s - TotalThreadsVoluntaryContextSwitches: 1.42M (1424428) Fragment Instance Lifecycle Timings: - ExecTime: 2m42s - ExecTreeExecTime: 5s102ms - OpenTime: 20s716ms - ExecTreeOpenTime: 20s197ms - PrepareTime: 46.260ms - ExecTreePrepareTime: 1.210ms DataStreamSender (dst_id=19):(Total: 29s658ms, non-child: 29s658ms, % non-child: 100.00%) - BytesSent: 4.09 GB (4392853804) - OverallThroughput: 141.25 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 30.10M (30098817) - SerializeBatchTime: 29s631ms - UncompressedRowBatchSize: 4.09 GB (4392853804) CodeGen:(Total: 549.666ms, non-child: 549.666ms, % non-child: 100.00%) - CodegenTime: 1.977ms - CompileTime: 154.519ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 363.390ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 31.043ms HASH_JOIN_NODE (id=9):(Total: 25s275ms, non-child: 4s239ms, % non-child: 16.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 254.520ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 30.10M (30098817) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s903ms - RowsReturned: 30.10M (30098817) - RowsReturnedRate: 1.19 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.310ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 607.144us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.414ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s931ms, non-child: 17.275ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.550ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.18 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.47 MB, 22.08 MB, 29.16 MB, 32.24 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s482ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s917ms - DataArrivalTimer: 19s914ms SenderSide: - DeserializeRowBatchTimer: 181.953ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s630ms, non-child: 926.867ms, % non-child: 16.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 403.984us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 30.10M (30098817) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 874.056ms - RowsReturned: 30.10M (30098817) - RowsReturnedRate: 5.35 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.573us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 98.214us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.905us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s129ms, non-child: 13.027us, % non-child: 0.00%) - ConvertRowBatchTime: 3.244us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 42.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 142.007ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s129ms - DataArrivalTimer: 2s129ms SenderSide: - DeserializeRowBatchTimer: 27.276us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s574ms, non-child: 2s574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:17/4.09 GB 0:16/3.88 GB 3:16/3.65 GB 4:15/3.11 GB 2:16/3.51 GB 7:13/2.97 GB 6:25/5.82 GB 5:13/3.19 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s368ms Hdfs Read Thread Concurrency Bucket: 0:99.73% 1:0.2732% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:35 BytesRead(4s000ms): 0, 137.91 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 183.89 MB, 234.70 MB, 234.70 MB, 234.70 MB, 234.70 MB, 234.70 MB, 234.70 MB, 234.70 MB, 234.70 MB, 277.29 MB, 282.78 MB, 284.63 MB, 284.63 MB, 284.63 MB - FooterProcessingTime: (Avg: 852.273us ; Min: 276.303us ; Max: 2.291ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.15 - BytesRead: 284.63 MB (298457824) - BytesReadDataNodeCache: 0 - BytesReadLocal: 284.63 MB (298457824) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 284.63 MB (298457824) - CachedFileHandlesHitCount: 60 (60) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s427ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 256.27 MB (268714561) - PerReadThreadRawHdfsThroughput: 904.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.400ms - RowBatchQueuePutWaitTime: 11m54s - RowsRead: 30.10M (30101579) - RowsReturned: 30.10M (30098817) - RowsReturnedRate: 11.69 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 5.90K (5896) - ScannerThreadsTotalWallClockTime: 12m40s - MaterializeTupleTime(*): 4s771ms - ScannerThreadsSysTime: 14s745ms - ScannerThreadsUserTime: 27s433ms - ScannerThreadsVoluntaryContextSwitches: 1.40M (1402456) - TotalRawHdfsReadTime(*): 314.526ms - TotalReadThroughput: 1.55 MB/sec Filter 0 (8.00 KB): - Rows processed: 117.45K (117450) - Rows rejected: 2.76K (2762) - Rows total: 30.10M (30101579) Filter 5 (2.00 MB): - Rows processed: 73.73K (73728) - Rows rejected: 0 (0) - Rows total: 30.10M (30098817) Filter 6 (2.00 MB): - Rows processed: 73.73K (73728) - Rows rejected: 0 (0) - Rows total: 30.10M (30098817) Filter 7 (2.00 MB): - Rows processed: 73.73K (73728) - Rows rejected: 0 (0) - Rows total: 30.10M (30098817) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 30.10M (30098817) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 124 (124) - Files total: 131 (131) - RowGroups processed: 29.39K (29394) - RowGroups rejected: 0 (0) - RowGroups total: 29.39K (29394) - Rows processed: 114.69K (114688) - Rows rejected: 0 (0) - Rows total: 30.10M (30098817) - Splits processed: 7 (7) - Splits rejected: 0 (0) - Splits total: 7 (7) Instance 5f429df048b5534b:41bcce1800000097 (host=foo.234.39:22000):(Total: 2m59s, non-child: 2m, % non-child: 67.21%) Hdfs split stats (:<# splits>/): 3:16/3.72 GB 6:14/3.41 GB 5:24/5.63 GB 0:16/3.70 GB 4:12/2.93 GB 7:14/3.47 GB 1:16/3.92 GB 2:14/3.32 GB Filter 0 arrival: 703ms Filter 9 arrival: 1s018ms Filter 8 arrival: 21s343ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 283.03 MB, 373.65 MB, 373.67 MB, 373.65 MB, 387.21 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.34 MB, 395.40 MB, 393.72 MB, 393.67 MB, 393.76 MB, 393.62 MB, 393.72 MB, 393.66 MB, 393.77 MB, 374.76 MB, 361.92 MB, 361.82 MB, 362.13 MB, 361.73 MB, 352.86 MB, 329.83 MB, 329.87 MB, 344.89 MB, 340.35 MB, 289.30 MB, 268.76 MB, 261.82 MB, 251.95 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.95 MB (416232958) - PerHostPeakMemUsage: 1.30 GB (1392426219) - RowsProduced: 31.70M (31703266) - TotalNetworkReceiveTime: 21s059ms - TotalNetworkSendTime: 1m37s - TotalStorageWaitTime: 213.815ms - TotalThreadsInvoluntaryContextSwitches: 13.81K (13808) - TotalThreadsTotalWallClockTime: 15m1s - TotalThreadsSysTime: 6s202ms - TotalThreadsUserTime: 1m40s - TotalThreadsVoluntaryContextSwitches: 348.74K (348742) Fragment Instance Lifecycle Timings: - ExecTime: 2m37s - ExecTreeExecTime: 5s460ms - OpenTime: 21s357ms - ExecTreeOpenTime: 20s860ms - PrepareTime: 42.696ms - ExecTreePrepareTime: 1.651ms DataStreamSender (dst_id=19):(Total: 31s878ms, non-child: 31s878ms, % non-child: 100.00%) - BytesSent: 4.31 GB (4625990815) - OverallThroughput: 138.39 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 31.70M (31703266) - SerializeBatchTime: 31s844ms - UncompressedRowBatchSize: 4.31 GB (4625990815) CodeGen:(Total: 523.546ms, non-child: 523.546ms, % non-child: 100.00%) - CodegenTime: 1.728ms - CompileTime: 174.933ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 320.391ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.723ms HASH_JOIN_NODE (id=9):(Total: 26s295ms, non-child: 4s461ms, % non-child: 16.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 256.251ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 31.70M (31703266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s148ms - RowsReturned: 31.70M (31703266) - RowsReturnedRate: 1.21 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 201.648ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 670.143us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.681ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s592ms, non-child: 16.543ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.673ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.43 K/sec RecvrSide: BytesReceived(4s000ms): 102.75 KB, 9.94 MB, 26.66 MB, 30.57 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s839ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s579ms - DataArrivalTimer: 20s576ms SenderSide: - DeserializeRowBatchTimer: 271.143ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s777ms, non-child: 1s032ms, % non-child: 17.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 438.633us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 31.70M (31703266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 974.186ms - RowsReturned: 31.70M (31703266) - RowsReturnedRate: 5.49 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 45.385us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 103.637us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.576us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 480.549ms, non-child: 15.981us, % non-child: 0.00%) - ConvertRowBatchTime: 4.581us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 189.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 480.537ms - DataArrivalTimer: 480.534ms SenderSide: - DeserializeRowBatchTimer: 73.112us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s265ms, non-child: 4s265ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:16/3.72 GB 6:14/3.41 GB 5:24/5.63 GB 0:16/3.70 GB 4:12/2.93 GB 7:14/3.47 GB 1:16/3.92 GB 2:14/3.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s053ms Hdfs Read Thread Concurrency Bucket: 0:99.72% 1:0.2801% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:120 PARQUET/SNAPPY:30 BytesRead(4s000ms): 0, 137.43 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 183.24 MB, 223.46 MB, 242.05 MB, 278.05 MB, 278.05 MB, 278.05 MB, 278.05 MB - FooterProcessingTime: (Avg: 1.181ms ; Min: 183.530us ; Max: 2.703ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 278.05 MB (291557118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 278.05 MB (291557118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 278.05 MB (291557118) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s404ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.64 MB (246042139) - PerReadThreadRawHdfsThroughput: 926.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.706ms - RowBatchQueuePutWaitTime: 10m48s - RowsRead: 31.71M (31705582) - RowsReturned: 31.70M (31703266) - RowsReturnedRate: 7.43 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 6.68K (6679) - ScannerThreadsTotalWallClockTime: 11m41s - MaterializeTupleTime(*): 4s772ms - ScannerThreadsSysTime: 4s289ms - ScannerThreadsUserTime: 41s463ms - ScannerThreadsVoluntaryContextSwitches: 325.81K (325808) - TotalRawHdfsReadTime(*): 300.211ms - TotalReadThroughput: 1.55 MB/sec Filter 0 (8.00 KB): - Rows processed: 100.62K (100620) - Rows rejected: 2.32K (2316) - Rows total: 31.71M (31705582) Filter 5 (2.00 MB): - Rows processed: 63.49K (63488) - Rows rejected: 0 (0) - Rows total: 31.70M (31703266) Filter 6 (2.00 MB): - Rows processed: 63.49K (63488) - Rows rejected: 0 (0) - Rows total: 31.70M (31703266) Filter 7 (2.00 MB): - Rows processed: 63.49K (63488) - Rows rejected: 0 (0) - Rows total: 31.70M (31703266) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 31.70M (31703266) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 120 (120) - Files total: 126 (126) - RowGroups processed: 30.96K (30961) - RowGroups rejected: 0 (0) - RowGroups total: 30.96K (30961) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 31.70M (31703266) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000fa (host=foo.221.37:22000):(Total: 2m58s, non-child: 2m24s, % non-child: 81.18%) Hdfs split stats (:<# splits>/): 2:16/3.81 GB 4:8/1.98 GB 5:15/3.58 GB 1:14/3.01 GB 3:24/5.88 GB 6:20/4.47 GB 7:16/3.55 GB 0:17/3.98 GB Filter 9 arrival: 1s346ms Filter 0 arrival: 1s707ms Filter 8 arrival: 19s894ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 171.85 MB, 269.65 MB, 269.65 MB, 269.65 MB, 291.78 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.60 MB, 291.62 MB, 289.54 MB, 285.77 MB, 283.99 MB, 283.94 MB, 284.07 MB, 284.17 MB, 284.01 MB, 284.15 MB, 268.06 MB, 268.15 MB, 267.95 MB, 268.04 MB, 268.36 MB, 268.11 MB, 252.27 MB, 245.09 MB, 244.14 MB, 244.25 MB, 237.29 MB, 228.30 MB, 202.54 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 293.12 MB (307356275) - PerHostPeakMemUsage: 1.21 GB (1303500145) - RowsProduced: 10.54M (10536489) - TotalNetworkReceiveTime: 19s870ms - TotalNetworkSendTime: 2m16s - TotalStorageWaitTime: 67.652ms - TotalThreadsInvoluntaryContextSwitches: 12.36K (12355) - TotalThreadsTotalWallClockTime: 11m52s - TotalThreadsSysTime: 1s473ms - TotalThreadsUserTime: 1m46s - TotalThreadsVoluntaryContextSwitches: 57.12K (57119) Fragment Instance Lifecycle Timings: - ExecTime: 2m38s - ExecTreeExecTime: 1s896ms - OpenTime: 19s907ms - ExecTreeOpenTime: 19s384ms - PrepareTime: 40.002ms - ExecTreePrepareTime: 1.336ms DataStreamSender (dst_id=19):(Total: 11s726ms, non-child: 11s726ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1535818359) - OverallThroughput: 124.91 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 10.54M (10536489) - SerializeBatchTime: 11s716ms - UncompressedRowBatchSize: 1.43 GB (1535818359) CodeGen:(Total: 547.003ms, non-child: 547.003ms, % non-child: 100.00%) - CodegenTime: 1.795ms - CompileTime: 153.640ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 367.374ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.464ms HASH_JOIN_NODE (id=9):(Total: 21s274ms, non-child: 1s753ms, % non-child: 8.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 272.413ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.54M (10536489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s447ms - RowsReturned: 10.54M (10536489) - RowsReturnedRate: 495.27 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.954ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 392.930us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.633ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s099ms, non-child: 17.201ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.989ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.19 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.29 MB, 24.09 MB, 29.73 MB, 32.53 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s828ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s084ms - DataArrivalTimer: 19s082ms SenderSide: - DeserializeRowBatchTimer: 180.747ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s945ms, non-child: 344.771ms, % non-child: 6.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 558.112us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 10.54M (10536489) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 317.868ms - RowsReturned: 10.54M (10536489) - RowsReturnedRate: 2.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.594us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 135.766us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.135us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 785.701ms, non-child: 12.018us, % non-child: 0.00%) - ConvertRowBatchTime: 3.388us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 115.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 785.692ms - DataArrivalTimer: 785.689ms SenderSide: - DeserializeRowBatchTimer: 91.739us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s814ms, non-child: 3s814ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:16/3.81 GB 4:8/1.98 GB 5:15/3.58 GB 1:14/3.01 GB 3:24/5.88 GB 6:20/4.47 GB 7:16/3.55 GB 0:17/3.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s713ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 76.95 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB, 102.60 MB - FooterProcessingTime: (Avg: 2.083ms ; Min: 1.812ms ; Max: 2.394ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.90 - BytesRead: 102.60 MB (107579883) - BytesReadDataNodeCache: 0 - BytesReadLocal: 102.60 MB (107579883) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 102.60 MB (107579883) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 495.394ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 130.60 MB (136948187) - PerReadThreadRawHdfsThroughput: 1002.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.188ms - RowBatchQueuePutWaitTime: 7m8s - RowsRead: 10.54M (10537748) - RowsReturned: 10.54M (10536489) - RowsReturnedRate: 2.76 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 9.27K (9268) - ScannerThreadsTotalWallClockTime: 8m33s - MaterializeTupleTime(*): 1s696ms - ScannerThreadsSysTime: 724.889ms - ScannerThreadsUserTime: 1m24s - ScannerThreadsVoluntaryContextSwitches: 46.84K (46835) - TotalRawHdfsReadTime(*): 102.315ms - TotalReadThroughput: 590.22 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.41K (50411) - Rows rejected: 1.26K (1259) - Rows total: 10.54M (10537748) Filter 5 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.54M (10536489) Filter 6 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.54M (10536489) Filter 7 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.54M (10536489) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 10.54M (10536489) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 10.29K (10289) - RowGroups rejected: 0 (0) - RowGroups total: 10.29K (10289) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 10.54M (10536489) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000d0 (host=foo.246.44:22000):(Total: 2m57s, non-child: 1m57s, % non-child: 66.45%) Hdfs split stats (:<# splits>/): 4:15/3.71 GB 2:13/2.90 GB 1:12/2.85 GB 0:17/4.13 GB 7:21/4.84 GB 6:13/3.17 GB 3:19/4.25 GB 5:20/4.78 GB Filter 0 arrival: 346ms Filter 9 arrival: 657ms Filter 8 arrival: 20s773ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 298.93 MB, 373.57 MB, 373.56 MB, 373.55 MB, 389.49 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.80 MB, 394.65 MB, 393.46 MB, 393.43 MB, 393.56 MB, 393.75 MB, 393.50 MB, 393.67 MB, 393.60 MB, 370.57 MB, 361.81 MB, 361.83 MB, 361.78 MB, 344.65 MB, 330.78 MB, 329.75 MB, 329.77 MB, 339.34 MB, 310.14 MB, 276.79 MB, 263.92 MB, 258.90 MB, 244.82 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.07 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.87 MB (416149538) - PerHostPeakMemUsage: 1.31 GB (1403306148) - RowsProduced: 32.92M (32920748) - TotalNetworkReceiveTime: 20s105ms - TotalNetworkSendTime: 1m33s - TotalStorageWaitTime: 217.477ms - TotalThreadsInvoluntaryContextSwitches: 14.42K (14424) - TotalThreadsTotalWallClockTime: 14m59s - TotalThreadsSysTime: 5s945ms - TotalThreadsUserTime: 1m45s - TotalThreadsVoluntaryContextSwitches: 230.13K (230127) Fragment Instance Lifecycle Timings: - ExecTime: 2m36s - ExecTreeExecTime: 5s684ms - OpenTime: 20s783ms - ExecTreeOpenTime: 20s289ms - PrepareTime: 41.002ms - ExecTreePrepareTime: 1.824ms DataStreamSender (dst_id=19):(Total: 33s013ms, non-child: 33s013ms, % non-child: 100.00%) - BytesSent: 4.45 GB (4775529500) - OverallThroughput: 137.95 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 32.92M (32920748) - SerializeBatchTime: 32s976ms - UncompressedRowBatchSize: 4.45 GB (4775529500) CodeGen:(Total: 519.116ms, non-child: 519.116ms, % non-child: 100.00%) - CodegenTime: 1.857ms - CompileTime: 181.583ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 311.984ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.067ms HASH_JOIN_NODE (id=9):(Total: 25s946ms, non-child: 4s625ms, % non-child: 17.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 281.677ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 32.92M (32920748) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s305ms - RowsReturned: 32.92M (32920748) - RowsReturnedRate: 1.27 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.650ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 629.274us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.041ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s995ms, non-child: 18.901ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.431ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.11 K/sec RecvrSide: BytesReceived(4s000ms): 261.44 KB, 11.65 MB, 27.15 MB, 30.82 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s487ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s980ms - DataArrivalTimer: 19s976ms SenderSide: - DeserializeRowBatchTimer: 177.129ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s859ms, non-child: 1s096ms, % non-child: 18.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 243.666us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 32.92M (32920748) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s029ms - RowsReturned: 32.92M (32920748) - RowsReturnedRate: 5.62 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 30.681us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 72.277us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.089us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 125.060ms, non-child: 8.274us, % non-child: 0.01%) - ConvertRowBatchTime: 2.048us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 727.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 125.054ms - DataArrivalTimer: 125.052ms SenderSide: - DeserializeRowBatchTimer: 330.775us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s638ms, non-child: 4s638ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.71 GB 2:13/2.90 GB 1:12/2.85 GB 0:17/4.13 GB 7:21/4.84 GB 6:13/3.17 GB 3:19/4.25 GB 5:20/4.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s418ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:30 BytesRead(4s000ms): 0, 141.12 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 188.16 MB, 261.05 MB, 285.18 MB, 285.18 MB, 285.18 MB, 285.18 MB, 285.18 MB - FooterProcessingTime: (Avg: 1.830ms ; Min: 662.290us ; Max: 2.491ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.98 - BytesRead: 285.18 MB (299028182) - BytesReadDataNodeCache: 0 - BytesReadLocal: 285.18 MB (299028182) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 285.18 MB (299028182) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s424ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.52 MB (245907817) - PerReadThreadRawHdfsThroughput: 803.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.902ms - RowBatchQueuePutWaitTime: 10m39s - RowsRead: 32.92M (32923153) - RowsReturned: 32.92M (32920748) - RowsReturnedRate: 7.10 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 7.12K (7116) - ScannerThreadsTotalWallClockTime: 11m41s - MaterializeTupleTime(*): 5s025ms - ScannerThreadsSysTime: 3s931ms - ScannerThreadsUserTime: 43s927ms - ScannerThreadsVoluntaryContextSwitches: 207.37K (207370) - TotalRawHdfsReadTime(*): 355.130ms - TotalReadThroughput: 1.61 MB/sec Filter 0 (8.00 KB): - Rows processed: 100.71K (100709) - Rows rejected: 2.40K (2405) - Rows total: 32.92M (32923153) Filter 5 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 32.92M (32920748) Filter 6 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 32.92M (32920748) Filter 7 (2.00 MB): - Rows processed: 64.51K (64512) - Rows rejected: 0 (0) - Rows total: 32.92M (32920748) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 32.92M (32920748) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 124 (124) - Files total: 130 (130) - RowGroups processed: 32.15K (32149) - RowGroups rejected: 0 (0) - RowGroups total: 32.15K (32149) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 32.92M (32920748) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000c8 (host=foo.187.41:22000):(Total: 2m56s, non-child: 2m3s, % non-child: 69.94%) Hdfs split stats (:<# splits>/): 3:15/3.46 GB 5:18/4.04 GB 7:29/6.59 GB 6:16/3.55 GB 1:13/3.09 GB 2:16/3.82 GB 4:13/2.80 GB 0:14/3.19 GB Filter 9 arrival: 2s195ms Filter 0 arrival: 2s356ms Filter 8 arrival: 21s595ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.53 MB, 232.52 MB, 373.42 MB, 373.41 MB, 373.41 MB, 386.91 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.85 MB, 394.83 MB, 393.61 MB, 393.35 MB, 393.42 MB, 393.37 MB, 393.63 MB, 393.44 MB, 393.43 MB, 392.52 MB, 362.50 MB, 361.71 MB, 361.70 MB, 361.57 MB, 361.50 MB, 346.66 MB, 329.76 MB, 329.83 MB, 329.85 MB, 327.84 MB, 221.70 MB, 212.67 MB, 180.47 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.79 MB (416065979) - PerHostPeakMemUsage: 1.30 GB (1397928494) - RowsProduced: 27.41M (27405967) - TotalNetworkReceiveTime: 22s448ms - TotalNetworkSendTime: 1m43s - TotalStorageWaitTime: 141.444ms - TotalThreadsInvoluntaryContextSwitches: 11.62K (11621) - TotalThreadsTotalWallClockTime: 14m42s - TotalThreadsSysTime: 13s184ms - TotalThreadsUserTime: 1m17s - TotalThreadsVoluntaryContextSwitches: 1.25M (1251585) Fragment Instance Lifecycle Timings: - ExecTime: 2m34s - ExecTreeExecTime: 4s735ms - OpenTime: 21s613ms - ExecTreeOpenTime: 21s096ms - PrepareTime: 33.327ms - ExecTreePrepareTime: 896.572us DataStreamSender (dst_id=19):(Total: 26s577ms, non-child: 26s577ms, % non-child: 100.00%) - BytesSent: 3.72 GB (3992050977) - OverallThroughput: 143.25 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 27.41M (27405967) - SerializeBatchTime: 26s555ms - UncompressedRowBatchSize: 3.72 GB (3992050977) CodeGen:(Total: 537.425ms, non-child: 537.425ms, % non-child: 100.00%) - CodegenTime: 1.543ms - CompileTime: 184.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.160ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 20.355ms HASH_JOIN_NODE (id=9):(Total: 25s810ms, non-child: 3s927ms, % non-child: 15.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 268.718ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.41M (27405967) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s583ms - RowsReturned: 27.41M (27405967) - RowsReturnedRate: 1.06 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 219.091ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 797.892us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.859ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s816ms, non-child: 17.457ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.510ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.19 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.89 MB, 22.58 MB, 29.30 MB, 32.34 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s491ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s802ms - DataArrivalTimer: 20s798ms SenderSide: - DeserializeRowBatchTimer: 178.341ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s612ms, non-child: 864.745ms, % non-child: 15.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 651.846us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.41M (27405967) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 813.811ms - RowsReturned: 27.41M (27405967) - RowsReturnedRate: 4.88 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.258us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 277.381us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.086us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s646ms, non-child: 13.309us, % non-child: 0.00%) - ConvertRowBatchTime: 3.691us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 55.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 145.246ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s646ms - DataArrivalTimer: 1s646ms SenderSide: - DeserializeRowBatchTimer: 14.016us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s101ms, non-child: 3s101ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:15/3.46 GB 5:18/4.04 GB 7:29/6.59 GB 6:16/3.55 GB 1:13/3.09 GB 2:16/3.82 GB 4:13/2.80 GB 0:14/3.19 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s869ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:129 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 142.66 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 190.21 MB, 201.84 MB, 236.71 MB, 236.71 MB - FooterProcessingTime: (Avg: 1.038ms ; Min: 340.577us ; Max: 2.911ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 236.71 MB (248210622) - BytesReadDataNodeCache: 0 - BytesReadLocal: 236.71 MB (248210622) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 236.71 MB (248210622) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s204ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.41 MB (245795125) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.665ms - RowBatchQueuePutWaitTime: 10m41s - RowsRead: 27.41M (27407905) - RowsReturned: 27.41M (27405967) - RowsReturnedRate: 8.84 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 5.67K (5667) - ScannerThreadsTotalWallClockTime: 11m23s - MaterializeTupleTime(*): 4s258ms - ScannerThreadsSysTime: 11s455ms - ScannerThreadsUserTime: 28s071ms - ScannerThreadsVoluntaryContextSwitches: 1.23M (1231027) - TotalRawHdfsReadTime(*): 197.450ms - TotalReadThroughput: 1.35 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.86K (83858) - Rows rejected: 1.94K (1938) - Rows total: 27.41M (27407905) Filter 5 (2.00 MB): - Rows processed: 38.91K (38912) - Rows rejected: 0 (0) - Rows total: 27.41M (27405967) Filter 6 (2.00 MB): - Rows processed: 38.91K (38912) - Rows rejected: 0 (0) - Rows total: 27.41M (27405967) Filter 7 (2.00 MB): - Rows processed: 38.91K (38912) - Rows rejected: 0 (0) - Rows total: 27.41M (27405967) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 27.41M (27405967) Filter 9 (8.00 KB): - Files processed: 134 (134) - Files rejected: 129 (129) - Files total: 134 (134) - RowGroups processed: 26.76K (26763) - RowGroups rejected: 0 (0) - RowGroups total: 26.76K (26763) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.41M (27405967) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce180000010b (host=foo.187.45:22000):(Total: 2m54s, non-child: 2m2s, % non-child: 70.14%) Hdfs split stats (:<# splits>/): 1:18/3.91 GB 2:14/3.45 GB 3:20/4.38 GB 4:18/4.44 GB 0:17/4.20 GB 6:13/2.52 GB 5:11/2.72 GB 7:21/4.97 GB Filter 0 arrival: 2s356ms Filter 9 arrival: 2s473ms Filter 8 arrival: 21s096ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.72 MB, 229.29 MB, 373.16 MB, 373.13 MB, 373.12 MB, 388.46 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.85 MB, 393.14 MB, 393.09 MB, 393.24 MB, 393.21 MB, 393.19 MB, 393.23 MB, 393.28 MB, 393.40 MB, 373.25 MB, 361.45 MB, 361.20 MB, 361.39 MB, 361.23 MB, 351.36 MB, 329.51 MB, 329.46 MB, 329.53 MB, 319.38 MB, 223.04 MB, 212.23 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.55 MB (415812578) - PerHostPeakMemUsage: 1.31 GB (1401449535) - RowsProduced: 27.40M (27401685) - TotalNetworkReceiveTime: 22s175ms - TotalNetworkSendTime: 1m43s - TotalStorageWaitTime: 211.392ms - TotalThreadsInvoluntaryContextSwitches: 10.96K (10962) - TotalThreadsTotalWallClockTime: 14m35s - TotalThreadsSysTime: 14s326ms - TotalThreadsUserTime: 1m11s - TotalThreadsVoluntaryContextSwitches: 1.27M (1267994) Fragment Instance Lifecycle Timings: - ExecTime: 2m33s - ExecTreeExecTime: 4s601ms - OpenTime: 21s122ms - ExecTreeOpenTime: 20s576ms - PrepareTime: 35.564ms - ExecTreePrepareTime: 939.338us DataStreamSender (dst_id=19):(Total: 26s453ms, non-child: 26s453ms, % non-child: 100.00%) - BytesSent: 3.71 GB (3986380339) - OverallThroughput: 143.71 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 27.40M (27401685) - SerializeBatchTime: 26s422ms - UncompressedRowBatchSize: 3.71 GB (3986380339) CodeGen:(Total: 567.094ms, non-child: 567.094ms, % non-child: 100.00%) - CodegenTime: 1.806ms - CompileTime: 197.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 347.500ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 21.902ms HASH_JOIN_NODE (id=9):(Total: 25s157ms, non-child: 3s835ms, % non-child: 15.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.356ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.40M (27401685) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s489ms - RowsReturned: 27.40M (27401685) - RowsReturnedRate: 1.09 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 209.701ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 687.265us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.744ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s295ms, non-child: 17.178ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.099ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.76 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.15 MB, 21.55 MB, 29.16 MB, 32.23 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s460ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s281ms - DataArrivalTimer: 20s278ms SenderSide: - DeserializeRowBatchTimer: 190.063ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s551ms, non-child: 871.755ms, % non-child: 15.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 626.214us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.40M (27401685) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 825.149ms - RowsReturned: 27.40M (27401685) - RowsReturnedRate: 4.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.989us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 283.708us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.941us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s893ms, non-child: 13.719us, % non-child: 0.00%) - ConvertRowBatchTime: 3.224us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 48.00 /sec RecvrSide: BytesReceived(4s000ms): 875.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 114.775ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s893ms - DataArrivalTimer: 1s893ms SenderSide: - DeserializeRowBatchTimer: 90.847us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s787ms, non-child: 2s787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:18/3.91 GB 2:14/3.45 GB 3:20/4.38 GB 4:18/4.44 GB 0:17/4.20 GB 6:13/2.52 GB 5:11/2.72 GB 7:21/4.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s589ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:30 BytesRead(4s000ms): 0, 141.80 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 189.07 MB, 239.88 MB, 239.88 MB - FooterProcessingTime: (Avg: 1.062ms ; Min: 277.705us ; Max: 2.179ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.90 - BytesRead: 239.88 MB (251528563) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.88 MB (251528563) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.88 MB (251528563) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s232ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.15 MB (245527786) - PerReadThreadRawHdfsThroughput: 966.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.848ms - RowBatchQueuePutWaitTime: 10m40s - RowsRead: 27.40M (27404038) - RowsReturned: 27.40M (27401685) - RowsReturnedRate: 9.83 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 5.00K (4999) - ScannerThreadsTotalWallClockTime: 11m18s - MaterializeTupleTime(*): 4s179ms - ScannerThreadsSysTime: 12s575ms - ScannerThreadsUserTime: 21s943ms - ScannerThreadsVoluntaryContextSwitches: 1.25M (1247898) - TotalRawHdfsReadTime(*): 248.070ms - TotalReadThroughput: 1.37 MB/sec Filter 0 (8.00 KB): - Rows processed: 100.66K (100657) - Rows rejected: 2.35K (2353) - Rows total: 27.40M (27404038) Filter 5 (2.00 MB): - Rows processed: 57.34K (57344) - Rows rejected: 0 (0) - Rows total: 27.40M (27401685) Filter 6 (2.00 MB): - Rows processed: 57.34K (57344) - Rows rejected: 0 (0) - Rows total: 27.40M (27401685) Filter 7 (2.00 MB): - Rows processed: 57.34K (57344) - Rows rejected: 0 (0) - Rows total: 27.40M (27401685) Filter 8 (256.00 KB): - Rows processed: 68.61K (68608) - Rows rejected: 0 (0) - Rows total: 27.40M (27401685) Filter 9 (8.00 KB): - Files processed: 132 (132) - Files rejected: 126 (126) - Files total: 132 (132) - RowGroups processed: 26.76K (26759) - RowGroups rejected: 0 (0) - RowGroups total: 26.76K (26759) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 27.40M (27401685) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000b5 (host=foo.234.43:22000):(Total: 2m50s, non-child: 1m57s, % non-child: 69.08%) Hdfs split stats (:<# splits>/): 5:15/3.36 GB 0:17/3.91 GB 2:13/2.98 GB 1:25/5.20 GB 3:17/3.91 GB 6:18/4.44 GB 7:13/3.22 GB 4:13/3.22 GB Filter 9 arrival: 530ms Filter 0 arrival: 739ms Filter 8 arrival: 21s149ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 1.50 MB, 238.68 MB, 375.26 MB, 375.25 MB, 375.25 MB, 389.44 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.95 MB, 397.72 MB, 395.15 MB, 395.20 MB, 395.19 MB, 395.24 MB, 395.24 MB, 395.29 MB, 395.34 MB, 382.37 MB, 363.49 MB, 363.56 MB, 363.52 MB, 363.52 MB, 363.61 MB, 340.59 MB, 330.52 MB, 323.57 MB, 337.90 MB, 238.19 MB, 212.31 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.58 MB (417937182) - PerHostPeakMemUsage: 1.31 GB (1402606304) - RowsProduced: 27.10M (27097410) - TotalNetworkReceiveTime: 20s366ms - TotalNetworkSendTime: 1m38s - TotalStorageWaitTime: 151.931ms - TotalThreadsInvoluntaryContextSwitches: 10.88K (10884) - TotalThreadsTotalWallClockTime: 14m19s - TotalThreadsSysTime: 11s783ms - TotalThreadsUserTime: 1m13s - TotalThreadsVoluntaryContextSwitches: 1.10M (1098755) Fragment Instance Lifecycle Timings: - ExecTime: 2m29s - ExecTreeExecTime: 4s518ms - OpenTime: 21s167ms - ExecTreeOpenTime: 20s680ms - PrepareTime: 54.675ms - ExecTreePrepareTime: 1.272ms DataStreamSender (dst_id=19):(Total: 27s059ms, non-child: 27s059ms, % non-child: 100.00%) - BytesSent: 3.68 GB (3951942407) - OverallThroughput: 139.28 MB/sec - PeakMemoryUsage: 7.91 MB (8294432) - RowsReturned: 27.10M (27097410) - SerializeBatchTime: 27s035ms - UncompressedRowBatchSize: 3.68 GB (3951942407) CodeGen:(Total: 511.681ms, non-child: 511.681ms, % non-child: 100.00%) - CodegenTime: 2.181ms - CompileTime: 166.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 319.354ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.281ms HASH_JOIN_NODE (id=9):(Total: 25s176ms, non-child: 3s734ms, % non-child: 14.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 286.392ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.10M (27097410) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s401ms - RowsReturned: 27.10M (27097410) - RowsReturnedRate: 1.08 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 225.338ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 631.172us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.103ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s380ms, non-child: 18.190ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.111ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.67 K/sec RecvrSide: BytesReceived(4s000ms): 224.21 KB, 11.01 MB, 27.00 MB, 30.73 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s870ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s365ms - DataArrivalTimer: 20s362ms SenderSide: - DeserializeRowBatchTimer: 221.831ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s601ms, non-child: 879.683ms, % non-child: 15.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 471.625us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.10M (27097410) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 832.330ms - RowsReturned: 27.10M (27097410) - RowsReturnedRate: 4.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.595us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 125.118us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.405us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.454us, non-child: 12.454us, % non-child: 100.00%) - ConvertRowBatchTime: 4.741us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.31 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.102us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 74.722us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s721ms, non-child: 4s721ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:15/3.36 GB 0:17/3.91 GB 2:13/2.98 GB 1:25/5.20 GB 3:17/3.91 GB 6:18/4.44 GB 7:13/3.22 GB 4:13/3.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s535ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 142.96 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 190.61 MB, 227.05 MB, 239.20 MB, 239.20 MB - FooterProcessingTime: (Avg: 1.798ms ; Min: 592.619us ; Max: 2.539ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.94 - BytesRead: 239.20 MB (250822990) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.20 MB (250822990) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.20 MB (250822990) - CachedFileHandlesHitCount: 43 (43) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s225ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 236.28 MB (247753511) - PerReadThreadRawHdfsThroughput: 1015.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.340ms - RowBatchQueuePutWaitTime: 10m25s - RowsRead: 27.10M (27099412) - RowsReturned: 27.10M (27097410) - RowsReturnedRate: 5.74 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 4.84K (4845) - ScannerThreadsTotalWallClockTime: 11m7s - MaterializeTupleTime(*): 4s095ms - ScannerThreadsSysTime: 10s141ms - ScannerThreadsUserTime: 23s855ms - ScannerThreadsVoluntaryContextSwitches: 1.08M (1079014) - TotalRawHdfsReadTime(*): 235.449ms - TotalReadThroughput: 1.41 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.92K (83922) - Rows rejected: 2.00K (2002) - Rows total: 27.10M (27099412) Filter 5 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.10M (27097410) Filter 6 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.10M (27097410) Filter 7 (2.00 MB): - Rows processed: 62.46K (62464) - Rows rejected: 0 (0) - Rows total: 27.10M (27097410) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 27.10M (27097410) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 126 (126) - Files total: 131 (131) - RowGroups processed: 26.46K (26463) - RowGroups rejected: 0 (0) - RowGroups total: 26.46K (26463) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.10M (27097410) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000e4 (host=foo.234.42:22000):(Total: 2m49s, non-child: 1m56s, % non-child: 68.65%) Hdfs split stats (:<# splits>/): 5:15/3.71 GB 4:24/5.55 GB 7:12/2.70 GB 2:14/3.38 GB 1:17/4.21 GB 3:14/3.47 GB 6:16/3.80 GB 0:15/3.71 GB Filter 0 arrival: 717ms Filter 9 arrival: 825ms Filter 8 arrival: 21s138ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 284.90 MB, 376.18 MB, 376.18 MB, 376.18 MB, 393.04 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.68 MB, 398.41 MB, 396.21 MB, 396.31 MB, 396.20 MB, 396.31 MB, 396.27 MB, 396.30 MB, 396.27 MB, 372.32 MB, 364.26 MB, 364.25 MB, 364.42 MB, 364.28 MB, 356.44 MB, 332.52 MB, 327.42 MB, 318.26 MB, 288.47 MB, 216.21 MB, 208.32 MB ThreadUsage(4s000ms): 5, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.09 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 399.59 MB (419000034) - PerHostPeakMemUsage: 1.31 GB (1403897182) - RowsProduced: 26.92M (26918692) - TotalNetworkReceiveTime: 20s652ms - TotalNetworkSendTime: 1m36s - TotalStorageWaitTime: 176.954ms - TotalThreadsInvoluntaryContextSwitches: 11.25K (11248) - TotalThreadsTotalWallClockTime: 14m21s - TotalThreadsSysTime: 12s926ms - TotalThreadsUserTime: 1m13s - TotalThreadsVoluntaryContextSwitches: 1.17M (1169754) Fragment Instance Lifecycle Timings: - ExecTime: 2m27s - ExecTreeExecTime: 4s581ms - OpenTime: 21s144ms - ExecTreeOpenTime: 20s645ms - PrepareTime: 47.930ms - ExecTreePrepareTime: 1.843ms DataStreamSender (dst_id=19):(Total: 27s283ms, non-child: 27s283ms, % non-child: 100.00%) - BytesSent: 3.65 GB (3923902996) - OverallThroughput: 137.16 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 26.92M (26918692) - SerializeBatchTime: 27s260ms - UncompressedRowBatchSize: 3.65 GB (3923902996) CodeGen:(Total: 527.464ms, non-child: 527.464ms, % non-child: 100.00%) - CodegenTime: 1.861ms - CompileTime: 164.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.724ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.721ms HASH_JOIN_NODE (id=9):(Total: 25s207ms, non-child: 3s751ms, % non-child: 14.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 251.724ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 26.92M (26918692) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s452ms - RowsReturned: 26.92M (26918692) - RowsReturnedRate: 1.07 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 202.168ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 431.638us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.731ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s381ms, non-child: 15.886ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.413ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.67 K/sec RecvrSide: BytesReceived(4s000ms): 121.61 KB, 10.18 MB, 26.65 MB, 30.59 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s843ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s368ms - DataArrivalTimer: 20s365ms SenderSide: - DeserializeRowBatchTimer: 276.739ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s611ms, non-child: 886.890ms, % non-child: 15.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 711.239us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 26.92M (26918692) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 835.689ms - RowsReturned: 26.92M (26918692) - RowsReturnedRate: 4.80 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 53.623us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 112.255us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 85.166us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 283.561ms, non-child: 20.033us, % non-child: 0.01%) - ConvertRowBatchTime: 2.945us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 320.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 283.545ms - DataArrivalTimer: 283.542ms SenderSide: - DeserializeRowBatchTimer: 86.706us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s441ms, non-child: 4s441ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:15/3.71 GB 4:24/5.55 GB 7:12/2.70 GB 2:14/3.38 GB 1:17/4.21 GB 3:14/3.47 GB 6:16/3.80 GB 0:15/3.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s234ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 144.92 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 193.23 MB, 234.90 MB, 240.85 MB, 240.85 MB - FooterProcessingTime: (Avg: 989.436us ; Min: 335.680us ; Max: 2.719ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.98 - BytesRead: 240.85 MB (252554345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.85 MB (252554345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.85 MB (252554345) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s233ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.16 MB (248682724) - PerReadThreadRawHdfsThroughput: 942.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 44.864ms - RowBatchQueuePutWaitTime: 10m17s - RowsRead: 26.92M (26920623) - RowsReturned: 26.92M (26918692) - RowsReturnedRate: 6.06 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 5.11K (5110) - ScannerThreadsTotalWallClockTime: 11m11s - MaterializeTupleTime(*): 4s040ms - ScannerThreadsSysTime: 11s253ms - ScannerThreadsUserTime: 23s660ms - ScannerThreadsVoluntaryContextSwitches: 1.15M (1151768) - TotalRawHdfsReadTime(*): 255.486ms - TotalReadThroughput: 1.43 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.85K (83851) - Rows rejected: 1.93K (1931) - Rows total: 26.92M (26920623) Filter 5 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.92M (26918692) Filter 6 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.92M (26918692) Filter 7 (2.00 MB): - Rows processed: 46.08K (46080) - Rows rejected: 0 (0) - Rows total: 26.92M (26918692) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 26.92M (26918692) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 122 (122) - Files total: 127 (127) - RowGroups processed: 26.29K (26288) - RowGroups rejected: 0 (0) - RowGroups total: 26.29K (26288) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 26.92M (26918692) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000d1 (host=foo.246.40:22000):(Total: 2m48s, non-child: 1m52s, % non-child: 66.68%) Hdfs split stats (:<# splits>/): 4:18/4.20 GB 2:10/2.39 GB 1:13/3.11 GB 5:16/3.73 GB 6:16/3.90 GB 7:11/2.71 GB 3:24/5.56 GB 0:20/4.79 GB Filter 0 arrival: 413ms Filter 9 arrival: 525ms Filter 8 arrival: 20s833ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 2.57 MB, 253.69 MB, 373.67 MB, 373.67 MB, 373.67 MB, 388.74 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 393.76 MB, 394.69 MB, 393.72 MB, 393.49 MB, 393.82 MB, 393.74 MB, 393.70 MB, 393.64 MB, 373.83 MB, 361.76 MB, 361.85 MB, 361.82 MB, 350.72 MB, 330.06 MB, 329.91 MB, 336.91 MB, 311.04 MB, 270.54 MB, 259.66 MB, 254.64 MB, 228.22 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.06 MB (416350065) - PerHostPeakMemUsage: 1.28 GB (1376696014) - RowsProduced: 30.60M (30604948) - TotalNetworkReceiveTime: 20s056ms - TotalNetworkSendTime: 1m30s - TotalStorageWaitTime: 188.426ms - TotalThreadsInvoluntaryContextSwitches: 13.56K (13558) - TotalThreadsTotalWallClockTime: 14m12s - TotalThreadsSysTime: 10s787ms - TotalThreadsUserTime: 1m30s - TotalThreadsVoluntaryContextSwitches: 1.04M (1037278) Fragment Instance Lifecycle Timings: - ExecTime: 2m28s - ExecTreeExecTime: 5s246ms - OpenTime: 20s837ms - ExecTreeOpenTime: 20s352ms - PrepareTime: 44.080ms - ExecTreePrepareTime: 1.370ms DataStreamSender (dst_id=19):(Total: 30s208ms, non-child: 30s208ms, % non-child: 100.00%) - BytesSent: 4.16 GB (4467702983) - OverallThroughput: 141.05 MB/sec - PeakMemoryUsage: 7.99 MB (8376352) - RowsReturned: 30.60M (30604948) - SerializeBatchTime: 30s180ms - UncompressedRowBatchSize: 4.16 GB (4467702983) CodeGen:(Total: 511.042ms, non-child: 511.042ms, % non-child: 100.00%) - CodegenTime: 1.689ms - CompileTime: 152.181ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 330.949ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.317ms HASH_JOIN_NODE (id=9):(Total: 25s576ms, non-child: 4s272ms, % non-child: 16.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.425ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 30.60M (30604948) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s964ms - RowsReturned: 30.60M (30604948) - RowsReturnedRate: 1.20 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.995ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 914.707us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.445ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s069ms, non-child: 16.868ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.703ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.02 K/sec RecvrSide: BytesReceived(4s000ms): 112.38 KB, 10.50 MB, 26.73 MB, 30.58 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s567ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s055ms - DataArrivalTimer: 20s053ms SenderSide: - DeserializeRowBatchTimer: 185.482ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s760ms, non-child: 1s015ms, % non-child: 17.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 426.702us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 30.60M (30604948) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 961.202ms - RowsReturned: 30.60M (30604948) - RowsReturnedRate: 5.31 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.969us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 116.661us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 65.868us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 9.375us, non-child: 9.375us, % non-child: 100.00%) - ConvertRowBatchTime: 3.855us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 9.71 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1.561us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 97.027us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s745ms, non-child: 4s745ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:18/4.20 GB 2:10/2.39 GB 1:13/3.11 GB 5:16/3.73 GB 6:16/3.90 GB 7:11/2.71 GB 3:24/5.56 GB 0:20/4.79 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s537ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:30 BytesRead(4s000ms): 0, 117.48 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 187.96 MB, 223.53 MB, 253.19 MB, 277.78 MB, 277.78 MB, 277.78 MB, 277.78 MB - FooterProcessingTime: (Avg: 1.657ms ; Min: 700.327us ; Max: 2.760ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.95 - BytesRead: 277.78 MB (291269760) - BytesReadDataNodeCache: 0 - BytesReadLocal: 277.78 MB (291269760) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 277.78 MB (291269760) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s399ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.66 MB (246055497) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.776ms - RowBatchQueuePutWaitTime: 10m8s - RowsRead: 30.61M (30607204) - RowsReturned: 30.60M (30604948) - RowsReturnedRate: 6.45 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 6.80K (6800) - ScannerThreadsTotalWallClockTime: 11m3s - MaterializeTupleTime(*): 4s687ms - ScannerThreadsSysTime: 8s984ms - ScannerThreadsUserTime: 35s020ms - ScannerThreadsVoluntaryContextSwitches: 1.02M (1015820) - TotalRawHdfsReadTime(*): 253.041ms - TotalReadThroughput: 1.64 MB/sec Filter 0 (8.00 KB): - Rows processed: 100.56K (100560) - Rows rejected: 2.26K (2256) - Rows total: 30.61M (30607204) Filter 5 (2.00 MB): - Rows processed: 50.18K (50176) - Rows rejected: 0 (0) - Rows total: 30.60M (30604948) Filter 6 (2.00 MB): - Rows processed: 50.18K (50176) - Rows rejected: 0 (0) - Rows total: 30.60M (30604948) Filter 7 (2.00 MB): - Rows processed: 50.18K (50176) - Rows rejected: 0 (0) - Rows total: 30.60M (30604948) Filter 8 (256.00 KB): - Rows processed: 84.99K (84992) - Rows rejected: 0 (0) - Rows total: 30.60M (30604948) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 122 (122) - Files total: 128 (128) - RowGroups processed: 29.89K (29887) - RowGroups rejected: 0 (0) - RowGroups total: 29.89K (29887) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 30.60M (30604948) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce18000000e2 (host=foo.221.40:22000):(Total: 2m48s, non-child: 2m14s, % non-child: 79.83%) Hdfs split stats (:<# splits>/): 7:15/3.64 GB 5:19/4.67 GB 6:20/4.51 GB 3:12/2.92 GB 0:13/3.04 GB 1:11/2.72 GB 2:18/4.21 GB 4:21/4.78 GB Filter 0 arrival: 1s721ms Filter 9 arrival: 2s301ms Filter 8 arrival: 19s912ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 163.48 MB, 258.53 MB, 258.52 MB, 258.52 MB, 279.00 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.84 MB, 278.81 MB, 278.62 MB, 278.46 MB, 278.56 MB, 278.64 MB, 278.58 MB, 277.66 MB, 264.76 MB, 262.63 MB, 262.74 MB, 262.71 MB, 262.77 MB, 261.59 MB, 249.70 MB, 246.51 MB, 246.75 MB, 246.69 MB, 246.55 MB, 246.76 MB, 144.95 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 2 - AverageThreadTokens: 4.96 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 281.90 MB (295592360) - PerHostPeakMemUsage: 1.19 GB (1282812776) - RowsProduced: 10.87M (10865265) - TotalNetworkReceiveTime: 20s772ms - TotalNetworkSendTime: 2m5s - TotalStorageWaitTime: 72.712ms - TotalThreadsInvoluntaryContextSwitches: 37.48K (37479) - TotalThreadsTotalWallClockTime: 13m54s - TotalThreadsSysTime: 43s629ms - TotalThreadsUserTime: 5m - TotalThreadsVoluntaryContextSwitches: 2.69M (2688590) Fragment Instance Lifecycle Timings: - ExecTime: 2m28s - ExecTreeExecTime: 2s058ms - OpenTime: 19s913ms - ExecTreeOpenTime: 19s359ms - PrepareTime: 42.551ms - ExecTreePrepareTime: 1.230ms DataStreamSender (dst_id=19):(Total: 11s938ms, non-child: 11s938ms, % non-child: 100.00%) - BytesSent: 1.48 GB (1583844172) - OverallThroughput: 126.52 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 10.87M (10865265) - SerializeBatchTime: 11s927ms - UncompressedRowBatchSize: 1.48 GB (1583844172) CodeGen:(Total: 580.720ms, non-child: 580.720ms, % non-child: 100.00%) - CodegenTime: 2.011ms - CompileTime: 175.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 376.789ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.282ms HASH_JOIN_NODE (id=9):(Total: 21s409ms, non-child: 1s832ms, % non-child: 8.56%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 266.173ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.87M (10865265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s534ms - RowsReturned: 10.87M (10865265) - RowsReturnedRate: 507.50 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 225.270ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 439.362us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.189ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s081ms, non-child: 18.158ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.706ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.21 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.29 MB, 24.17 MB, 29.70 MB, 32.53 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 3s803ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s065ms - DataArrivalTimer: 19s063ms SenderSide: - DeserializeRowBatchTimer: 173.672ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s998ms, non-child: 417.280ms, % non-child: 8.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 805.331us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 10.87M (10865265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 394.304ms - RowsReturned: 10.87M (10865265) - RowsReturnedRate: 2.17 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.902us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 155.722us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 104.761us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s706ms, non-child: 16.244us, % non-child: 0.00%) - ConvertRowBatchTime: 5.215us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 53.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s706ms - DataArrivalTimer: 1s706ms SenderSide: - DeserializeRowBatchTimer: 121.070us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s875ms, non-child: 2s875ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:15/3.64 GB 5:19/4.67 GB 6:20/4.51 GB 3:12/2.92 GB 0:13/3.04 GB 1:11/2.72 GB 2:18/4.21 GB 4:21/4.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s769ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 71.23 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB, 94.98 MB - FooterProcessingTime: (Avg: 3.371ms ; Min: 2.659ms ; Max: 4.084ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 94.98 MB (99589346) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.98 MB (99589346) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.98 MB (99589346) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 485.229ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.50 MB (125309303) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.726ms - RowBatchQueuePutWaitTime: 5m17s - RowsRead: 10.87M (10866067) - RowsReturned: 10.87M (10865265) - RowsReturnedRate: 3.78 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 34.33K (34332) - ScannerThreadsTotalWallClockTime: 10m44s - MaterializeTupleTime(*): 1s658ms - ScannerThreadsSysTime: 42s780ms - ScannerThreadsUserTime: 4m37s - ScannerThreadsVoluntaryContextSwitches: 2.68M (2679235) - TotalRawHdfsReadTime(*): 75.074ms - TotalReadThroughput: 582.37 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.57K (33570) - Rows rejected: 802 (802) - Rows total: 10.87M (10866067) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 10.87M (10865265) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 10.87M (10865265) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 10.87M (10865265) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.87M (10865265) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 127 (127) - Files total: 129 (129) - RowGroups processed: 10.61K (10611) - RowGroups rejected: 0 (0) - RowGroups total: 10.61K (10611) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.87M (10865265) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000101 (host=foo.187.48:22000):(Total: 2m47s, non-child: 1m57s, % non-child: 70.63%) Hdfs split stats (:<# splits>/): 7:17/4.05 GB 5:18/4.21 GB 2:17/4.00 GB 6:11/2.72 GB 1:17/4.21 GB 0:17/3.73 GB 3:14/3.30 GB 4:18/4.17 GB Filter 0 arrival: 2s321ms Filter 9 arrival: 2s906ms Filter 8 arrival: 23s112ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.53 MB, 231.06 MB, 371.51 MB, 371.51 MB, 371.51 MB, 377.19 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 394.24 MB, 391.69 MB, 391.47 MB, 391.56 MB, 391.54 MB, 391.56 MB, 391.75 MB, 391.62 MB, 391.61 MB, 381.61 MB, 359.80 MB, 359.66 MB, 359.68 MB, 359.69 MB, 354.77 MB, 327.89 MB, 327.82 MB, 327.64 MB, 321.81 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 394.95 MB (414130837) - PerHostPeakMemUsage: 1.30 GB (1400009380) - RowsProduced: 22.23M (22230617) - TotalNetworkReceiveTime: 24s726ms - TotalNetworkSendTime: 1m41s - TotalStorageWaitTime: 156.175ms - TotalThreadsInvoluntaryContextSwitches: 6.68K (6683) - TotalThreadsTotalWallClockTime: 13m56s - TotalThreadsSysTime: 2s365ms - TotalThreadsUserTime: 49s034ms - TotalThreadsVoluntaryContextSwitches: 95.16K (95158) Fragment Instance Lifecycle Timings: - ExecTime: 2m23s - ExecTreeExecTime: 3s823ms - OpenTime: 23s112ms - ExecTreeOpenTime: 22s628ms - PrepareTime: 43.688ms - ExecTreePrepareTime: 1.398ms DataStreamSender (dst_id=19):(Total: 22s094ms, non-child: 22s094ms, % non-child: 100.00%) - BytesSent: 3.02 GB (3247629038) - OverallThroughput: 140.18 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 22.23M (22230617) - SerializeBatchTime: 22s077ms - UncompressedRowBatchSize: 3.02 GB (3247629038) CodeGen:(Total: 511.942ms, non-child: 511.942ms, % non-child: 100.00%) - CodegenTime: 1.884ms - CompileTime: 160.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 322.696ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.103ms HASH_JOIN_NODE (id=9):(Total: 26s435ms, non-child: 3s256ms, % non-child: 12.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 254.707ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.23M (22230617) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s939ms - RowsReturned: 22.23M (22230617) - RowsReturnedRate: 840.95 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 213.643ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 462.426us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.269ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 22s360ms, non-child: 16.138ms, % non-child: 0.07%) - ConvertRowBatchTime: 12.373ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 20.66 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.93 MB, 22.67 MB, 29.36 MB, 32.31 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s475ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 22s346ms - DataArrivalTimer: 22s344ms SenderSide: - DeserializeRowBatchTimer: 271.845ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s400ms, non-child: 687.241ms, % non-child: 12.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 797.751us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.23M (22230617) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 648.547ms - RowsReturned: 22.23M (22230617) - RowsReturnedRate: 4.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.816us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 307.301us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.401us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s379ms, non-child: 18.934us, % non-child: 0.00%) - ConvertRowBatchTime: 5.900us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 38.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 133.240ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s379ms - DataArrivalTimer: 2s379ms SenderSide: - DeserializeRowBatchTimer: 106.736us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s334ms, non-child: 2s334ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:17/4.05 GB 5:18/4.21 GB 2:17/4.00 GB 6:11/2.72 GB 1:17/4.21 GB 0:17/3.73 GB 3:14/3.30 GB 4:18/4.17 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s167ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 141.66 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB, 188.88 MB - FooterProcessingTime: (Avg: 1.211ms ; Min: 198.241us ; Max: 2.156ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.90 - BytesRead: 188.88 MB (198059952) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.88 MB (198059952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.88 MB (198059952) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 952.551ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 232.52 MB (243815435) - PerReadThreadRawHdfsThroughput: 989.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.261ms - RowBatchQueuePutWaitTime: 10m35s - RowsRead: 22.23M (22232223) - RowsReturned: 22.23M (22230617) - RowsReturnedRate: 9.52 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1787) - ScannerThreadsTotalWallClockTime: 10m45s - MaterializeTupleTime(*): 3s360ms - ScannerThreadsSysTime: 961.852ms - ScannerThreadsUserTime: 7s869ms - ScannerThreadsVoluntaryContextSwitches: 78.07K (78072) - TotalRawHdfsReadTime(*): 190.799ms - TotalReadThroughput: 1.14 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.14K (67142) - Rows rejected: 1.61K (1606) - Rows total: 22.23M (22232223) Filter 5 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 22.23M (22230617) Filter 6 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 22.23M (22230617) Filter 7 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 22.23M (22230617) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 22.23M (22230617) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 21.71K (21710) - RowGroups rejected: 0 (0) - RowGroups total: 21.71K (21710) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 22.23M (22230617) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000a5 (host=foo.234.40:22000):(Total: 2m46s, non-child: 1m57s, % non-child: 70.59%) Hdfs split stats (:<# splits>/): 0:13/2.78 GB 2:20/4.70 GB 3:10/2.29 GB 6:13/2.93 GB 4:20/4.80 GB 1:17/3.97 GB 7:18/4.39 GB 5:17/4.21 GB Filter 9 arrival: 559ms Filter 0 arrival: 723ms Filter 8 arrival: 21s146ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 252.10 MB, 332.42 MB, 332.43 MB, 332.42 MB, 348.50 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.86 MB, 353.88 MB, 352.41 MB, 352.42 MB, 352.40 MB, 352.41 MB, 367.94 MB, 393.65 MB, 393.59 MB, 393.58 MB, 376.64 MB, 369.66 MB, 369.71 MB, 363.86 MB, 361.70 MB, 355.66 MB, 337.91 MB, 338.02 MB, 329.98 MB, 291.71 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 394.97 MB (414154382) - PerHostPeakMemUsage: 1.30 GB (1393390360) - RowsProduced: 22.84M (22835744) - TotalNetworkReceiveTime: 20s338ms - TotalNetworkSendTime: 1m39s - TotalStorageWaitTime: 178.982ms - TotalThreadsInvoluntaryContextSwitches: 7.89K (7892) - TotalThreadsTotalWallClockTime: 13m52s - TotalThreadsSysTime: 4s166ms - TotalThreadsUserTime: 52s864ms - TotalThreadsVoluntaryContextSwitches: 250.07K (250066) Fragment Instance Lifecycle Timings: - ExecTime: 2m25s - ExecTreeExecTime: 4s344ms - OpenTime: 21s152ms - ExecTreeOpenTime: 20s640ms - PrepareTime: 43.430ms - ExecTreePrepareTime: 1.882ms DataStreamSender (dst_id=19):(Total: 23s381ms, non-child: 23s381ms, % non-child: 100.00%) - BytesSent: 3.11 GB (3338459578) - OverallThroughput: 136.17 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 22.84M (22835744) - SerializeBatchTime: 23s355ms - UncompressedRowBatchSize: 3.11 GB (3338459578) CodeGen:(Total: 540.341ms, non-child: 540.341ms, % non-child: 100.00%) - CodegenTime: 1.708ms - CompileTime: 173.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 337.107ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.211ms HASH_JOIN_NODE (id=9):(Total: 24s967ms, non-child: 3s670ms, % non-child: 14.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 279.708ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.84M (22835744) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s355ms - RowsReturned: 22.84M (22835744) - RowsReturnedRate: 914.62 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 232.758ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 525.142us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.058ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s347ms, non-child: 18.319ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.943ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.70 K/sec RecvrSide: BytesReceived(4s000ms): 121.57 KB, 10.41 MB, 26.70 MB, 30.56 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s843ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s332ms - DataArrivalTimer: 20s329ms SenderSide: - DeserializeRowBatchTimer: 291.265ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s471ms, non-child: 779.717ms, % non-child: 14.25%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 586.031us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.84M (22835744) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 732.210ms - RowsReturned: 22.84M (22835744) - RowsReturnedRate: 4.17 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.061us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 148.591us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.661us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 5.843ms, non-child: 11.793us, % non-child: 0.20%) - ConvertRowBatchTime: 3.238us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 15.57 K/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 5.834ms - DataArrivalTimer: 5.832ms SenderSide: - DeserializeRowBatchTimer: 44.045us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s685ms, non-child: 4s685ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/2.78 GB 2:20/4.70 GB 3:10/2.29 GB 6:13/2.93 GB 4:20/4.80 GB 1:17/3.97 GB 7:18/4.39 GB 5:17/4.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s518ms Hdfs Read Thread Concurrency Bucket: 0:99.7% 1:0.304% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 114.29 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 152.38 MB, 169.90 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB, 199.11 MB - FooterProcessingTime: (Avg: 2.852ms ; Min: 2.349ms ; Max: 4.103ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 199.11 MB (208784671) - BytesReadDataNodeCache: 0 - BytesReadLocal: 199.11 MB (208784671) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 199.11 MB (208784671) - CachedFileHandlesHitCount: 40 (40) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 985.611ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.37 MB (246800799) - PerReadThreadRawHdfsThroughput: 946.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.344ms - RowBatchQueuePutWaitTime: 10m28s - RowsRead: 22.84M (22837747) - RowsReturned: 22.84M (22835744) - RowsReturnedRate: 4.87 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 2.37K (2373) - ScannerThreadsTotalWallClockTime: 10m46s - MaterializeTupleTime(*): 3s455ms - ScannerThreadsSysTime: 2s718ms - ScannerThreadsUserTime: 8s334ms - ScannerThreadsVoluntaryContextSwitches: 233.20K (233202) - TotalRawHdfsReadTime(*): 210.382ms - TotalReadThroughput: 1.21 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.92K (83923) - Rows rejected: 2.00K (2003) - Rows total: 22.84M (22837747) Filter 5 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 22.84M (22835744) Filter 6 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 22.84M (22835744) Filter 7 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 22.84M (22835744) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 22.84M (22835744) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 123 (123) - Files total: 128 (128) - RowGroups processed: 22.30K (22300) - RowGroups rejected: 0 (0) - RowGroups total: 22.30K (22300) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 22.84M (22835744) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000e5 (host=foo.187.43:22000):(Total: 2m45s, non-child: 1m59s, % non-child: 72.21%) Hdfs split stats (:<# splits>/): 5:10/2.48 GB 7:18/4.16 GB 2:15/3.71 GB 3:16/3.67 GB 6:14/3.47 GB 4:21/5.20 GB 1:17/4.01 GB 0:17/3.99 GB Filter 0 arrival: 2s381ms Filter 9 arrival: 2s515ms Filter 8 arrival: 20s726ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.72 MB, 215.34 MB, 373.23 MB, 373.24 MB, 373.22 MB, 388.35 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 394.00 MB, 393.23 MB, 393.12 MB, 393.29 MB, 393.35 MB, 393.24 MB, 393.24 MB, 393.11 MB, 393.29 MB, 372.24 MB, 361.48 MB, 361.53 MB, 361.40 MB, 361.32 MB, 359.40 MB, 329.60 MB, 329.54 MB, 329.60 MB, 329.61 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.04 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.58 MB (415843476) - PerHostPeakMemUsage: 1.31 GB (1402734431) - RowsProduced: 21.88M (21884958) - TotalNetworkReceiveTime: 21s975ms - TotalNetworkSendTime: 1m43s - TotalStorageWaitTime: 145.484ms - TotalThreadsInvoluntaryContextSwitches: 6.18K (6178) - TotalThreadsTotalWallClockTime: 13m57s - TotalThreadsSysTime: 2s003ms - TotalThreadsUserTime: 45s678ms - TotalThreadsVoluntaryContextSwitches: 47.99K (47993) Fragment Instance Lifecycle Timings: - ExecTime: 2m25s - ExecTreeExecTime: 3s845ms - OpenTime: 20s725ms - ExecTreeOpenTime: 20s272ms - PrepareTime: 62.397ms - ExecTreePrepareTime: 1.717ms DataStreamSender (dst_id=19):(Total: 21s477ms, non-child: 21s477ms, % non-child: 100.00%) - BytesSent: 2.97 GB (3192126703) - OverallThroughput: 141.74 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 21.88M (21884958) - SerializeBatchTime: 21s458ms - UncompressedRowBatchSize: 2.97 GB (3192126703) CodeGen:(Total: 489.302ms, non-child: 489.302ms, % non-child: 100.00%) - CodegenTime: 1.682ms - CompileTime: 138.540ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 312.666ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 37.562ms HASH_JOIN_NODE (id=9):(Total: 24s102ms, non-child: 3s289ms, % non-child: 13.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 282.100ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 21.88M (21884958) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s947ms - RowsReturned: 21.88M (21884958) - RowsReturnedRate: 907.99 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.948ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 2.698ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.898ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s978ms, non-child: 18.931ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.144ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.12 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.00 MB, 21.30 MB, 29.09 MB, 32.21 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s550ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s963ms - DataArrivalTimer: 19s959ms SenderSide: - DeserializeRowBatchTimer: 181.132ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s437ms, non-child: 702.018ms, % non-child: 12.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 947.419us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.88M (21884958) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 661.161ms - RowsReturned: 21.88M (21884958) - RowsReturnedRate: 4.02 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.449us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 531.768us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.171us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s012ms, non-child: 44.245us, % non-child: 0.00%) - ConvertRowBatchTime: 24.513us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 45.00 /sec RecvrSide: BytesReceived(4s000ms): 875.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 208.390ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s012ms - DataArrivalTimer: 2s012ms SenderSide: - DeserializeRowBatchTimer: 41.990us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s723ms, non-child: 2s723ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:10/2.48 GB 7:18/4.16 GB 2:15/3.71 GB 3:16/3.67 GB 6:14/3.47 GB 4:21/5.20 GB 1:17/4.01 GB 0:17/3.99 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s549ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 141.75 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB, 189.00 MB - FooterProcessingTime: (Avg: 1.394ms ; Min: 818.596us ; Max: 2.655ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 189.00 MB (198181341) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.00 MB (198181341) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.00 MB (198181341) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 971.470ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.23 MB (245606735) - PerReadThreadRawHdfsThroughput: 894.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.792ms - RowBatchQueuePutWaitTime: 10m35s - RowsRead: 21.89M (21886500) - RowsReturned: 21.88M (21884958) - RowsReturnedRate: 8.04 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1315) - ScannerThreadsTotalWallClockTime: 10m49s - MaterializeTupleTime(*): 3s323ms - ScannerThreadsSysTime: 582.909ms - ScannerThreadsUserTime: 5s279ms - ScannerThreadsVoluntaryContextSwitches: 30.10K (30097) - TotalRawHdfsReadTime(*): 211.340ms - TotalReadThroughput: 1.14 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.08K (67078) - Rows rejected: 1.54K (1542) - Rows total: 21.89M (21886500) Filter 5 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 21.88M (21884958) Filter 6 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 21.88M (21884958) Filter 7 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 21.88M (21884958) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.88M (21884958) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 21.37K (21372) - RowGroups rejected: 0 (0) - RowGroups total: 21.37K (21372) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.88M (21884958) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000ab (host=foo.234.49:22000):(Total: 2m45s, non-child: 1m53s, % non-child: 68.62%) Hdfs split stats (:<# splits>/): 5:17/4.21 GB 4:16/3.91 GB 3:16/3.91 GB 2:15/3.67 GB 0:12/2.66 GB 1:18/4.46 GB 6:15/3.71 GB 7:15/3.71 GB Filter 9 arrival: 559ms Filter 0 arrival: 606ms Filter 8 arrival: 18s959ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 272.54 MB, 374.28 MB, 374.28 MB, 379.61 MB, 394.30 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.08 MB, 394.03 MB, 394.25 MB, 394.26 MB, 394.23 MB, 394.39 MB, 394.30 MB, 394.26 MB, 394.30 MB, 363.49 MB, 362.48 MB, 362.45 MB, 362.43 MB, 337.66 MB, 330.60 MB, 330.67 MB, 330.48 MB, 282.23 MB, 217.25 MB, 208.28 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.65 MB (416968785) - PerHostPeakMemUsage: 1.28 GB (1376628520) - RowsProduced: 27.88M (27875936) - TotalNetworkReceiveTime: 18s153ms - TotalNetworkSendTime: 1m33s - TotalStorageWaitTime: 184.721ms - TotalThreadsInvoluntaryContextSwitches: 11.33K (11327) - TotalThreadsTotalWallClockTime: 13m52s - TotalThreadsSysTime: 12s081ms - TotalThreadsUserTime: 1m20s - TotalThreadsVoluntaryContextSwitches: 1.12M (1119101) Fragment Instance Lifecycle Timings: - ExecTime: 2m26s - ExecTreeExecTime: 4s729ms - OpenTime: 18s973ms - ExecTreeOpenTime: 18s449ms - PrepareTime: 37.864ms - ExecTreePrepareTime: 1.369ms DataStreamSender (dst_id=19):(Total: 28s216ms, non-child: 28s216ms, % non-child: 100.00%) - BytesSent: 3.79 GB (4064502273) - OverallThroughput: 137.37 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 27.88M (27875936) - SerializeBatchTime: 28s186ms - UncompressedRowBatchSize: 3.79 GB (4064502273) CodeGen:(Total: 546.684ms, non-child: 546.684ms, % non-child: 100.00%) - CodegenTime: 1.751ms - CompileTime: 189.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 333.059ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 23.167ms HASH_JOIN_NODE (id=9):(Total: 23s157ms, non-child: 3s921ms, % non-child: 16.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.334ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 27.88M (27875936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s607ms - RowsReturned: 27.88M (27875936) - RowsReturnedRate: 1.20 M/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 219.424ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 496.768us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.971ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s167ms, non-child: 16.508ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.296ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.43 K/sec RecvrSide: BytesReceived(4s000ms): 93.31 KB, 9.87 MB, 26.71 MB, 30.54 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s716ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s153ms - DataArrivalTimer: 18s151ms SenderSide: - DeserializeRowBatchTimer: 176.309ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s595ms, non-child: 873.029ms, % non-child: 15.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 367.375us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 27.88M (27875936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 816.533ms - RowsReturned: 27.88M (27875936) - RowsReturnedRate: 4.98 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.332us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 119.531us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.903us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 11.827us, non-child: 11.827us, % non-child: 100.00%) - ConvertRowBatchTime: 3.478us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.69 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.449us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 26.292us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s722ms, non-child: 4s722ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/4.21 GB 4:16/3.91 GB 3:16/3.91 GB 2:15/3.67 GB 0:12/2.66 GB 1:18/4.46 GB 6:15/3.71 GB 7:15/3.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s514ms Hdfs Read Thread Concurrency Bucket: 0:99.7% 1:0% 2:0% 3:0% 4:0.303% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:119 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 127.65 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 188.02 MB, 235.29 MB, 235.29 MB, 235.29 MB - FooterProcessingTime: (Avg: 2.067ms ; Min: 876.193us ; Max: 2.475ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 235.29 MB (246716401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.29 MB (246716401) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.29 MB (246716401) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s187ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.27 MB (246697850) - PerReadThreadRawHdfsThroughput: 876.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46.151ms - RowBatchQueuePutWaitTime: 10m - RowsRead: 27.88M (27878004) - RowsReturned: 27.88M (27875936) - RowsReturnedRate: 5.90 M/sec - ScanRangesComplete: 124 (124) - ScannerThreadsInvoluntaryContextSwitches: 5.05K (5054) - ScannerThreadsTotalWallClockTime: 10m48s - MaterializeTupleTime(*): 4s224ms - ScannerThreadsSysTime: 10s286ms - ScannerThreadsUserTime: 28s298ms - ScannerThreadsVoluntaryContextSwitches: 1.10M (1100253) - TotalRawHdfsReadTime(*): 268.446ms - TotalReadThroughput: 1.42 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.99K (83988) - Rows rejected: 2.07K (2068) - Rows total: 27.88M (27878004) Filter 5 (2.00 MB): - Rows processed: 56.32K (56320) - Rows rejected: 0 (0) - Rows total: 27.88M (27875936) Filter 6 (2.00 MB): - Rows processed: 56.32K (56320) - Rows rejected: 0 (0) - Rows total: 27.88M (27875936) Filter 7 (2.00 MB): - Rows processed: 56.32K (56320) - Rows rejected: 0 (0) - Rows total: 27.88M (27875936) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 27.88M (27875936) Filter 9 (8.00 KB): - Files processed: 124 (124) - Files rejected: 119 (119) - Files total: 124 (124) - RowGroups processed: 27.22K (27222) - RowGroups rejected: 0 (0) - RowGroups total: 27.22K (27222) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 27.88M (27875936) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000ad (host=foo.187.49:22000):(Total: 2m45s, non-child: 1m58s, % non-child: 71.62%) Hdfs split stats (:<# splits>/): 2:9/2.15 GB 4:20/4.74 GB 6:19/4.70 GB 7:13/3.01 GB 5:14/3.28 GB 1:18/4.19 GB 0:26/6.07 GB 3:10/2.48 GB Filter 0 arrival: 2s385ms Filter 9 arrival: 2s707ms Filter 8 arrival: 22s446ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.53 MB, 234.55 MB, 376.18 MB, 376.18 MB, 376.17 MB, 384.77 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 399.08 MB, 397.00 MB, 396.08 MB, 396.26 MB, 396.25 MB, 396.23 MB, 396.20 MB, 396.15 MB, 396.24 MB, 396.21 MB, 370.30 MB, 364.44 MB, 364.35 MB, 364.27 MB, 364.49 MB, 335.57 MB, 332.56 MB, 327.47 MB, 312.09 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 399.59 MB (419003974) - PerHostPeakMemUsage: 1.31 GB (1403865257) - RowsProduced: 21.32M (21318957) - TotalNetworkReceiveTime: 23s909ms - TotalNetworkSendTime: 1m42s - TotalStorageWaitTime: 168.132ms - TotalThreadsInvoluntaryContextSwitches: 6.04K (6045) - TotalThreadsTotalWallClockTime: 13m49s - TotalThreadsSysTime: 2s347ms - TotalThreadsUserTime: 44s805ms - TotalThreadsVoluntaryContextSwitches: 99.85K (99851) Fragment Instance Lifecycle Timings: - ExecTime: 2m22s - ExecTreeExecTime: 3s636ms - OpenTime: 22s453ms - ExecTreeOpenTime: 21s994ms - PrepareTime: 37.285ms - ExecTreePrepareTime: 1.052ms DataStreamSender (dst_id=19):(Total: 20s800ms, non-child: 20s800ms, % non-child: 100.00%) - BytesSent: 2.90 GB (3112479210) - OverallThroughput: 142.70 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 21.32M (21318957) - SerializeBatchTime: 20s783ms - UncompressedRowBatchSize: 2.90 GB (3112479210) CodeGen:(Total: 481.995ms, non-child: 481.995ms, % non-child: 100.00%) - CodegenTime: 1.979ms - CompileTime: 147.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 309.689ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.564ms HASH_JOIN_NODE (id=9):(Total: 25s611ms, non-child: 3s085ms, % non-child: 12.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 270.687ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.32M (21318957) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s754ms - RowsReturned: 21.32M (21318957) - RowsReturnedRate: 832.40 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 228.385ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 561.037us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.440ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s711ms, non-child: 17.766ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.821ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.28 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.49 MB, 22.22 MB, 29.17 MB, 32.27 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s574ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s697ms - DataArrivalTimer: 21s694ms SenderSide: - DeserializeRowBatchTimer: 283.509ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s437ms, non-child: 685.089ms, % non-child: 12.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 766.891us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.32M (21318957) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 640.439ms - RowsReturned: 21.32M (21318957) - RowsReturnedRate: 3.92 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.840us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 220.903us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.446us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s212ms, non-child: 16.931us, % non-child: 0.00%) - ConvertRowBatchTime: 3.930us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 41.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 227.909ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s211ms - DataArrivalTimer: 2s211ms SenderSide: - DeserializeRowBatchTimer: 35.815us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s540ms, non-child: 2s540ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:9/2.15 GB 4:20/4.74 GB 6:19/4.70 GB 7:13/3.01 GB 5:14/3.28 GB 1:18/4.19 GB 0:26/6.07 GB 3:10/2.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s369ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 144.60 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB, 192.80 MB - FooterProcessingTime: (Avg: 1.493ms ; Min: 547.438us ; Max: 2.435ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.90 - BytesRead: 192.80 MB (202167242) - BytesReadDataNodeCache: 0 - BytesReadLocal: 192.80 MB (202167242) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 192.80 MB (202167242) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 995.140ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.16 MB (248680691) - PerReadThreadRawHdfsThroughput: 1007.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.203ms - RowBatchQueuePutWaitTime: 10m31s - RowsRead: 21.32M (21320476) - RowsReturned: 21.32M (21318957) - RowsReturnedRate: 8.39 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1349) - ScannerThreadsTotalWallClockTime: 10m40s - MaterializeTupleTime(*): 3s280ms - ScannerThreadsSysTime: 1s041ms - ScannerThreadsUserTime: 5s737ms - ScannerThreadsVoluntaryContextSwitches: 84.57K (84569) - TotalRawHdfsReadTime(*): 191.286ms - TotalReadThroughput: 1.17 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.06K (67055) - Rows rejected: 1.52K (1519) - Rows total: 21.32M (21320476) Filter 5 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 21.32M (21318957) Filter 6 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 21.32M (21318957) Filter 7 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 21.32M (21318957) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.32M (21318957) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 125 (125) - Files total: 129 (129) - RowGroups processed: 20.82K (20819) - RowGroups rejected: 0 (0) - RowGroups total: 20.82K (20819) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.32M (21318957) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000ec (host=foo.187.55:22000):(Total: 2m44s, non-child: 1m57s, % non-child: 71.44%) Hdfs split stats (:<# splits>/): 5:12/2.91 GB 6:13/3.11 GB 4:17/4.19 GB 3:17/4.15 GB 1:21/5.04 GB 2:21/5.17 GB 7:16/3.59 GB 0:10/2.45 GB Filter 0 arrival: 2s182ms Filter 9 arrival: 2s298ms Filter 8 arrival: 22s247ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 232.35 MB, 373.24 MB, 373.25 MB, 373.23 MB, 381.53 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 395.33 MB, 393.19 MB, 393.46 MB, 393.27 MB, 393.25 MB, 393.20 MB, 393.33 MB, 393.39 MB, 393.21 MB, 384.38 MB, 361.36 MB, 361.35 MB, 361.36 MB, 361.41 MB, 358.32 MB, 330.51 MB, 329.66 MB, 324.38 MB, 272.73 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.51 MB (415768501) - PerHostPeakMemUsage: 1.31 GB (1401305784) - RowsProduced: 21.10M (21096580) - TotalNetworkReceiveTime: 23s202ms - TotalNetworkSendTime: 1m41s - TotalStorageWaitTime: 153.150ms - TotalThreadsInvoluntaryContextSwitches: 6.30K (6301) - TotalThreadsTotalWallClockTime: 13m42s - TotalThreadsSysTime: 2s530ms - TotalThreadsUserTime: 48s332ms - TotalThreadsVoluntaryContextSwitches: 105.90K (105904) Fragment Instance Lifecycle Timings: - ExecTime: 2m21s - ExecTreeExecTime: 3s770ms - OpenTime: 22s247ms - ExecTreeOpenTime: 21s739ms - PrepareTime: 44.368ms - ExecTreePrepareTime: 1.412ms DataStreamSender (dst_id=19):(Total: 20s858ms, non-child: 20s858ms, % non-child: 100.00%) - BytesSent: 2.87 GB (3082574774) - OverallThroughput: 140.94 MB/sec - PeakMemoryUsage: 7.86 MB (8245280) - RowsReturned: 21.10M (21096580) - SerializeBatchTime: 20s840ms - UncompressedRowBatchSize: 2.87 GB (3082574774) CodeGen:(Total: 533.434ms, non-child: 533.434ms, % non-child: 100.00%) - CodegenTime: 2.476ms - CompileTime: 158.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 347.255ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.287ms HASH_JOIN_NODE (id=9):(Total: 25s494ms, non-child: 3s222ms, % non-child: 12.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 258.917ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.10M (21096580) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s903ms - RowsReturned: 21.10M (21096580) - RowsReturnedRate: 827.50 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.960ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 373.250us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.995ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s467ms, non-child: 16.930ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.666ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.52 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.83 MB, 22.63 MB, 29.35 MB, 32.32 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s313ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s452ms - DataArrivalTimer: 21s450ms SenderSide: - DeserializeRowBatchTimer: 187.180ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s354ms, non-child: 679.217ms, % non-child: 12.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 427.131us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.10M (21096580) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 644.072ms - RowsReturned: 21.10M (21096580) - RowsReturnedRate: 3.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.477us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 108.556us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.638us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s748ms, non-child: 13.241us, % non-child: 0.00%) - ConvertRowBatchTime: 3.211us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 52.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s748ms - DataArrivalTimer: 1s748ms SenderSide: - DeserializeRowBatchTimer: 74.078us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s926ms, non-child: 2s926ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:12/2.91 GB 6:13/3.11 GB 4:17/4.19 GB 3:17/4.15 GB 1:21/5.04 GB 2:21/5.17 GB 7:16/3.59 GB 0:10/2.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s769ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 139.04 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB, 185.39 MB - FooterProcessingTime: (Avg: 1.822ms ; Min: 692.486us ; Max: 2.738ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 185.39 MB (194393729) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.39 MB (194393729) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.39 MB (194393729) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 942.656ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.22 MB (245600199) - PerReadThreadRawHdfsThroughput: 941.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.120ms - RowBatchQueuePutWaitTime: 10m25s - RowsRead: 21.10M (21098128) - RowsReturned: 21.10M (21096580) - RowsReturnedRate: 7.21 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1553) - ScannerThreadsTotalWallClockTime: 10m34s - MaterializeTupleTime(*): 3s227ms - ScannerThreadsSysTime: 1s050ms - ScannerThreadsUserTime: 8s909ms - ScannerThreadsVoluntaryContextSwitches: 89.23K (89227) - TotalRawHdfsReadTime(*): 196.868ms - TotalReadThroughput: 1.13 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.08K (67084) - Rows rejected: 1.55K (1548) - Rows total: 21.10M (21098128) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21096580) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21096580) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 21.10M (21096580) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.10M (21096580) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 123 (123) - Files total: 127 (127) - RowGroups processed: 20.60K (20602) - RowGroups rejected: 0 (0) - RowGroups total: 20.60K (20602) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.10M (21096580) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000f0 (host=foo.246.38:22000):(Total: 2m40s, non-child: 1m49s, % non-child: 68.37%) Hdfs split stats (:<# splits>/): 0:16/3.63 GB 3:23/5.46 GB 2:10/2.48 GB 5:20/4.85 GB 6:11/2.64 GB 1:13/3.05 GB 7:17/4.19 GB 4:17/3.96 GB Filter 0 arrival: 495ms Filter 9 arrival: 586ms Filter 8 arrival: 20s915ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 271.97 MB, 358.91 MB, 358.91 MB, 358.91 MB, 374.84 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.16 MB, 380.06 MB, 378.82 MB, 378.92 MB, 379.11 MB, 378.95 MB, 378.91 MB, 379.02 MB, 379.05 MB, 356.11 MB, 347.07 MB, 347.03 MB, 368.32 MB, 357.09 MB, 347.20 MB, 347.08 MB, 329.35 MB, 242.65 MB, 199.83 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.08 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 382.27 MB (400834716) - PerHostPeakMemUsage: 1.31 GB (1401697212) - RowsProduced: 24.70M (24701757) - TotalNetworkReceiveTime: 20s077ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 187.555ms - TotalThreadsInvoluntaryContextSwitches: 10.00K (10003) - TotalThreadsTotalWallClockTime: 13m34s - TotalThreadsSysTime: 7s032ms - TotalThreadsUserTime: 1m6s - TotalThreadsVoluntaryContextSwitches: 582.19K (582187) Fragment Instance Lifecycle Timings: - ExecTime: 2m19s - ExecTreeExecTime: 4s417ms - OpenTime: 20s920ms - ExecTreeOpenTime: 20s375ms - PrepareTime: 45.136ms - ExecTreePrepareTime: 1.385ms DataStreamSender (dst_id=19):(Total: 25s315ms, non-child: 25s315ms, % non-child: 100.00%) - BytesSent: 3.35 GB (3601292345) - OverallThroughput: 135.67 MB/sec - PeakMemoryUsage: 7.96 MB (8343584) - RowsReturned: 24.70M (24701757) - SerializeBatchTime: 25s293ms - UncompressedRowBatchSize: 3.35 GB (3601292345) CodeGen:(Total: 573.867ms, non-child: 573.867ms, % non-child: 100.00%) - CodegenTime: 1.773ms - CompileTime: 165.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 377.783ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.046ms HASH_JOIN_NODE (id=9):(Total: 24s771ms, non-child: 3s653ms, % non-child: 14.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 271.628ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 24.70M (24701757) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s346ms - RowsReturned: 24.70M (24701757) - RowsReturnedRate: 997.18 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.718ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 521.205us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.965ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s091ms, non-child: 17.210ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.786ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.99 K/sec RecvrSide: BytesReceived(4s000ms): 158.97 KB, 10.78 MB, 26.84 MB, 30.69 MB, 32.77 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s592ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s077ms - DataArrivalTimer: 20s074ms SenderSide: - DeserializeRowBatchTimer: 178.885ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s516ms, non-child: 849.950ms, % non-child: 15.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 372.984us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 24.70M (24701757) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 802.202ms - RowsReturned: 24.70M (24701757) - RowsReturnedRate: 4.48 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.417us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 131.207us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.716us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 9.111us, non-child: 9.111us, % non-child: 100.00%) - ConvertRowBatchTime: 3.345us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 9.99 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1.283us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 252.208us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s666ms, non-child: 4s666ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:16/3.63 GB 3:23/5.46 GB 2:10/2.48 GB 5:20/4.85 GB 6:11/2.64 GB 1:13/3.05 GB 7:17/4.19 GB 4:17/3.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s475ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:25 BytesRead(4s000ms): 0, 129.68 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 172.90 MB, 213.81 MB, 219.66 MB, 219.66 MB, 219.66 MB, 219.66 MB, 219.66 MB, 219.66 MB - FooterProcessingTime: (Avg: 2.325ms ; Min: 567.872us ; Max: 2.800ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.96 - BytesRead: 219.66 MB (230326933) - BytesReadDataNodeCache: 0 - BytesReadLocal: 219.66 MB (230326933) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 219.66 MB (230326933) - CachedFileHandlesHitCount: 43 (43) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 1s133ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.91 MB (230590651) - PerReadThreadRawHdfsThroughput: 877.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 48.054ms - RowBatchQueuePutWaitTime: 9m52s - RowsRead: 24.70M (24703654) - RowsReturned: 24.70M (24701757) - RowsReturnedRate: 5.29 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 4.27K (4267) - ScannerThreadsTotalWallClockTime: 10m33s - MaterializeTupleTime(*): 3s748ms - ScannerThreadsSysTime: 5s484ms - ScannerThreadsUserTime: 19s447ms - ScannerThreadsVoluntaryContextSwitches: 564.17K (564169) - TotalRawHdfsReadTime(*): 250.359ms - TotalReadThroughput: 1.37 MB/sec Filter 0 (8.00 KB): - Rows processed: 83.82K (83817) - Rows rejected: 1.90K (1897) - Rows total: 24.70M (24703654) Filter 5 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 24.70M (24701757) Filter 6 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 24.70M (24701757) Filter 7 (2.00 MB): - Rows processed: 48.13K (48128) - Rows rejected: 0 (0) - Rows total: 24.70M (24701757) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 24.70M (24701757) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 122 (122) - Files total: 127 (127) - RowGroups processed: 24.12K (24122) - RowGroups rejected: 0 (0) - RowGroups total: 24.12K (24122) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 24.70M (24701757) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce18000000b8 (host=foo.234.47:22000):(Total: 2m39s, non-child: 1m52s, % non-child: 71.02%) Hdfs split stats (:<# splits>/): 6:16/3.71 GB 0:16/3.96 GB 4:13/2.97 GB 1:18/4.44 GB 2:20/4.89 GB 3:19/4.37 GB 7:10/2.48 GB 5:14/3.23 GB Filter 0 arrival: 593ms Filter 9 arrival: 724ms Filter 8 arrival: 18s946ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 257.53 MB, 373.35 MB, 373.39 MB, 378.58 MB, 393.47 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.41 MB, 393.40 MB, 393.35 MB, 393.35 MB, 393.54 MB, 393.43 MB, 393.50 MB, 393.44 MB, 393.52 MB, 378.43 MB, 361.60 MB, 361.63 MB, 361.58 MB, 361.66 MB, 355.74 MB, 330.77 MB, 329.89 MB, 329.80 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.08 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 396.74 MB (416010265) - PerHostPeakMemUsage: 1.31 GB (1401445567) - RowsProduced: 22.28M (22281742) - TotalNetworkReceiveTime: 18s314ms - TotalNetworkSendTime: 1m36s - TotalStorageWaitTime: 173.266ms - TotalThreadsInvoluntaryContextSwitches: 7.12K (7119) - TotalThreadsTotalWallClockTime: 13m27s - TotalThreadsSysTime: 2s508ms - TotalThreadsUserTime: 48s840ms - TotalThreadsVoluntaryContextSwitches: 102.16K (102157) Fragment Instance Lifecycle Timings: - ExecTime: 2m20s - ExecTreeExecTime: 3s972ms - OpenTime: 18s957ms - ExecTreeOpenTime: 18s444ms - PrepareTime: 43.847ms - ExecTreePrepareTime: 1.239ms DataStreamSender (dst_id=19):(Total: 23s152ms, non-child: 23s152ms, % non-child: 100.00%) - BytesSent: 3.03 GB (3254762777) - OverallThroughput: 134.07 MB/sec - PeakMemoryUsage: 7.96 MB (8351776) - RowsReturned: 22.28M (22281742) - SerializeBatchTime: 23s131ms - UncompressedRowBatchSize: 3.03 GB (3254762777) CodeGen:(Total: 538.472ms, non-child: 538.472ms, % non-child: 100.00%) - CodegenTime: 2.674ms - CompileTime: 157.725ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 353.804ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.297ms HASH_JOIN_NODE (id=9):(Total: 22s399ms, non-child: 3s310ms, % non-child: 14.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 275.714ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.28M (22281742) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s009ms - RowsReturned: 22.28M (22281742) - RowsReturnedRate: 994.75 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.827ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 394.861us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.982ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s156ms, non-child: 17.686ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.472ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.45 K/sec RecvrSide: BytesReceived(4s000ms): 121.71 KB, 10.04 MB, 26.71 MB, 30.59 MB, 32.77 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s712ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s142ms - DataArrivalTimer: 18s138ms SenderSide: - DeserializeRowBatchTimer: 279.184ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s484ms, non-child: 763.260ms, % non-child: 13.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 374.772us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.28M (22281742) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 721.055ms - RowsReturned: 22.28M (22281742) - RowsReturnedRate: 4.06 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.126us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 84.405us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.275us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 171.727ms, non-child: 22.304us, % non-child: 0.01%) - ConvertRowBatchTime: 1.991us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 529.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 171.721ms - DataArrivalTimer: 171.705ms SenderSide: - DeserializeRowBatchTimer: 119.040us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s549ms, non-child: 4s549ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:16/3.71 GB 0:16/3.96 GB 4:13/2.97 GB 1:18/4.44 GB 2:20/4.89 GB 3:19/4.37 GB 7:10/2.48 GB 5:14/3.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s334ms Hdfs Read Thread Concurrency Bucket: 0:99.68% 1:0% 2:0% 3:0.3155% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 117.97 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB, 187.73 MB - FooterProcessingTime: (Avg: 1.697ms ; Min: 1.512ms ; Max: 1.845ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 3.97 - BytesRead: 187.73 MB (196851152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.73 MB (196851152) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.73 MB (196851152) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 984.860ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.43 MB (245813184) - PerReadThreadRawHdfsThroughput: 701.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 54.872ms - RowBatchQueuePutWaitTime: 10m7s - RowsRead: 22.28M (22283346) - RowsReturned: 22.28M (22281742) - RowsReturnedRate: 4.90 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 1.79K (1793) - ScannerThreadsTotalWallClockTime: 10m29s - MaterializeTupleTime(*): 3s540ms - ScannerThreadsSysTime: 1s033ms - ScannerThreadsUserTime: 5s958ms - ScannerThreadsVoluntaryContextSwitches: 85.59K (85591) - TotalRawHdfsReadTime(*): 267.572ms - TotalReadThroughput: 1.18 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.14K (67140) - Rows rejected: 1.60K (1604) - Rows total: 22.28M (22283346) Filter 5 (2.00 MB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 22.28M (22281742) Filter 6 (2.00 MB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 22.28M (22281742) Filter 7 (2.00 MB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 22.28M (22281742) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 22.28M (22281742) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 122 (122) - Files total: 126 (126) - RowGroups processed: 21.76K (21760) - RowGroups rejected: 0 (0) - RowGroups total: 21.76K (21760) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 22.28M (22281742) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000ce (host=foo.234.51:22000):(Total: 2m37s, non-child: 1m51s, % non-child: 70.49%) Hdfs split stats (:<# splits>/): 2:19/4.66 GB 0:7/1.73 GB 5:14/3.41 GB 4:14/3.23 GB 1:19/4.50 GB 3:25/6.00 GB 6:14/3.31 GB 7:13/3.14 GB Filter 9 arrival: 506ms Filter 0 arrival: 567ms Filter 8 arrival: 20s981ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.88 MB, 301.26 MB, 376.66 MB, 376.69 MB, 376.66 MB, 393.44 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 399.03 MB, 397.72 MB, 396.59 MB, 396.57 MB, 396.63 MB, 396.69 MB, 396.66 MB, 396.75 MB, 396.63 MB, 378.90 MB, 364.82 MB, 364.90 MB, 364.79 MB, 364.98 MB, 347.83 MB, 333.22 MB, 325.07 MB, 291.72 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 400.01 MB (419441070) - PerHostPeakMemUsage: 1.28 GB (1377587880) - RowsProduced: 21.45M (21445714) - TotalNetworkReceiveTime: 20s215ms - TotalNetworkSendTime: 1m35s - TotalStorageWaitTime: 164.171ms - TotalThreadsInvoluntaryContextSwitches: 6.86K (6862) - TotalThreadsTotalWallClockTime: 13m15s - TotalThreadsSysTime: 2s543ms - TotalThreadsUserTime: 50s339ms - TotalThreadsVoluntaryContextSwitches: 113.46K (113457) Fragment Instance Lifecycle Timings: - ExecTime: 2m16s - ExecTreeExecTime: 3s723ms - OpenTime: 20s988ms - ExecTreeOpenTime: 20s520ms - PrepareTime: 46.325ms - ExecTreePrepareTime: 1.779ms DataStreamSender (dst_id=19):(Total: 21s867ms, non-child: 21s867ms, % non-child: 100.00%) - BytesSent: 2.92 GB (3132785341) - OverallThroughput: 136.63 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 21.45M (21445714) - SerializeBatchTime: 21s848ms - UncompressedRowBatchSize: 2.92 GB (3132785341) CodeGen:(Total: 493.811ms, non-child: 493.811ms, % non-child: 100.00%) - CodegenTime: 1.578ms - CompileTime: 154.823ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 312.595ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.963ms HASH_JOIN_NODE (id=9):(Total: 24s228ms, non-child: 3s111ms, % non-child: 12.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 276.657ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 21.45M (21445714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s806ms - RowsReturned: 21.45M (21445714) - RowsReturnedRate: 885.14 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 230.860ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 429.472us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.904ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s229ms, non-child: 16.943ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.934ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.84 K/sec RecvrSide: BytesReceived(4s000ms): 335.85 KB, 11.89 MB, 27.22 MB, 30.83 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s723ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s214ms - DataArrivalTimer: 20s212ms SenderSide: - DeserializeRowBatchTimer: 282.697ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s449ms, non-child: 723.949ms, % non-child: 13.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 446.622us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.45M (21445714) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 686.109ms - RowsReturned: 21.45M (21445714) - RowsReturnedRate: 3.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.632us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 142.942us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.782us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 13.578us, non-child: 13.578us, % non-child: 100.00%) - ConvertRowBatchTime: 3.632us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 6.70 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 3.760us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 126.876us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s726ms, non-child: 4s726ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:19/4.66 GB 0:7/1.73 GB 5:14/3.41 GB 4:14/3.23 GB 1:19/4.50 GB 3:25/6.00 GB 6:14/3.31 GB 7:13/3.14 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s560ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 143.12 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB, 190.83 MB - FooterProcessingTime: (Avg: 2.937ms ; Min: 2.460ms ; Max: 4.251ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.94 - BytesRead: 190.83 MB (200096644) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200096644) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200096644) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 979.225ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.65 MB (249195334) - PerReadThreadRawHdfsThroughput: 965.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.413ms - RowBatchQueuePutWaitTime: 9m59s - RowsRead: 21.45M (21447367) - RowsReturned: 21.45M (21445714) - RowsReturnedRate: 4.54 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 1.83K (1835) - ScannerThreadsTotalWallClockTime: 10m17s - MaterializeTupleTime(*): 3s408ms - ScannerThreadsSysTime: 1s199ms - ScannerThreadsUserTime: 9s779ms - ScannerThreadsVoluntaryContextSwitches: 96.41K (96414) - TotalRawHdfsReadTime(*): 197.673ms - TotalReadThroughput: 1.21 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.19K (67189) - Rows rejected: 1.65K (1653) - Rows total: 21.45M (21447367) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.45M (21445714) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.45M (21445714) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.45M (21445714) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.45M (21445714) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 121 (121) - Files total: 125 (125) - RowGroups processed: 20.94K (20942) - RowGroups rejected: 0 (0) - RowGroups total: 20.94K (20942) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.45M (21445714) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000095 (host=foo.234.48:22000):(Total: 2m36s, non-child: 1m49s, % non-child: 69.82%) Hdfs split stats (:<# splits>/): 7:18/4.09 GB 2:14/3.30 GB 6:18/4.21 GB 0:17/3.73 GB 4:19/4.29 GB 3:16/3.90 GB 5:15/3.44 GB 1:15/3.38 GB Filter 9 arrival: 563ms Filter 0 arrival: 596ms Filter 8 arrival: 19s824ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 283.12 MB, 373.80 MB, 373.80 MB, 376.29 MB, 394.37 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.21 MB, 394.03 MB, 393.91 MB, 393.83 MB, 393.95 MB, 394.02 MB, 393.94 MB, 393.88 MB, 385.00 MB, 362.00 MB, 362.13 MB, 362.07 MB, 362.02 MB, 345.91 MB, 329.99 MB, 329.98 MB, 329.95 MB, 266.78 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.07 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.22 MB (416510843) - PerHostPeakMemUsage: 1.28 GB (1370121389) - RowsProduced: 22.44M (22435405) - TotalNetworkReceiveTime: 19s012ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 156.564ms - TotalThreadsInvoluntaryContextSwitches: 6.88K (6879) - TotalThreadsTotalWallClockTime: 13m13s - TotalThreadsSysTime: 2s185ms - TotalThreadsUserTime: 49s733ms - TotalThreadsVoluntaryContextSwitches: 56.97K (56971) Fragment Instance Lifecycle Timings: - ExecTime: 2m16s - ExecTreeExecTime: 4s065ms - OpenTime: 19s833ms - ExecTreeOpenTime: 19s311ms - PrepareTime: 44.438ms - ExecTreePrepareTime: 2.152ms DataStreamSender (dst_id=19):(Total: 23s349ms, non-child: 23s349ms, % non-child: 100.00%) - BytesSent: 3.05 GB (3277071803) - OverallThroughput: 133.84 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 22.44M (22435405) - SerializeBatchTime: 23s329ms - UncompressedRowBatchSize: 3.05 GB (3277071803) CodeGen:(Total: 549.247ms, non-child: 549.247ms, % non-child: 100.00%) - CodegenTime: 1.762ms - CompileTime: 158.984ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 361.180ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.583ms HASH_JOIN_NODE (id=9):(Total: 23s360ms, non-child: 3s407ms, % non-child: 14.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.339ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.44M (22435405) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s101ms - RowsReturned: 22.44M (22435405) - RowsReturnedRate: 960.38 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.101ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 2.033ms - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.269ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s026ms, non-child: 17.958ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.829ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.28 K/sec RecvrSide: BytesReceived(4s000ms): 270.58 KB, 11.27 MB, 27.03 MB, 30.74 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s707ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s012ms - DataArrivalTimer: 19s008ms SenderSide: - DeserializeRowBatchTimer: 183.115ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s437ms, non-child: 758.118ms, % non-child: 13.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 332.720us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.44M (22435405) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 718.837ms - RowsReturned: 22.44M (22435405) - RowsReturnedRate: 4.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 18.288us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 122.663us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 66.147us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 9.967us, non-child: 9.967us, % non-child: 100.00%) - ConvertRowBatchTime: 3.548us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 9.13 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1.627us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 171.258us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s679ms, non-child: 4s679ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/4.09 GB 2:14/3.30 GB 6:18/4.21 GB 0:17/3.73 GB 4:19/4.29 GB 3:16/3.90 GB 5:15/3.44 GB 1:15/3.38 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s495ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 140.41 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB, 187.21 MB - FooterProcessingTime: (Avg: 2.342ms ; Min: 1.506ms ; Max: 2.843ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.99 - BytesRead: 187.21 MB (196303316) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.21 MB (196303316) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.21 MB (196303316) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 977.368ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 234.83 MB (246239212) - PerReadThreadRawHdfsThroughput: 844.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.082ms - RowBatchQueuePutWaitTime: 9m55s - RowsRead: 22.44M (22436910) - RowsReturned: 22.44M (22435405) - RowsReturnedRate: 4.79 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 1.53K (1528) - ScannerThreadsTotalWallClockTime: 10m17s - MaterializeTupleTime(*): 3s469ms - ScannerThreadsSysTime: 663.897ms - ScannerThreadsUserTime: 6s298ms - ScannerThreadsVoluntaryContextSwitches: 41.61K (41606) - TotalRawHdfsReadTime(*): 221.657ms - TotalReadThroughput: 1.20 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.04K (67041) - Rows rejected: 1.50K (1505) - Rows total: 22.44M (22436910) Filter 5 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 22.44M (22435405) Filter 6 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 22.44M (22435405) Filter 7 (2.00 MB): - Rows processed: 23.55K (23552) - Rows rejected: 0 (0) - Rows total: 22.44M (22435405) Filter 8 (256.00 KB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 22.44M (22435405) Filter 9 (8.00 KB): - Files processed: 132 (132) - Files rejected: 128 (128) - Files total: 132 (132) - RowGroups processed: 21.91K (21910) - RowGroups rejected: 0 (0) - RowGroups total: 21.91K (21910) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 22.44M (22435405) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000104 (host=foo.187.52:22000):(Total: 2m35s, non-child: 1m53s, % non-child: 72.81%) Hdfs split stats (:<# splits>/): 1:12/2.82 GB 0:7/1.73 GB 5:11/2.45 GB 7:23/5.47 GB 4:13/2.95 GB 6:16/3.90 GB 2:20/4.91 GB 3:22/5.45 GB Filter 9 arrival: 1s760ms Filter 0 arrival: 2s051ms Filter 8 arrival: 22s701ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 189.68 MB, 316.35 MB, 316.34 MB, 316.33 MB, 321.69 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.77 MB, 337.80 MB, 336.69 MB, 336.31 MB, 336.44 MB, 336.39 MB, 336.45 MB, 334.35 MB, 314.62 MB, 312.56 MB, 312.40 MB, 312.42 MB, 312.49 MB, 310.53 MB, 288.64 MB, 288.65 MB, 288.63 MB, 210.10 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3 - AverageThreadTokens: 5.00 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.68 MB (356184941) - PerHostPeakMemUsage: 1.23 GB (1316359560) - RowsProduced: 16.83M (16832441) - TotalNetworkReceiveTime: 23s171ms - TotalNetworkSendTime: 1m41s - TotalStorageWaitTime: 114.708ms - TotalThreadsInvoluntaryContextSwitches: 20.75K (20751) - TotalThreadsTotalWallClockTime: 13m - TotalThreadsSysTime: 3s172ms - TotalThreadsUserTime: 3m4s - TotalThreadsVoluntaryContextSwitches: 124.22K (124215) Fragment Instance Lifecycle Timings: - ExecTime: 2m13s - ExecTreeExecTime: 2s851ms - OpenTime: 22s707ms - ExecTreeOpenTime: 22s225ms - PrepareTime: 42.555ms - ExecTreePrepareTime: 1.152ms DataStreamSender (dst_id=19):(Total: 16s809ms, non-child: 16s809ms, % non-child: 100.00%) - BytesSent: 2.29 GB (2456194862) - OverallThroughput: 139.35 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 16.83M (16832441) - SerializeBatchTime: 16s794ms - UncompressedRowBatchSize: 2.29 GB (2456194862) CodeGen:(Total: 507.829ms, non-child: 507.829ms, % non-child: 100.00%) - CodegenTime: 1.818ms - CompileTime: 156.460ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 323.917ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.921ms HASH_JOIN_NODE (id=9):(Total: 25s065ms, non-child: 2s489ms, % non-child: 9.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 267.575ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.83M (16832441) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s175ms - RowsReturned: 16.83M (16832441) - RowsReturnedRate: 671.54 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.243ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 468.123us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.614ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s947ms, non-child: 17.443ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.884ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.05 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.14 MB, 22.85 MB, 29.38 MB, 32.31 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s211ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s932ms - DataArrivalTimer: 21s930ms SenderSide: - DeserializeRowBatchTimer: 176.400ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s210ms, non-child: 520.338ms, % non-child: 9.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 511.222us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.83M (16832441) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 488.464ms - RowsReturned: 16.83M (16832441) - RowsReturnedRate: 3.23 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.322us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 124.146us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 69.390us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s238ms, non-child: 16.753us, % non-child: 0.00%) - ConvertRowBatchTime: 5.025us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 73.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s238ms - DataArrivalTimer: 1s238ms SenderSide: - DeserializeRowBatchTimer: 68.317us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s451ms, non-child: 3s451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:12/2.82 GB 0:7/1.73 GB 5:11/2.45 GB 7:23/5.47 GB 4:13/2.95 GB 6:16/3.90 GB 2:20/4.91 GB 3:22/5.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s311ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:121 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 105.06 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB, 140.07 MB - FooterProcessingTime: (Avg: 2.952ms ; Min: 2.229ms ; Max: 4.165ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 140.07 MB (146878874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.07 MB (146878874) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.07 MB (146878874) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 718.467ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.35 MB (185964668) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.362ms - RowBatchQueuePutWaitTime: 7m23s - RowsRead: 16.83M (16833653) - RowsReturned: 16.83M (16832441) - RowsReturnedRate: 4.88 M/sec - ScanRangesComplete: 124 (124) - ScannerThreadsInvoluntaryContextSwitches: 16.96K (16961) - ScannerThreadsTotalWallClockTime: 10m1s - MaterializeTupleTime(*): 2s575ms - ScannerThreadsSysTime: 2s115ms - ScannerThreadsUserTime: 2m32s - ScannerThreadsVoluntaryContextSwitches: 110.97K (110975) - TotalRawHdfsReadTime(*): 127.195ms - TotalReadThroughput: 922.42 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.36K (50364) - Rows rejected: 1.21K (1212) - Rows total: 16.83M (16833653) Filter 5 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 16.83M (16832441) Filter 6 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 16.83M (16832441) Filter 7 (2.00 MB): - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 16.83M (16832441) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.83M (16832441) Filter 9 (8.00 KB): - Files processed: 124 (124) - Files rejected: 121 (121) - Files total: 124 (124) - RowGroups processed: 16.44K (16437) - RowGroups rejected: 0 (0) - RowGroups total: 16.44K (16437) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.83M (16832441) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000f7 (host=foo.187.56:22000):(Total: 2m35s, non-child: 1m52s, % non-child: 72.08%) Hdfs split stats (:<# splits>/): 6:13/3.22 GB 3:18/3.83 GB 0:17/3.94 GB 4:20/4.71 GB 2:12/2.85 GB 7:13/3.14 GB 5:18/4.31 GB 1:17/4.21 GB Filter 0 arrival: 2s031ms Filter 9 arrival: 2s356ms Filter 8 arrival: 22s064ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.85 MB, 215.19 MB, 350.13 MB, 350.13 MB, 350.15 MB, 361.58 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.03 MB, 373.02 MB, 370.48 MB, 370.25 MB, 370.04 MB, 370.23 MB, 370.32 MB, 370.13 MB, 370.22 MB, 370.34 MB, 350.38 MB, 338.28 MB, 338.37 MB, 329.92 MB, 302.93 MB, 282.03 MB, 247.66 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 373.46 MB (391597569) - PerHostPeakMemUsage: 1.25 GB (1340240933) - RowsProduced: 18.75M (18748808) - TotalNetworkReceiveTime: 23s083ms - TotalNetworkSendTime: 1m38s - TotalStorageWaitTime: 168.119ms - TotalThreadsInvoluntaryContextSwitches: 7.72K (7718) - TotalThreadsTotalWallClockTime: 12m58s - TotalThreadsSysTime: 7s064ms - TotalThreadsUserTime: 54s708ms - TotalThreadsVoluntaryContextSwitches: 721.06K (721064) Fragment Instance Lifecycle Timings: - ExecTime: 2m13s - ExecTreeExecTime: 3s186ms - OpenTime: 22s072ms - ExecTreeOpenTime: 21s590ms - PrepareTime: 39.942ms - ExecTreePrepareTime: 1.714ms DataStreamSender (dst_id=19):(Total: 18s138ms, non-child: 18s138ms, % non-child: 100.00%) - BytesSent: 2.55 GB (2735617584) - OverallThroughput: 143.83 MB/sec - PeakMemoryUsage: 7.93 MB (8310816) - RowsReturned: 18.75M (18748808) - SerializeBatchTime: 18s122ms - UncompressedRowBatchSize: 2.55 GB (2735617584) CodeGen:(Total: 507.158ms, non-child: 507.158ms, % non-child: 100.00%) - CodegenTime: 1.785ms - CompileTime: 154.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 326.027ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.548ms HASH_JOIN_NODE (id=9):(Total: 24s763ms, non-child: 2s795ms, % non-child: 11.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.359ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 18.75M (18748808) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s428ms - RowsReturned: 18.75M (18748808) - RowsReturnedRate: 757.12 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.319ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 527.870us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.174ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s261ms, non-child: 21.901ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.224ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.73 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.30 MB, 23.06 MB, 29.39 MB, 32.40 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s189ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s247ms - DataArrivalTimer: 21s240ms SenderSide: - DeserializeRowBatchTimer: 217.636ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s281ms, non-child: 592.118ms, % non-child: 11.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 358.076us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 18.75M (18748808) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 555.501ms - RowsReturned: 18.75M (18748808) - RowsReturnedRate: 3.55 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.986us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.959us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.554us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s836ms, non-child: 14.146us, % non-child: 0.00%) - ConvertRowBatchTime: 3.325us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 49.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s836ms - DataArrivalTimer: 1s836ms SenderSide: - DeserializeRowBatchTimer: 22.656us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s853ms, non-child: 2s853ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:13/3.22 GB 3:18/3.83 GB 0:17/3.94 GB 4:20/4.71 GB 2:12/2.85 GB 7:13/3.14 GB 5:18/4.31 GB 1:17/4.21 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s713ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 119.78 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB, 159.70 MB - FooterProcessingTime: (Avg: 2.553ms ; Min: 1.818ms ; Max: 3.671ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.88 - BytesRead: 159.70 MB (167462624) - BytesReadDataNodeCache: 0 - BytesReadLocal: 159.70 MB (167462624) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 159.70 MB (167462624) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 829.137ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 211.15 MB (221403732) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.224ms - RowBatchQueuePutWaitTime: 9m30s - RowsRead: 18.75M (18750392) - RowsReturned: 18.75M (18748808) - RowsReturnedRate: 6.57 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 3.67K (3665) - ScannerThreadsTotalWallClockTime: 9m59s - MaterializeTupleTime(*): 2s897ms - ScannerThreadsSysTime: 5s843ms - ScannerThreadsUserTime: 20s551ms - ScannerThreadsVoluntaryContextSwitches: 705.08K (705081) - TotalRawHdfsReadTime(*): 140.361ms - TotalReadThroughput: 1.03 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.12K (67120) - Rows rejected: 1.58K (1584) - Rows total: 18.75M (18750392) Filter 5 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 18.75M (18748808) Filter 6 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 18.75M (18748808) Filter 7 (2.00 MB): - Rows processed: 13.31K (13312) - Rows rejected: 0 (0) - Rows total: 18.75M (18748808) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 18.75M (18748808) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 18.31K (18308) - RowGroups rejected: 0 (0) - RowGroups total: 18.31K (18308) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 18.75M (18748808) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000a1 (host=foo.234.46:22000):(Total: 2m34s, non-child: 1m51s, % non-child: 71.96%) Hdfs split stats (:<# splits>/): 4:14/3.36 GB 5:15/3.40 GB 3:10/2.28 GB 7:14/3.41 GB 2:20/4.63 GB 6:16/3.94 GB 0:18/4.40 GB 1:19/4.66 GB Filter 0 arrival: 176ms Filter 9 arrival: 545ms Filter 8 arrival: 18s543ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.20 MB, 263.42 MB, 363.65 MB, 363.63 MB, 369.63 MB, 383.35 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.30 MB, 383.43 MB, 383.58 MB, 383.74 MB, 383.73 MB, 383.67 MB, 383.61 MB, 383.79 MB, 366.87 MB, 351.81 MB, 351.86 MB, 351.76 MB, 351.79 MB, 351.70 MB, 314.28 MB, 288.50 MB, 288.56 MB ThreadUsage(4s000ms): 3, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 387.07 MB (405867196) - PerHostPeakMemUsage: 1.30 GB (1394424713) - RowsProduced: 20.53M (20527265) - TotalNetworkReceiveTime: 17s745ms - TotalNetworkSendTime: 1m35s - TotalStorageWaitTime: 179.358ms - TotalThreadsInvoluntaryContextSwitches: 7.21K (7214) - TotalThreadsTotalWallClockTime: 12m56s - TotalThreadsSysTime: 2s351ms - TotalThreadsUserTime: 54s722ms - TotalThreadsVoluntaryContextSwitches: 82.14K (82138) Fragment Instance Lifecycle Timings: - ExecTime: 2m15s - ExecTreeExecTime: 3s675ms - OpenTime: 18s548ms - ExecTreeOpenTime: 18s044ms - PrepareTime: 43.868ms - ExecTreePrepareTime: 1.606ms DataStreamSender (dst_id=19):(Total: 21s069ms, non-child: 21s069ms, % non-child: 100.00%) - BytesSent: 2.79 GB (2994988943) - OverallThroughput: 135.57 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 20.53M (20527265) - SerializeBatchTime: 21s050ms - UncompressedRowBatchSize: 2.79 GB (2994988943) CodeGen:(Total: 530.281ms, non-child: 530.281ms, % non-child: 100.00%) - CodegenTime: 1.697ms - CompileTime: 160.912ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 341.564ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.303ms HASH_JOIN_NODE (id=9):(Total: 21s704ms, non-child: 3s086ms, % non-child: 14.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 272.225ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 20.53M (20527265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s807ms - RowsReturned: 20.53M (20527265) - RowsReturnedRate: 945.75 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 226.583ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 484.603us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.460ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s759ms, non-child: 18.433ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.126ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 26.01 K/sec RecvrSide: BytesReceived(4s000ms): 326.50 KB, 11.87 MB, 27.26 MB, 30.84 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s307ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s744ms - DataArrivalTimer: 17s741ms SenderSide: - DeserializeRowBatchTimer: 176.521ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s374ms, non-child: 680.516ms, % non-child: 12.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 427.501us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.53M (20527265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 643.221ms - RowsReturned: 20.53M (20527265) - RowsReturnedRate: 3.82 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.364us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 126.827us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 71.118us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 13.036us, non-child: 13.036us, % non-child: 100.00%) - ConvertRowBatchTime: 4.821us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 6.98 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.605us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 189.730us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s693ms, non-child: 4s693ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:14/3.36 GB 5:15/3.40 GB 3:10/2.28 GB 7:14/3.41 GB 2:20/4.63 GB 6:16/3.94 GB 0:18/4.40 GB 1:19/4.66 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s518ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 112.24 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB, 179.59 MB - FooterProcessingTime: (Avg: 9.645ms ; Min: 2.066ms ; Max: 30.998ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 179.59 MB (188312727) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.59 MB (188312727) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.59 MB (188312727) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 927.788ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 224.65 MB (235565467) - PerReadThreadRawHdfsThroughput: 867.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.560ms - RowBatchQueuePutWaitTime: 9m37s - RowsRead: 20.53M (20528685) - RowsReturned: 20.53M (20527265) - RowsReturnedRate: 4.37 M/sec - ScanRangesComplete: 126 (126) - ScannerThreadsInvoluntaryContextSwitches: 2.40K (2398) - ScannerThreadsTotalWallClockTime: 10m4s - MaterializeTupleTime(*): 3s145ms - ScannerThreadsSysTime: 1s031ms - ScannerThreadsUserTime: 15s348ms - ScannerThreadsVoluntaryContextSwitches: 67.32K (67322) - TotalRawHdfsReadTime(*): 206.974ms - TotalReadThroughput: 1.17 MB/sec Filter 0 (8.00 KB): - Rows processed: 66.96K (66956) - Rows rejected: 1.42K (1420) - Rows total: 20.53M (20528685) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 20.53M (20527265) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 20.53M (20527265) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 20.53M (20527265) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 20.53M (20527265) Filter 9 (8.00 KB): - Files processed: 126 (126) - Files rejected: 122 (122) - Files total: 126 (126) - RowGroups processed: 20.04K (20044) - RowGroups rejected: 0 (0) - RowGroups total: 20.04K (20044) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.53M (20527265) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000c5 (host=foo.246.39:22000):(Total: 2m33s, non-child: 1m47s, % non-child: 70.16%) Hdfs split stats (:<# splits>/): 3:13/2.88 GB 6:12/2.72 GB 7:14/3.47 GB 2:16/3.96 GB 5:16/3.48 GB 4:20/4.68 GB 0:18/4.43 GB 1:19/4.51 GB Filter 0 arrival: 476ms Filter 9 arrival: 499ms Filter 8 arrival: 20s526ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 263.90 MB, 358.37 MB, 358.39 MB, 358.38 MB, 377.27 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.63 MB, 380.32 MB, 378.37 MB, 378.50 MB, 378.38 MB, 378.48 MB, 378.57 MB, 378.37 MB, 377.68 MB, 352.62 MB, 346.60 MB, 346.49 MB, 346.56 MB, 312.30 MB, 290.22 MB, 289.45 MB, 259.30 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.07 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 381.71 MB (400248879) - PerHostPeakMemUsage: 1.27 GB (1362652558) - RowsProduced: 20.44M (20438975) - TotalNetworkReceiveTime: 19s768ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 174.824ms - TotalThreadsInvoluntaryContextSwitches: 8.02K (8021) - TotalThreadsTotalWallClockTime: 12m57s - TotalThreadsSysTime: 2s980ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 177.97K (177972) Fragment Instance Lifecycle Timings: - ExecTime: 2m12s - ExecTreeExecTime: 3s680ms - OpenTime: 20s540ms - ExecTreeOpenTime: 20s078ms - PrepareTime: 41.238ms - ExecTreePrepareTime: 1.307ms DataStreamSender (dst_id=19):(Total: 21s526ms, non-child: 21s526ms, % non-child: 100.00%) - BytesSent: 2.78 GB (2982666357) - OverallThroughput: 132.14 MB/sec - PeakMemoryUsage: 7.93 MB (8310816) - RowsReturned: 20.44M (20438975) - SerializeBatchTime: 21s507ms - UncompressedRowBatchSize: 2.78 GB (2982666357) CodeGen:(Total: 485.511ms, non-child: 485.511ms, % non-child: 100.00%) - CodegenTime: 1.879ms - CompileTime: 138.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 321.825ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.649ms HASH_JOIN_NODE (id=9):(Total: 23s742ms, non-child: 3s113ms, % non-child: 13.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 282.361ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 20.44M (20438975) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s807ms - RowsReturned: 20.44M (20438975) - RowsReturnedRate: 860.87 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 230.735ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 783.201us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.541ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s782ms, non-child: 17.110ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.735ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.35 K/sec RecvrSide: BytesReceived(4s000ms): 158.95 KB, 10.70 MB, 26.94 MB, 30.70 MB, 32.78 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s642ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s768ms - DataArrivalTimer: 19s765ms SenderSide: - DeserializeRowBatchTimer: 182.227ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s423ms, non-child: 678.259ms, % non-child: 12.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 418.902us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.44M (20438975) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 638.154ms - RowsReturned: 20.44M (20438975) - RowsReturnedRate: 3.77 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.190us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 156.501us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 62.597us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 10.624us, non-child: 10.624us, % non-child: 100.00%) - ConvertRowBatchTime: 3.118us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 8.57 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.746us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 92.767us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s745ms, non-child: 4s745ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:13/2.88 GB 6:12/2.72 GB 7:14/3.47 GB 2:16/3.96 GB 5:16/3.48 GB 4:20/4.68 GB 0:18/4.43 GB 1:19/4.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s577ms Hdfs Read Thread Concurrency Bucket: 0:99.67% 1:0% 2:0.3289% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 122.13 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB, 174.21 MB - FooterProcessingTime: (Avg: 2.792ms ; Min: 2.348ms ; Max: 4.051ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 3.97 - BytesRead: 174.21 MB (182671119) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.21 MB (182671119) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.21 MB (182671119) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 902.940ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.40 MB (230055764) - PerReadThreadRawHdfsThroughput: 897.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.210ms - RowBatchQueuePutWaitTime: 9m25s - RowsRead: 20.44M (20440474) - RowsReturned: 20.44M (20438975) - RowsReturnedRate: 4.31 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 3.27K (3269) - ScannerThreadsTotalWallClockTime: 10m3s - MaterializeTupleTime(*): 3s212ms - ScannerThreadsSysTime: 1s570ms - ScannerThreadsUserTime: 22s154ms - ScannerThreadsVoluntaryContextSwitches: 162.78K (162775) - TotalRawHdfsReadTime(*): 194.081ms - TotalReadThroughput: 1.14 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.03K (67035) - Rows rejected: 1.50K (1499) - Rows total: 20.44M (20440474) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.44M (20438975) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.44M (20438975) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 20.44M (20438975) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 20.44M (20438975) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 19.96K (19959) - RowGroups rejected: 0 (0) - RowGroups total: 19.96K (19959) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.44M (20438975) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000010e (host=foo.246.50:22000):(Total: 2m33s, non-child: 1m48s, % non-child: 70.96%) Hdfs split stats (:<# splits>/): 2:18/4.22 GB 3:9/1.82 GB 0:21/4.89 GB 6:16/3.80 GB 7:11/2.72 GB 1:20/4.56 GB 5:20/4.87 GB 4:15/3.49 GB Filter 0 arrival: 282ms Filter 9 arrival: 630ms Filter 8 arrival: 19s874ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.20 MB, 293.23 MB, 365.96 MB, 365.95 MB, 365.95 MB, 387.93 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.94 MB, 387.08 MB, 386.11 MB, 385.92 MB, 385.95 MB, 386.02 MB, 386.07 MB, 385.83 MB, 382.91 MB, 354.15 MB, 354.17 MB, 354.21 MB, 354.08 MB, 338.30 MB, 313.95 MB, 288.88 MB, 285.80 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.04 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 389.37 MB (408279958) - PerHostPeakMemUsage: 1.25 GB (1346091482) - RowsProduced: 20.35M (20349511) - TotalNetworkReceiveTime: 18s982ms - TotalNetworkSendTime: 1m32s - TotalStorageWaitTime: 152.203ms - TotalThreadsInvoluntaryContextSwitches: 7.54K (7542) - TotalThreadsTotalWallClockTime: 12m49s - TotalThreadsSysTime: 1s866ms - TotalThreadsUserTime: 53s452ms - TotalThreadsVoluntaryContextSwitches: 49.02K (49024) Fragment Instance Lifecycle Timings: - ExecTime: 2m13s - ExecTreeExecTime: 3s739ms - OpenTime: 19s877ms - ExecTreeOpenTime: 19s288ms - PrepareTime: 45.223ms - ExecTreePrepareTime: 1.755ms DataStreamSender (dst_id=19):(Total: 20s855ms, non-child: 20s855ms, % non-child: 100.00%) - BytesSent: 2.77 GB (2973479752) - OverallThroughput: 135.97 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 20.35M (20349511) - SerializeBatchTime: 20s837ms - UncompressedRowBatchSize: 2.77 GB (2973479752) CodeGen:(Total: 615.473ms, non-child: 615.473ms, % non-child: 100.00%) - CodegenTime: 2.143ms - CompileTime: 178.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 407.529ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.361ms HASH_JOIN_NODE (id=9):(Total: 23s013ms, non-child: 3s137ms, % non-child: 13.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 279.112ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 20.35M (20349511) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s841ms - RowsReturned: 20.35M (20349511) - RowsReturnedRate: 884.25 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 234.273ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 443.886us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.824ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s997ms, non-child: 19.081ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.470ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 24.32 K/sec RecvrSide: BytesReceived(4s000ms): 363.27 KB, 12.20 MB, 27.43 MB, 30.90 MB, 32.81 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s356ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s982ms - DataArrivalTimer: 18s978ms SenderSide: - DeserializeRowBatchTimer: 180.886ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s302ms, non-child: 709.742ms, % non-child: 13.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 479.875us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 20.35M (20349511) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 669.115ms - RowsReturned: 20.35M (20349511) - RowsReturnedRate: 3.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 22.725us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 151.198us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.328us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.079us, non-child: 12.079us, % non-child: 100.00%) - ConvertRowBatchTime: 3.064us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.53 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.349us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 50.476us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s592ms, non-child: 4s592ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:18/4.22 GB 3:9/1.82 GB 0:21/4.89 GB 6:16/3.80 GB 7:11/2.72 GB 1:20/4.56 GB 5:20/4.87 GB 4:15/3.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s435ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 134.97 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB, 179.96 MB - FooterProcessingTime: (Avg: 2.356ms ; Min: 2.148ms ; Max: 2.479ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 179.96 MB (188696558) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.96 MB (188696558) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.96 MB (188696558) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 924.069ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 226.94 MB (237959965) - PerReadThreadRawHdfsThroughput: 793.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.122ms - RowBatchQueuePutWaitTime: 9m34s - RowsRead: 20.35M (20351073) - RowsReturned: 20.35M (20349511) - RowsReturnedRate: 4.43 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 2.62K (2616) - ScannerThreadsTotalWallClockTime: 9m57s - MaterializeTupleTime(*): 3s111ms - ScannerThreadsSysTime: 541.915ms - ScannerThreadsUserTime: 13s846ms - ScannerThreadsVoluntaryContextSwitches: 33.63K (33634) - TotalRawHdfsReadTime(*): 226.910ms - TotalReadThroughput: 1.18 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.10K (67098) - Rows rejected: 1.56K (1562) - Rows total: 20.35M (20351073) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 20.35M (20349511) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 20.35M (20349511) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 20.35M (20349511) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 20.35M (20349511) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 126 (126) - Files total: 130 (130) - RowGroups processed: 19.87K (19872) - RowGroups rejected: 0 (0) - RowGroups total: 19.87K (19872) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 20.35M (20349511) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000010f (host=foo.246.36:22000):(Total: 2m33s, non-child: 1m49s, % non-child: 71.30%) Hdfs split stats (:<# splits>/): 1:19/4.46 GB 5:14/3.36 GB 4:19/4.56 GB 6:18/4.43 GB 0:14/3.23 GB 3:14/3.44 GB 2:11/2.72 GB 7:18/4.25 GB Filter 0 arrival: 481ms Filter 9 arrival: 494ms Filter 8 arrival: 18s671ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 284.15 MB, 375.15 MB, 375.16 MB, 382.43 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.40 MB, 395.37 MB, 395.10 MB, 395.18 MB, 395.18 MB, 395.29 MB, 395.39 MB, 395.23 MB, 383.30 MB, 363.34 MB, 363.43 MB, 363.46 MB, 361.38 MB, 333.57 MB, 331.72 MB, 327.73 MB, 290.38 MB ThreadUsage(4s000ms): 4, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.07 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 398.47 MB (417827891) - PerHostPeakMemUsage: 1.28 GB (1373964388) - RowsProduced: 21.27M (21269971) - TotalNetworkReceiveTime: 17s932ms - TotalNetworkSendTime: 1m32s - TotalStorageWaitTime: 166.038ms - TotalThreadsInvoluntaryContextSwitches: 6.86K (6859) - TotalThreadsTotalWallClockTime: 12m54s - TotalThreadsSysTime: 2s599ms - TotalThreadsUserTime: 46s135ms - TotalThreadsVoluntaryContextSwitches: 124.78K (124778) Fragment Instance Lifecycle Timings: - ExecTime: 2m14s - ExecTreeExecTime: 3s612ms - OpenTime: 18s685ms - ExecTreeOpenTime: 18s230ms - PrepareTime: 42.487ms - ExecTreePrepareTime: 1.534ms DataStreamSender (dst_id=19):(Total: 21s605ms, non-child: 21s605ms, % non-child: 100.00%) - BytesSent: 2.90 GB (3108715959) - OverallThroughput: 137.22 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 21.27M (21269971) - SerializeBatchTime: 21s586ms - UncompressedRowBatchSize: 2.90 GB (3108715959) CodeGen:(Total: 480.208ms, non-child: 480.208ms, % non-child: 100.00%) - CodegenTime: 1.563ms - CompileTime: 137.068ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 315.640ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.050ms HASH_JOIN_NODE (id=9):(Total: 21s828ms, non-child: 2s992ms, % non-child: 13.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 271.247ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.27M (21269971) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s700ms - RowsReturned: 21.27M (21269971) - RowsReturnedRate: 974.43 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.302ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 493.461us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.105ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s946ms, non-child: 17.328ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.559ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.74 K/sec RecvrSide: BytesReceived(4s000ms): 242.75 KB, 11.11 MB, 27.11 MB, 30.82 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s659ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s932ms - DataArrivalTimer: 17s929ms SenderSide: - DeserializeRowBatchTimer: 289.369ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s463ms, non-child: 717.863ms, % non-child: 13.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 459.692us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.27M (21269971) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 677.040ms - RowsReturned: 21.27M (21269971) - RowsReturnedRate: 3.89 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.391us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 169.508us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.608us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.161us, non-child: 12.161us, % non-child: 100.00%) - ConvertRowBatchTime: 4.096us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.48 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.412us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 22.225us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s746ms, non-child: 4s746ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:19/4.46 GB 5:14/3.36 GB 4:19/4.56 GB 6:18/4.43 GB 0:14/3.23 GB 3:14/3.44 GB 2:11/2.72 GB 7:18/4.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s578ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 143.31 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB, 191.08 MB - FooterProcessingTime: (Avg: 3.287ms ; Min: 2.697ms ; Max: 4.906ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.99 - BytesRead: 191.08 MB (200362519) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.08 MB (200362519) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.08 MB (200362519) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 973.234ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 236.16 MB (247629926) - PerReadThreadRawHdfsThroughput: 897.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.032ms - RowBatchQueuePutWaitTime: 9m40s - RowsRead: 21.27M (21271603) - RowsReturned: 21.27M (21269971) - RowsReturnedRate: 4.48 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1683) - ScannerThreadsTotalWallClockTime: 10m3s - MaterializeTupleTime(*): 3s245ms - ScannerThreadsSysTime: 1s268ms - ScannerThreadsUserTime: 6s016ms - ScannerThreadsVoluntaryContextSwitches: 107.27K (107270) - TotalRawHdfsReadTime(*): 212.879ms - TotalReadThroughput: 1.26 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.17K (67168) - Rows rejected: 1.63K (1632) - Rows total: 21.27M (21271603) Filter 5 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 21.27M (21269971) Filter 6 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 21.27M (21269971) Filter 7 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 21.27M (21269971) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.27M (21269971) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 123 (123) - Files total: 127 (127) - RowGroups processed: 20.77K (20771) - RowGroups rejected: 0 (0) - RowGroups total: 20.77K (20771) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.27M (21269971) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000b1 (host=foo.246.41:22000):(Total: 2m32s, non-child: 1m45s, % non-child: 69.15%) Hdfs split stats (:<# splits>/): 4:7/1.50 GB 1:19/4.64 GB 0:16/3.72 GB 6:13/3.22 GB 7:13/3.12 GB 5:19/4.26 GB 3:23/5.50 GB 2:18/4.25 GB Filter 0 arrival: 432ms Filter 9 arrival: 580ms Filter 8 arrival: 20s472ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.20 MB, 300.87 MB, 376.14 MB, 376.13 MB, 376.14 MB, 395.42 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 398.17 MB, 397.40 MB, 396.15 MB, 396.09 MB, 396.23 MB, 396.13 MB, 396.16 MB, 396.18 MB, 376.22 MB, 364.31 MB, 364.43 MB, 364.28 MB, 356.28 MB, 333.51 MB, 329.33 MB, 324.41 MB, 244.70 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.00 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 399.44 MB (418838673) - PerHostPeakMemUsage: 1.27 GB (1368878773) - RowsProduced: 22.01M (22005235) - TotalNetworkReceiveTime: 19s646ms - TotalNetworkSendTime: 1m28s - TotalStorageWaitTime: 164.247ms - TotalThreadsInvoluntaryContextSwitches: 7.44K (7438) - TotalThreadsTotalWallClockTime: 12m46s - TotalThreadsSysTime: 3s748ms - TotalThreadsUserTime: 51s463ms - TotalThreadsVoluntaryContextSwitches: 249.14K (249143) Fragment Instance Lifecycle Timings: - ExecTime: 2m12s - ExecTreeExecTime: 4s010ms - OpenTime: 20s476ms - ExecTreeOpenTime: 19s938ms - PrepareTime: 45.624ms - ExecTreePrepareTime: 1.299ms DataStreamSender (dst_id=19):(Total: 22s674ms, non-child: 22s674ms, % non-child: 100.00%) - BytesSent: 2.99 GB (3213355148) - OverallThroughput: 135.15 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 22.01M (22005235) - SerializeBatchTime: 22s650ms - UncompressedRowBatchSize: 2.99 GB (3213355148) CodeGen:(Total: 566.326ms, non-child: 566.326ms, % non-child: 100.00%) - CodegenTime: 2.096ms - CompileTime: 173.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 362.591ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.832ms HASH_JOIN_NODE (id=9):(Total: 23s932ms, non-child: 3s280ms, % non-child: 13.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 267.303ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 22.01M (22005235) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s987ms - RowsReturned: 22.01M (22005235) - RowsReturnedRate: 919.48 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 219.931ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 454.807us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.453ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s660ms, non-child: 16.851ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.631ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.50 K/sec RecvrSide: BytesReceived(4s000ms): 308.15 KB, 11.72 MB, 27.24 MB, 30.87 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s523ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s645ms - DataArrivalTimer: 19s643ms SenderSide: - DeserializeRowBatchTimer: 191.819ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s486ms, non-child: 730.047ms, % non-child: 13.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 315.102us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 22.01M (22005235) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 690.518ms - RowsReturned: 22.01M (22005235) - RowsReturnedRate: 4.01 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.130us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 110.048us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.443us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 10.734us, non-child: 10.734us, % non-child: 100.00%) - ConvertRowBatchTime: 3.210us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 8.48 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.086us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 46.895us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s756ms, non-child: 4s756ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:7/1.50 GB 1:19/4.64 GB 0:16/3.72 GB 6:13/3.22 GB 7:13/3.12 GB 5:19/4.26 GB 3:23/5.50 GB 2:18/4.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s494ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 142.78 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB, 190.38 MB - FooterProcessingTime: (Avg: 2.806ms ; Min: 2.415ms ; Max: 3.536ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 190.38 MB (199627555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.38 MB (199627555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.38 MB (199627555) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 998.785ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 237.15 MB (248668091) - PerReadThreadRawHdfsThroughput: 939.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.748ms - RowBatchQueuePutWaitTime: 9m35s - RowsRead: 22.01M (22006838) - RowsReturned: 22.01M (22005235) - RowsReturnedRate: 4.63 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 2.23K (2232) - ScannerThreadsTotalWallClockTime: 9m53s - MaterializeTupleTime(*): 3s574ms - ScannerThreadsSysTime: 2s347ms - ScannerThreadsUserTime: 9s089ms - ScannerThreadsVoluntaryContextSwitches: 232.66K (232655) - TotalRawHdfsReadTime(*): 202.683ms - TotalReadThroughput: 1.25 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.14K (67139) - Rows rejected: 1.60K (1603) - Rows total: 22.01M (22006838) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 22.01M (22005235) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 22.01M (22005235) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 22.01M (22005235) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 22.01M (22005235) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 21.49K (21489) - RowGroups rejected: 0 (0) - RowGroups total: 21.49K (21489) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 22.01M (22005235) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000f4 (host=foo.234.50:22000):(Total: 2m31s, non-child: 1m45s, % non-child: 69.46%) Hdfs split stats (:<# splits>/): 1:11/2.60 GB 2:20/4.86 GB 3:13/3.13 GB 5:13/3.18 GB 0:15/3.52 GB 7:14/3.36 GB 4:21/4.94 GB 6:20/4.72 GB Filter 0 arrival: 602ms Filter 9 arrival: 1s351ms Filter 8 arrival: 20s636ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 272.82 MB, 360.07 MB, 360.08 MB, 360.07 MB, 379.61 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 382.41 MB, 381.88 MB, 380.07 MB, 380.15 MB, 380.20 MB, 380.07 MB, 380.15 MB, 379.99 MB, 370.26 MB, 348.28 MB, 348.39 MB, 348.30 MB, 346.37 MB, 322.30 MB, 292.60 MB, 289.12 MB ThreadUsage(4s000ms): 3, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 383.48 MB (402103098) - PerHostPeakMemUsage: 1.28 GB (1371316406) - RowsProduced: 21.08M (21081290) - TotalNetworkReceiveTime: 20s742ms - TotalNetworkSendTime: 1m29s - TotalStorageWaitTime: 121.570ms - TotalThreadsInvoluntaryContextSwitches: 7.83K (7835) - TotalThreadsTotalWallClockTime: 12m42s - TotalThreadsSysTime: 2s324ms - TotalThreadsUserTime: 55s571ms - TotalThreadsVoluntaryContextSwitches: 67.96K (67961) Fragment Instance Lifecycle Timings: - ExecTime: 2m11s - ExecTreeExecTime: 3s710ms - OpenTime: 20s646ms - ExecTreeOpenTime: 20s171ms - PrepareTime: 34.467ms - ExecTreePrepareTime: 811.927us DataStreamSender (dst_id=19):(Total: 21s961ms, non-child: 21s961ms, % non-child: 100.00%) - BytesSent: 2.87 GB (3077210445) - OverallThroughput: 133.63 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 21.08M (21081290) - SerializeBatchTime: 21s940ms - UncompressedRowBatchSize: 2.87 GB (3077210445) CodeGen:(Total: 495.848ms, non-child: 495.848ms, % non-child: 100.00%) - CodegenTime: 1.819ms - CompileTime: 155.083ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 319.270ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 21.026ms HASH_JOIN_NODE (id=9):(Total: 23s864ms, non-child: 3s093ms, % non-child: 12.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 246.461ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.08M (21081290) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s815ms - RowsReturned: 21.08M (21081290) - RowsReturnedRate: 883.39 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 204.246ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 542.691us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.271ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s912ms, non-child: 17.390ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.365ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.20 K/sec RecvrSide: BytesReceived(4s000ms): 186.57 KB, 10.91 MB, 26.90 MB, 30.67 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s768ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s898ms - DataArrivalTimer: 19s895ms SenderSide: - DeserializeRowBatchTimer: 177.157ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s417ms, non-child: 703.520ms, % non-child: 12.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 478.409us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.08M (21081290) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 663.273ms - RowsReturned: 21.08M (21081290) - RowsReturnedRate: 3.89 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.929us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 124.642us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.872us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 843.239ms, non-child: 14.339us, % non-child: 0.00%) - ConvertRowBatchTime: 4.032us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 107.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 843.228ms - DataArrivalTimer: 843.225ms SenderSide: - DeserializeRowBatchTimer: 62.450us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s870ms, non-child: 3s870ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:11/2.60 GB 2:20/4.86 GB 3:13/3.13 GB 5:13/3.18 GB 0:15/3.52 GB 7:14/3.36 GB 4:21/4.94 GB 6:20/4.72 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s717ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 132.17 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB, 176.23 MB - FooterProcessingTime: (Avg: 2.320ms ; Min: 1.951ms ; Max: 2.907ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 176.23 MB (184789995) - BytesReadDataNodeCache: 0 - BytesReadLocal: 176.23 MB (184789995) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 176.23 MB (184789995) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 899.208ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 221.14 MB (231880707) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.237ms - RowBatchQueuePutWaitTime: 9m26s - RowsRead: 21.08M (21082871) - RowsReturned: 21.08M (21081290) - RowsReturnedRate: 5.45 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.86K (2863) - ScannerThreadsTotalWallClockTime: 9m50s - MaterializeTupleTime(*): 3s232ms - ScannerThreadsSysTime: 942.855ms - ScannerThreadsUserTime: 15s239ms - ScannerThreadsVoluntaryContextSwitches: 53.06K (53062) - TotalRawHdfsReadTime(*): 170.506ms - TotalReadThroughput: 1.17 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.12K (67117) - Rows rejected: 1.58K (1581) - Rows total: 21.08M (21082871) Filter 5 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.08M (21081290) Filter 6 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.08M (21081290) Filter 7 (2.00 MB): - Rows processed: 29.70K (29696) - Rows rejected: 0 (0) - Rows total: 21.08M (21081290) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 21.08M (21081290) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 123 (123) - Files total: 127 (127) - RowGroups processed: 20.59K (20587) - RowGroups rejected: 0 (0) - RowGroups total: 20.59K (20587) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.08M (21081290) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000bd (host=foo.246.47:22000):(Total: 2m31s, non-child: 1m46s, % non-child: 70.42%) Hdfs split stats (:<# splits>/): 0:12/2.73 GB 7:18/4.42 GB 3:17/3.58 GB 1:12/2.97 GB 5:18/4.42 GB 6:19/4.66 GB 2:18/4.46 GB 4:14/3.20 GB Filter 0 arrival: 297ms Filter 9 arrival: 609ms Filter 8 arrival: 18s658ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.20 MB, 299.54 MB, 374.34 MB, 374.34 MB, 380.34 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.63 MB, 394.48 MB, 394.40 MB, 394.24 MB, 394.33 MB, 394.25 MB, 394.35 MB, 394.40 MB, 368.40 MB, 362.41 MB, 362.47 MB, 362.40 MB, 347.62 MB, 330.57 MB, 330.70 MB, 328.57 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.02 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 397.74 MB (417063964) - PerHostPeakMemUsage: 1.27 GB (1359123751) - RowsProduced: 21.72M (21719988) - TotalNetworkReceiveTime: 18s032ms - TotalNetworkSendTime: 1m30s - TotalStorageWaitTime: 169.791ms - TotalThreadsInvoluntaryContextSwitches: 7.10K (7104) - TotalThreadsTotalWallClockTime: 12m39s - TotalThreadsSysTime: 2s570ms - TotalThreadsUserTime: 47s513ms - TotalThreadsVoluntaryContextSwitches: 111.41K (111409) Fragment Instance Lifecycle Timings: - ExecTime: 2m12s - ExecTreeExecTime: 4s009ms - OpenTime: 18s675ms - ExecTreeOpenTime: 18s209ms - PrepareTime: 40.748ms - ExecTreePrepareTime: 867.438us DataStreamSender (dst_id=19):(Total: 22s091ms, non-child: 22s091ms, % non-child: 100.00%) - BytesSent: 2.96 GB (3178463186) - OverallThroughput: 137.21 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 21.72M (21719988) - SerializeBatchTime: 22s072ms - UncompressedRowBatchSize: 2.96 GB (3178463186) CodeGen:(Total: 486.236ms, non-child: 486.236ms, % non-child: 100.00%) - CodegenTime: 1.592ms - CompileTime: 148.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 316.215ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 20.577ms HASH_JOIN_NODE (id=9):(Total: 22s199ms, non-child: 3s334ms, % non-child: 15.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 263.242ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 21.72M (21719988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s054ms - RowsReturned: 21.72M (21719988) - RowsReturnedRate: 978.39 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.613ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 373.103us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.851ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s935ms, non-child: 16.837ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.399ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.76 K/sec RecvrSide: BytesReceived(4s000ms): 316.80 KB, 11.87 MB, 27.30 MB, 30.84 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s470ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s921ms - DataArrivalTimer: 17s918ms SenderSide: - DeserializeRowBatchTimer: 169.181ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s492ms, non-child: 759.169ms, % non-child: 13.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 371.834us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 21.72M (21719988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 720.453ms - RowsReturned: 21.72M (21719988) - RowsReturnedRate: 3.95 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.819us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 113.723us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.892us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 110.492ms, non-child: 11.240us, % non-child: 0.01%) - ConvertRowBatchTime: 3.492us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 823.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 110.483ms - DataArrivalTimer: 110.481ms SenderSide: - DeserializeRowBatchTimer: 15.539us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s623ms, non-child: 4s623ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:12/2.73 GB 7:18/4.42 GB 3:17/3.58 GB 1:12/2.97 GB 5:18/4.42 GB 6:19/4.66 GB 2:18/4.46 GB 4:14/3.20 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s457ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 143.13 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB, 190.84 MB - FooterProcessingTime: (Avg: 2.919ms ; Min: 1.721ms ; Max: 3.953ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 190.84 MB (200105742) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.84 MB (200105742) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.84 MB (200105742) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 980.309ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 235.28 MB (246712921) - PerReadThreadRawHdfsThroughput: 937.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.902ms - RowBatchQueuePutWaitTime: 9m33s - RowsRead: 21.72M (21721516) - RowsReturned: 21.72M (21719988) - RowsReturnedRate: 4.70 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 2.02K (2019) - ScannerThreadsTotalWallClockTime: 9m50s - MaterializeTupleTime(*): 3s294ms - ScannerThreadsSysTime: 1s304ms - ScannerThreadsUserTime: 5s854ms - ScannerThreadsVoluntaryContextSwitches: 94.73K (94733) - TotalRawHdfsReadTime(*): 203.488ms - TotalReadThroughput: 1.27 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.06K (67064) - Rows rejected: 1.53K (1528) - Rows total: 21.72M (21721516) Filter 5 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 21.72M (21719988) Filter 6 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 21.72M (21719988) Filter 7 (2.00 MB): - Rows processed: 25.60K (25600) - Rows rejected: 0 (0) - Rows total: 21.72M (21719988) Filter 8 (256.00 KB): - Rows processed: 35.84K (35840) - Rows rejected: 0 (0) - Rows total: 21.72M (21719988) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 124 (124) - Files total: 128 (128) - RowGroups processed: 21.21K (21211) - RowGroups rejected: 0 (0) - RowGroups total: 21.21K (21211) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 21.72M (21719988) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000f8 (host=foo.187.40:22000):(Total: 2m31s, non-child: 1m49s, % non-child: 72.32%) Hdfs split stats (:<# splits>/): 1:16/3.67 GB 5:19/4.50 GB 6:14/3.19 GB 0:15/3.31 GB 2:19/4.51 GB 3:16/3.47 GB 7:19/4.30 GB 4:16/3.51 GB Filter 0 arrival: 2s329ms Filter 9 arrival: 2s677ms Filter 8 arrival: 22s768ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 173.18 MB, 317.00 MB, 316.98 MB, 316.96 MB, 322.56 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 339.32 MB, 337.40 MB, 336.99 MB, 337.05 MB, 337.06 MB, 336.95 MB, 337.08 MB, 316.08 MB, 313.11 MB, 313.18 MB, 313.21 MB, 313.04 MB, 297.22 MB, 289.34 MB, 286.36 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.27 MB (356801713) - PerHostPeakMemUsage: 1.23 GB (1316349865) - RowsProduced: 16.28M (16276418) - TotalNetworkReceiveTime: 24s147ms - TotalNetworkSendTime: 1m36s - TotalStorageWaitTime: 90.524ms - TotalThreadsInvoluntaryContextSwitches: 4.96K (4959) - TotalThreadsTotalWallClockTime: 10m11s - TotalThreadsSysTime: 1s743ms - TotalThreadsUserTime: 34s727ms - TotalThreadsVoluntaryContextSwitches: 48.21K (48214) Fragment Instance Lifecycle Timings: - ExecTime: 2m8s - ExecTreeExecTime: 2s954ms - OpenTime: 22s775ms - ExecTreeOpenTime: 22s302ms - PrepareTime: 56.134ms - ExecTreePrepareTime: 1.983ms DataStreamSender (dst_id=19):(Total: 16s067ms, non-child: 16s067ms, % non-child: 100.00%) - BytesSent: 2.21 GB (2376785387) - OverallThroughput: 141.07 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 16.28M (16276418) - SerializeBatchTime: 16s053ms - UncompressedRowBatchSize: 2.21 GB (2376785387) CodeGen:(Total: 503.408ms, non-child: 503.408ms, % non-child: 100.00%) - CodegenTime: 3.368ms - CompileTime: 145.650ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 326.249ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.859ms HASH_JOIN_NODE (id=9):(Total: 25s245ms, non-child: 2s611ms, % non-child: 10.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 288.211ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.28M (16276418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s268ms - RowsReturned: 16.28M (16276418) - RowsReturnedRate: 644.74 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 236.822ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 741.629us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.501ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 22s002ms, non-child: 18.375ms, % non-child: 0.08%) - ConvertRowBatchTime: 13.262ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.00 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.24 MB, 21.60 MB, 29.07 MB, 32.20 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s490ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s987ms - DataArrivalTimer: 21s984ms SenderSide: - DeserializeRowBatchTimer: 251.430ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s213ms, non-child: 529.456ms, % non-child: 10.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 833.459us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.28M (16276418) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 498.627ms - RowsReturned: 16.28M (16276418) - RowsReturnedRate: 3.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.568us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 440.774us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.630us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s159ms, non-child: 15.711us, % non-child: 0.00%) - ConvertRowBatchTime: 3.969us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 42.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 146.016ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s159ms - DataArrivalTimer: 2s159ms SenderSide: - DeserializeRowBatchTimer: 67.343us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s525ms, non-child: 2s525ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:16/3.67 GB 5:19/4.50 GB 6:14/3.19 GB 0:15/3.31 GB 2:19/4.51 GB 3:16/3.47 GB 7:19/4.30 GB 4:16/3.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s389ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:131 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 107.32 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB - FooterProcessingTime: (Avg: 1.915ms ; Min: 1.349ms ; Max: 2.392ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.90 - BytesRead: 143.09 MB (150043222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.09 MB (150043222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.09 MB (150043222) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 722.698ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.96 MB (186602722) - PerReadThreadRawHdfsThroughput: 985.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.088ms - RowBatchQueuePutWaitTime: 7m11s - RowsRead: 16.28M (16277652) - RowsReturned: 16.28M (16276418) - RowsReturnedRate: 6.45 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1157) - ScannerThreadsTotalWallClockTime: 7m16s - MaterializeTupleTime(*): 2s469ms - ScannerThreadsSysTime: 514.919ms - ScannerThreadsUserTime: 4s134ms - ScannerThreadsVoluntaryContextSwitches: 35.49K (35495) - TotalRawHdfsReadTime(*): 145.214ms - TotalReadThroughput: 970.37 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.39K (50386) - Rows rejected: 1.23K (1234) - Rows total: 16.28M (16277652) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 16.28M (16276418) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 16.28M (16276418) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 16.28M (16276418) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.28M (16276418) Filter 9 (8.00 KB): - Files processed: 134 (134) - Files rejected: 131 (131) - Files total: 134 (134) - RowGroups processed: 15.89K (15894) - RowGroups rejected: 0 (0) - RowGroups total: 15.89K (15894) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.28M (16276418) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000109 (host=foo.234.52:22000):(Total: 2m29s, non-child: 1m48s, % non-child: 72.78%) Hdfs split stats (:<# splits>/): 1:10/2.48 GB 4:9/2.11 GB 5:17/4.16 GB 2:9/2.23 GB 3:21/4.67 GB 0:21/4.79 GB 7:14/3.37 GB 6:24/5.80 GB Filter 9 arrival: 531ms Filter 0 arrival: 579ms Filter 8 arrival: 21s002ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 240.58 MB, 317.04 MB, 317.04 MB, 317.04 MB, 332.39 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 337.50 MB, 338.23 MB, 337.15 MB, 337.06 MB, 337.03 MB, 336.98 MB, 337.10 MB, 336.20 MB, 313.16 MB, 313.15 MB, 313.26 MB, 313.09 MB, 308.17 MB, 289.19 MB, 289.21 MB, 276.79 MB ThreadUsage(4s000ms): 4, 6, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.15 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.41 MB (356950085) - PerHostPeakMemUsage: 1.22 GB (1314367736) - RowsProduced: 16.21M (16205983) - TotalNetworkReceiveTime: 20s223ms - TotalNetworkSendTime: 1m35s - TotalStorageWaitTime: 94.344ms - TotalThreadsInvoluntaryContextSwitches: 6.21K (6209) - TotalThreadsTotalWallClockTime: 10m19s - TotalThreadsSysTime: 1s718ms - TotalThreadsUserTime: 41s916ms - TotalThreadsVoluntaryContextSwitches: 55.20K (55204) Fragment Instance Lifecycle Timings: - ExecTime: 2m8s - ExecTreeExecTime: 3s014ms - OpenTime: 21s012ms - ExecTreeOpenTime: 20s523ms - PrepareTime: 43.286ms - ExecTreePrepareTime: 1.070ms DataStreamSender (dst_id=19):(Total: 16s695ms, non-child: 16s695ms, % non-child: 100.00%) - BytesSent: 2.20 GB (2358092968) - OverallThroughput: 134.70 MB/sec - PeakMemoryUsage: 7.98 MB (8368160) - RowsReturned: 16.21M (16205983) - SerializeBatchTime: 16s680ms - UncompressedRowBatchSize: 2.20 GB (2358092968) CodeGen:(Total: 518.019ms, non-child: 518.019ms, % non-child: 100.00%) - CodegenTime: 1.754ms - CompileTime: 151.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 337.774ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.676ms HASH_JOIN_NODE (id=9):(Total: 23s524ms, non-child: 2s567ms, % non-child: 10.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.651ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.03 MB (161515264) - ProbeRows: 16.21M (16205983) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s277ms - RowsReturned: 16.21M (16205983) - RowsReturnedRate: 688.89 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.769ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 491.934us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.872ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s238ms, non-child: 19.065ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.746ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.83 K/sec RecvrSide: BytesReceived(4s000ms): 195.90 KB, 10.90 MB, 26.91 MB, 30.67 MB, 32.75 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s716ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s223ms - DataArrivalTimer: 20s219ms SenderSide: - DeserializeRowBatchTimer: 279.485ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s258ms, non-child: 590.873ms, % non-child: 11.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 401.271us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.21M (16205983) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 559.590ms - RowsReturned: 16.21M (16205983) - RowsReturnedRate: 3.08 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 18.583us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 121.161us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.912us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.289us, non-child: 12.289us, % non-child: 100.00%) - ConvertRowBatchTime: 4.266us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.40 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.134us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 38.325us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s667ms, non-child: 4s667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:10/2.48 GB 4:9/2.11 GB 5:17/4.16 GB 2:9/2.23 GB 3:21/4.67 GB 0:21/4.79 GB 7:14/3.37 GB 6:24/5.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s535ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 107.66 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB, 143.54 MB - FooterProcessingTime: (Avg: 2.374ms ; Min: 1.858ms ; Max: 2.727ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.03 - BytesRead: 143.54 MB (150513673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.54 MB (150513673) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.54 MB (150513673) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 734.766ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.02 MB (186667763) - PerReadThreadRawHdfsThroughput: 914.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.990ms - RowBatchQueuePutWaitTime: 7m5s - RowsRead: 16.21M (16207149) - RowsReturned: 16.21M (16205983) - RowsReturnedRate: 3.47 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 2.07K (2069) - ScannerThreadsTotalWallClockTime: 7m29s - MaterializeTupleTime(*): 2s502ms - ScannerThreadsSysTime: 601.906ms - ScannerThreadsUserTime: 10s109ms - ScannerThreadsVoluntaryContextSwitches: 41.83K (41830) - TotalRawHdfsReadTime(*): 156.939ms - TotalReadThroughput: 986.48 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.32K (50318) - Rows rejected: 1.17K (1166) - Rows total: 16.21M (16207149) Filter 5 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.21M (16205983) Filter 6 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.21M (16205983) Filter 7 (2.00 MB): - Rows processed: 33.79K (33792) - Rows rejected: 0 (0) - Rows total: 16.21M (16205983) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.21M (16205983) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 122 (122) - Files total: 125 (125) - RowGroups processed: 15.82K (15825) - RowGroups rejected: 0 (0) - RowGroups total: 15.82K (15825) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.21M (16205983) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000f5 (host=foo.187.44:22000):(Total: 2m29s, non-child: 1m47s, % non-child: 71.92%) Hdfs split stats (:<# splits>/): 0:12/2.90 GB 7:21/4.90 GB 4:17/4.17 GB 5:17/4.15 GB 6:16/3.91 GB 1:11/2.68 GB 2:19/4.71 GB 3:12/2.97 GB Filter 9 arrival: 2s207ms Filter 0 arrival: 2s361ms Filter 8 arrival: 23s011ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 190.84 MB, 317.94 MB, 317.91 MB, 317.90 MB, 323.33 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.59 MB, 339.65 MB, 338.18 MB, 337.88 MB, 337.85 MB, 337.95 MB, 337.90 MB, 337.07 MB, 316.10 MB, 314.05 MB, 314.07 MB, 314.06 MB, 314.31 MB, 290.31 MB, 285.21 MB, 277.95 MB ThreadUsage(4s000ms): 2, 4, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 341.37 MB (357957441) - PerHostPeakMemUsage: 1.23 GB (1322678236) - RowsProduced: 16.20M (16202350) - TotalNetworkReceiveTime: 23s890ms - TotalNetworkSendTime: 1m35s - TotalStorageWaitTime: 100.607ms - TotalThreadsInvoluntaryContextSwitches: 4.91K (4908) - TotalThreadsTotalWallClockTime: 10m5s - TotalThreadsSysTime: 1s519ms - TotalThreadsUserTime: 35s112ms - TotalThreadsVoluntaryContextSwitches: 33.18K (33178) Fragment Instance Lifecycle Timings: - ExecTime: 2m6s - ExecTreeExecTime: 2s886ms - OpenTime: 23s019ms - ExecTreeOpenTime: 22s521ms - PrepareTime: 44.227ms - ExecTreePrepareTime: 1.142ms DataStreamSender (dst_id=19):(Total: 16s057ms, non-child: 16s057ms, % non-child: 100.00%) - BytesSent: 2.19 GB (2353799816) - OverallThroughput: 139.79 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 16.20M (16202350) - SerializeBatchTime: 16s044ms - UncompressedRowBatchSize: 2.19 GB (2353799816) CodeGen:(Total: 523.454ms, non-child: 523.454ms, % non-child: 100.00%) - CodegenTime: 1.704ms - CompileTime: 149.227ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 347.403ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 26.337ms HASH_JOIN_NODE (id=9):(Total: 25s396ms, non-child: 2s523ms, % non-child: 9.94%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 276.301ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.20M (16202350) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s198ms - RowsReturned: 16.20M (16202350) - RowsReturnedRate: 637.97 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 228.034ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 401.452us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.230ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 22s233ms, non-child: 17.297ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.823ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 20.78 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.62 MB, 22.39 MB, 29.21 MB, 32.29 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s520ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 22s219ms - DataArrivalTimer: 22s216ms SenderSide: - DeserializeRowBatchTimer: 276.969ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s216ms, non-child: 537.969ms, % non-child: 10.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 858.603us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.20M (16202350) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 508.193ms - RowsReturned: 16.20M (16202350) - RowsReturnedRate: 3.11 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 47.038us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 206.669us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 78.159us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s670ms, non-child: 15.945us, % non-child: 0.00%) - ConvertRowBatchTime: 5.072us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 54.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 162.073ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s670ms - DataArrivalTimer: 1s670ms SenderSide: - DeserializeRowBatchTimer: 51.763us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s007ms, non-child: 3s007ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:12/2.90 GB 7:21/4.90 GB 4:17/4.17 GB 5:17/4.15 GB 6:16/3.91 GB 1:11/2.68 GB 2:19/4.71 GB 3:12/2.97 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 2s870ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 107.91 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB, 143.88 MB - FooterProcessingTime: (Avg: 3.981ms ; Min: 2.137ms ; Max: 6.661ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 143.88 MB (150866926) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.88 MB (150866926) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.88 MB (150866926) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 729.609ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.89 MB (187582112) - PerReadThreadRawHdfsThroughput: 905.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.348ms - RowBatchQueuePutWaitTime: 7m7s - RowsRead: 16.20M (16203473) - RowsReturned: 16.20M (16202350) - RowsReturnedRate: 5.39 M/sec - ScanRangesComplete: 125 (125) - ScannerThreadsInvoluntaryContextSwitches: 1.10K (1099) - ScannerThreadsTotalWallClockTime: 7m11s - MaterializeTupleTime(*): 2s460ms - ScannerThreadsSysTime: 402.938ms - ScannerThreadsUserTime: 4s560ms - ScannerThreadsVoluntaryContextSwitches: 19.47K (19466) - TotalRawHdfsReadTime(*): 158.856ms - TotalReadThroughput: 988.80 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.27K (50275) - Rows rejected: 1.12K (1123) - Rows total: 16.20M (16203473) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.20M (16202350) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.20M (16202350) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.20M (16202350) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 16.20M (16202350) Filter 9 (8.00 KB): - Files processed: 125 (125) - Files rejected: 122 (122) - Files total: 125 (125) - RowGroups processed: 15.82K (15822) - RowGroups rejected: 0 (0) - RowGroups total: 15.82K (15822) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.20M (16202350) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000c1 (host=foo.187.51:22000):(Total: 2m29s, non-child: 1m49s, % non-child: 73.24%) Hdfs split stats (:<# splits>/): 3:24/5.92 GB 5:11/2.54 GB 4:15/3.44 GB 0:13/3.22 GB 6:16/3.80 GB 1:16/3.74 GB 2:16/3.83 GB 7:17/4.00 GB Filter 9 arrival: 1s975ms Filter 0 arrival: 2s135ms Filter 8 arrival: 21s369ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 189.89 MB, 316.58 MB, 316.58 MB, 316.58 MB, 329.90 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.62 MB, 337.35 MB, 336.33 MB, 336.63 MB, 336.67 MB, 336.56 MB, 336.67 MB, 330.72 MB, 312.84 MB, 312.79 MB, 312.88 MB, 312.80 MB, 311.71 MB, 288.68 MB, 288.73 MB, 285.80 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.04 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.02 MB (356531738) - PerHostPeakMemUsage: 1.23 GB (1324771929) - RowsProduced: 16.29M (16288141) - TotalNetworkReceiveTime: 22s124ms - TotalNetworkSendTime: 1m37s - TotalStorageWaitTime: 100.379ms - TotalThreadsInvoluntaryContextSwitches: 20.17K (20167) - TotalThreadsTotalWallClockTime: 12m32s - TotalThreadsSysTime: 2s206ms - TotalThreadsUserTime: 2m56s - TotalThreadsVoluntaryContextSwitches: 56.65K (56654) Fragment Instance Lifecycle Timings: - ExecTime: 2m7s - ExecTreeExecTime: 2s702ms - OpenTime: 21s383ms - ExecTreeOpenTime: 20s934ms - PrepareTime: 41.262ms - ExecTreePrepareTime: 949.259us DataStreamSender (dst_id=19):(Total: 15s809ms, non-child: 15s809ms, % non-child: 100.00%) - BytesSent: 2.21 GB (2377057779) - OverallThroughput: 143.39 MB/sec - PeakMemoryUsage: 8.04 MB (8425504) - RowsReturned: 16.29M (16288141) - SerializeBatchTime: 15s795ms - UncompressedRowBatchSize: 2.21 GB (2377057779) CodeGen:(Total: 470.119ms, non-child: 470.119ms, % non-child: 100.00%) - CodegenTime: 2.005ms - CompileTime: 141.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 307.204ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 21.334ms HASH_JOIN_NODE (id=9):(Total: 23s624ms, non-child: 2s313ms, % non-child: 9.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 276.547ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 16.29M (16288141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s987ms - RowsReturned: 16.29M (16288141) - RowsReturnedRate: 689.45 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 228.782ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 827.718us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.890ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s646ms, non-child: 17.559ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.162ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.38 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.96 MB, 22.66 MB, 29.33 MB, 32.33 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s332ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s631ms - DataArrivalTimer: 20s628ms SenderSide: - DeserializeRowBatchTimer: 172.593ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s286ms, non-child: 563.582ms, % non-child: 10.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 627.465us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.29M (16288141) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 529.745ms - RowsReturned: 16.29M (16288141) - RowsReturnedRate: 3.08 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.466us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 318.560us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.542us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s492ms, non-child: 14.994us, % non-child: 0.00%) - ConvertRowBatchTime: 5.580us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 60.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s492ms - DataArrivalTimer: 1s492ms SenderSide: - DeserializeRowBatchTimer: 89.025us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s230ms, non-child: 3s230ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:24/5.92 GB 5:11/2.54 GB 4:15/3.44 GB 0:13/3.22 GB 6:16/3.80 GB 1:16/3.74 GB 2:16/3.83 GB 7:17/4.00 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s093ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.82 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB, 142.43 MB - FooterProcessingTime: (Avg: 2.471ms ; Min: 2.313ms ; Max: 2.714ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 142.43 MB (149345308) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.43 MB (149345308) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.43 MB (149345308) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 741.913ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 177.57 MB (186199495) - PerReadThreadRawHdfsThroughput: 951.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.155ms - RowBatchQueuePutWaitTime: 7m6s - RowsRead: 16.29M (16289283) - RowsReturned: 16.29M (16288141) - RowsReturnedRate: 5.04 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 16.55K (16545) - ScannerThreadsTotalWallClockTime: 9m40s - MaterializeTupleTime(*): 2s463ms - ScannerThreadsSysTime: 1s197ms - ScannerThreadsUserTime: 2m26s - ScannerThreadsVoluntaryContextSwitches: 44.30K (44302) - TotalRawHdfsReadTime(*): 149.655ms - TotalReadThroughput: 978.83 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.29K (50294) - Rows rejected: 1.14K (1142) - Rows total: 16.29M (16289283) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.29M (16288141) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.29M (16288141) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 16.29M (16288141) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.29M (16288141) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 125 (125) - Files total: 128 (128) - RowGroups processed: 15.91K (15906) - RowGroups rejected: 0 (0) - RowGroups total: 15.91K (15906) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.29M (16288141) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000e0 (host=foo.187.47:22000):(Total: 2m28s, non-child: 1m48s, % non-child: 72.85%) Hdfs split stats (:<# splits>/): 2:13/3.22 GB 3:14/3.47 GB 0:19/4.28 GB 1:19/4.55 GB 5:10/2.48 GB 4:22/5.06 GB 6:9/2.23 GB 7:21/5.08 GB Filter 0 arrival: 2s389ms Filter 9 arrival: 3s142ms Filter 8 arrival: 22s437ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.39 MB, 141.33 MB, 301.95 MB, 301.94 MB, 301.94 MB, 309.52 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.53 MB, 323.56 MB, 322.68 MB, 321.98 MB, 321.96 MB, 321.92 MB, 322.13 MB, 321.80 MB, 317.00 MB, 304.11 MB, 298.18 MB, 298.13 MB, 298.07 MB, 290.11 MB, 263.64 MB, 235.61 MB ThreadUsage(4s000ms): 2, 3, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 325.31 MB (341113048) - PerHostPeakMemUsage: 1.20 GB (1292731409) - RowsProduced: 15.16M (15160232) - TotalNetworkReceiveTime: 24s210ms - TotalNetworkSendTime: 1m37s - TotalStorageWaitTime: 106.219ms - TotalThreadsInvoluntaryContextSwitches: 5.86K (5860) - TotalThreadsTotalWallClockTime: 10m4s - TotalThreadsSysTime: 1s842ms - TotalThreadsUserTime: 40s571ms - TotalThreadsVoluntaryContextSwitches: 80.48K (80483) Fragment Instance Lifecycle Timings: - ExecTime: 2m6s - ExecTreeExecTime: 2s695ms - OpenTime: 22s428ms - ExecTreeOpenTime: 21s954ms - PrepareTime: 55.534ms - ExecTreePrepareTime: 1.624ms DataStreamSender (dst_id=19):(Total: 15s310ms, non-child: 15s310ms, % non-child: 100.00%) - BytesSent: 2.06 GB (2207619347) - OverallThroughput: 137.51 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 15.16M (15160232) - SerializeBatchTime: 15s297ms - UncompressedRowBatchSize: 2.06 GB (2207619347) CodeGen:(Total: 506.535ms, non-child: 506.535ms, % non-child: 100.00%) - CodegenTime: 1.792ms - CompileTime: 152.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 318.706ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 34.285ms HASH_JOIN_NODE (id=9):(Total: 24s639ms, non-child: 2s456ms, % non-child: 9.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 273.504ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.16M (15160232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s070ms - RowsReturned: 15.16M (15160232) - RowsReturnedRate: 615.29 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.877ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 722.925us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.588ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s605ms, non-child: 18.496ms, % non-child: 0.09%) - ConvertRowBatchTime: 14.026ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.38 K/sec RecvrSide: BytesReceived(4s000ms): 0, 2.69 MB, 20.78 MB, 28.96 MB, 32.07 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s546ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s589ms - DataArrivalTimer: 21s587ms SenderSide: - DeserializeRowBatchTimer: 213.761ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s157ms, non-child: 485.181ms, % non-child: 9.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 510.423us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.16M (15160232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 455.344ms - RowsReturned: 15.16M (15160232) - RowsReturnedRate: 2.94 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 41.129us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 122.895us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.552us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 2s620ms, non-child: 13.939us, % non-child: 0.00%) - ConvertRowBatchTime: 2.987us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 34.00 /sec RecvrSide: BytesReceived(4s000ms): 875.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 200.264ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2s620ms - DataArrivalTimer: 2s620ms SenderSide: - DeserializeRowBatchTimer: 69.377us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s051ms, non-child: 2s051ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:13/3.22 GB 3:14/3.47 GB 0:19/4.28 GB 1:19/4.55 GB 5:10/2.48 GB 4:22/5.06 GB 6:9/2.23 GB 7:21/5.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 1s927ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 81.62 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB, 130.59 MB - FooterProcessingTime: (Avg: 2.596ms ; Min: 2.056ms ; Max: 3.646ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 130.59 MB (136937246) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.59 MB (136937246) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.59 MB (136937246) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 682.399ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 162.94 MB (170860211) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.249ms - RowBatchQueuePutWaitTime: 6m58s - RowsRead: 15.16M (15161456) - RowsReturned: 15.16M (15160232) - RowsReturnedRate: 7.39 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.38K (2382) - ScannerThreadsTotalWallClockTime: 7m10s - MaterializeTupleTime(*): 2s436ms - ScannerThreadsSysTime: 771.881ms - ScannerThreadsUserTime: 11s626ms - ScannerThreadsVoluntaryContextSwitches: 67.39K (67390) - TotalRawHdfsReadTime(*): 116.880ms - TotalReadThroughput: 897.50 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.38K (50376) - Rows rejected: 1.22K (1224) - Rows total: 15.16M (15161456) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.16M (15160232) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.16M (15160232) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 15.16M (15160232) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.16M (15160232) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 14.80K (14805) - RowGroups rejected: 0 (0) - RowGroups total: 14.80K (14805) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.16M (15160232) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000d5 (host=foo.246.52:22000):(Total: 2m27s, non-child: 1m42s, % non-child: 69.65%) Hdfs split stats (:<# splits>/): 5:14/3.47 GB 4:8/1.98 GB 7:16/3.79 GB 1:16/3.96 GB 0:22/5.10 GB 6:15/3.71 GB 3:13/3.00 GB 2:23/5.28 GB Filter 0 arrival: 270ms Filter 9 arrival: 536ms Filter 8 arrival: 20s788ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.21 MB, 288.41 MB, 359.53 MB, 359.52 MB, 359.53 MB, 376.12 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.85 MB, 380.29 MB, 379.49 MB, 379.66 MB, 379.62 MB, 379.74 MB, 379.56 MB, 379.59 MB, 364.67 MB, 347.83 MB, 347.65 MB, 347.68 MB, 309.61 MB, 288.62 MB, 282.61 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.03 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 382.93 MB (401535059) - PerHostPeakMemUsage: 1.23 GB (1318272346) - RowsProduced: 19.22M (19218969) - TotalNetworkReceiveTime: 20s008ms - TotalNetworkSendTime: 1m27s - TotalStorageWaitTime: 145.321ms - TotalThreadsInvoluntaryContextSwitches: 7.39K (7392) - TotalThreadsTotalWallClockTime: 12m21s - TotalThreadsSysTime: 2s620ms - TotalThreadsUserTime: 57s712ms - TotalThreadsVoluntaryContextSwitches: 135.36K (135361) Fragment Instance Lifecycle Timings: - ExecTime: 2m6s - ExecTreeExecTime: 3s627ms - OpenTime: 20s792ms - ExecTreeOpenTime: 20s296ms - PrepareTime: 42.631ms - ExecTreePrepareTime: 1.236ms DataStreamSender (dst_id=19):(Total: 20s365ms, non-child: 20s365ms, % non-child: 100.00%) - BytesSent: 2.62 GB (2808148868) - OverallThroughput: 131.50 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 19.22M (19218969) - SerializeBatchTime: 20s348ms - UncompressedRowBatchSize: 2.62 GB (2808148868) CodeGen:(Total: 522.749ms, non-child: 522.749ms, % non-child: 100.00%) - CodegenTime: 1.690ms - CompileTime: 162.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.429ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.522ms HASH_JOIN_NODE (id=9):(Total: 23s908ms, non-child: 3s024ms, % non-child: 12.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.907ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 19.22M (19218969) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s746ms - RowsReturned: 19.22M (19218969) - RowsReturnedRate: 803.87 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.683ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 610.948us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.288ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s022ms, non-child: 17.215ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.402ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.07 K/sec RecvrSide: BytesReceived(4s000ms): 419.92 KB, 12.63 MB, 27.47 MB, 30.99 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s406ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s008ms - DataArrivalTimer: 20s005ms SenderSide: - DeserializeRowBatchTimer: 180.561ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s383ms, non-child: 696.111ms, % non-child: 12.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 684.065us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 19.22M (19218969) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 657.145ms - RowsReturned: 19.22M (19218969) - RowsReturnedRate: 3.57 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 17.230us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 233.128us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.734us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.562us, non-child: 12.562us, % non-child: 100.00%) - ConvertRowBatchTime: 3.375us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.24 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 3.137us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 82.207us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s687ms, non-child: 4s687ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/3.47 GB 4:8/1.98 GB 7:16/3.79 GB 1:16/3.96 GB 0:22/5.10 GB 6:15/3.71 GB 3:13/3.00 GB 2:23/5.28 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s535ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:123 PARQUET/SNAPPY:20 BytesRead(4s000ms): 0, 130.44 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB, 173.92 MB - FooterProcessingTime: (Avg: 2.538ms ; Min: 2.155ms ; Max: 3.358ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 173.92 MB (182364393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.92 MB (182364393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.92 MB (182364393) - CachedFileHandlesHitCount: 34 (34) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 894.789ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 220.53 MB (231247131) - PerReadThreadRawHdfsThroughput: 905.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.139ms - RowBatchQueuePutWaitTime: 9m5s - RowsRead: 19.22M (19220517) - RowsReturned: 19.22M (19218969) - RowsReturnedRate: 4.10 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.77K (2775) - ScannerThreadsTotalWallClockTime: 9m34s - MaterializeTupleTime(*): 2s972ms - ScannerThreadsSysTime: 1s309ms - ScannerThreadsUserTime: 19s765ms - ScannerThreadsVoluntaryContextSwitches: 121.54K (121539) - TotalRawHdfsReadTime(*): 192.089ms - TotalReadThroughput: 1.19 MB/sec Filter 0 (8.00 KB): - Rows processed: 67.08K (67084) - Rows rejected: 1.55K (1548) - Rows total: 19.22M (19220517) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 19.22M (19218969) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 19.22M (19218969) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 19.22M (19218969) Filter 8 (256.00 KB): - Rows processed: 52.22K (52224) - Rows rejected: 0 (0) - Rows total: 19.22M (19218969) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 123 (123) - Files total: 127 (127) - RowGroups processed: 18.77K (18768) - RowGroups rejected: 0 (0) - RowGroups total: 18.77K (18768) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 19.22M (19218969) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce18000000c4 (host=foo.234.38:22000):(Total: 2m26s, non-child: 1m46s, % non-child: 72.61%) Hdfs split stats (:<# splits>/): 7:17/4.04 GB 3:8/1.79 GB 0:22/5.27 GB 4:21/4.95 GB 1:11/2.72 GB 5:14/3.43 GB 2:18/4.46 GB 6:16/3.60 GB Filter 0 arrival: 713ms Filter 9 arrival: 1s460ms Filter 8 arrival: 21s134ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.03 MB, 239.64 MB, 315.86 MB, 315.83 MB, 315.84 MB, 332.55 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 338.12 MB, 337.49 MB, 335.87 MB, 335.79 MB, 335.88 MB, 335.89 MB, 335.90 MB, 327.92 MB, 311.94 MB, 311.91 MB, 311.88 MB, 311.80 MB, 302.07 MB, 288.12 MB, 257.33 MB ThreadUsage(4s000ms): 3, 6, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.13 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 339.21 MB (355689919) - PerHostPeakMemUsage: 1.21 GB (1303756669) - RowsProduced: 15.61M (15611765) - TotalNetworkReceiveTime: 21s238ms - TotalNetworkSendTime: 1m34s - TotalStorageWaitTime: 115.582ms - TotalThreadsInvoluntaryContextSwitches: 5.91K (5911) - TotalThreadsTotalWallClockTime: 10m5s - TotalThreadsSysTime: 1s474ms - TotalThreadsUserTime: 43s307ms - TotalThreadsVoluntaryContextSwitches: 31.83K (31831) Fragment Instance Lifecycle Timings: - ExecTime: 2m5s - ExecTreeExecTime: 2s688ms - OpenTime: 21s140ms - ExecTreeOpenTime: 20s624ms - PrepareTime: 45.622ms - ExecTreePrepareTime: 2.208ms DataStreamSender (dst_id=19):(Total: 16s354ms, non-child: 16s354ms, % non-child: 100.00%) - BytesSent: 2.12 GB (2275290709) - OverallThroughput: 132.68 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 15.61M (15611765) - SerializeBatchTime: 16s340ms - UncompressedRowBatchSize: 2.12 GB (2275290709) CodeGen:(Total: 542.825ms, non-child: 542.825ms, % non-child: 100.00%) - CodegenTime: 2.460ms - CompileTime: 178.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 335.569ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.307ms HASH_JOIN_NODE (id=9):(Total: 23s303ms, non-child: 2s310ms, % non-child: 9.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 261.861ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.61M (15611765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s030ms - RowsReturned: 15.61M (15611765) - RowsReturnedRate: 669.93 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 211.773ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 472.906us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.103ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s351ms, non-child: 17.461ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.452ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.70 K/sec RecvrSide: BytesReceived(4s000ms): 158.95 KB, 10.73 MB, 26.84 MB, 30.71 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s828ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s337ms - DataArrivalTimer: 20s334ms SenderSide: - DeserializeRowBatchTimer: 166.972ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s164ms, non-child: 521.120ms, % non-child: 10.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 743.211us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.61M (15611765) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 491.323ms - RowsReturned: 15.61M (15611765) - RowsReturnedRate: 3.02 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 52.354us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 338.743us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 160.619us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 900.745ms, non-child: 13.640us, % non-child: 0.00%) - ConvertRowBatchTime: 3.789us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 101.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 900.735ms - DataArrivalTimer: 900.732ms SenderSide: - DeserializeRowBatchTimer: 257.173us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s742ms, non-child: 3s742ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:17/4.04 GB 3:8/1.79 GB 0:22/5.27 GB 4:21/4.95 GB 1:11/2.72 GB 5:14/3.43 GB 2:18/4.46 GB 6:16/3.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s612ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 101.65 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB, 135.54 MB - FooterProcessingTime: (Avg: 2.669ms ; Min: 2.493ms ; Max: 2.768ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 135.54 MB (142121433) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.54 MB (142121433) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.54 MB (142121433) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 689.770ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 176.82 MB (185412870) - PerReadThreadRawHdfsThroughput: 849.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.956ms - RowBatchQueuePutWaitTime: 6m54s - RowsRead: 15.61M (15612923) - RowsReturned: 15.61M (15611765) - RowsReturnedRate: 4.17 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 2.06K (2063) - ScannerThreadsTotalWallClockTime: 7m16s - MaterializeTupleTime(*): 2s386ms - ScannerThreadsSysTime: 410.936ms - ScannerThreadsUserTime: 13s134ms - ScannerThreadsVoluntaryContextSwitches: 19.52K (19515) - TotalRawHdfsReadTime(*): 159.499ms - TotalReadThroughput: 950.62 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.31K (50310) - Rows rejected: 1.16K (1158) - Rows total: 15.61M (15612923) Filter 5 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.61M (15611765) Filter 6 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.61M (15611765) Filter 7 (2.00 MB): - Rows processed: 30.72K (30720) - Rows rejected: 0 (0) - Rows total: 15.61M (15611765) Filter 8 (256.00 KB): - Rows processed: 36.86K (36864) - Rows rejected: 0 (0) - Rows total: 15.61M (15611765) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 15.25K (15246) - RowGroups rejected: 0 (0) - RowGroups total: 15.25K (15246) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.61M (15611765) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000106 (host=foo.187.53:22000):(Total: 2m26s, non-child: 1m47s, % non-child: 73.24%) Hdfs split stats (:<# splits>/): 2:13/2.97 GB 4:11/2.53 GB 3:19/4.44 GB 0:10/2.35 GB 1:25/5.45 GB 6:20/4.87 GB 7:13/2.89 GB 5:20/4.82 GB Filter 9 arrival: 1s740ms Filter 0 arrival: 2s039ms Filter 8 arrival: 21s272ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m30s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.53 MB, 197.07 MB, 305.97 MB, 305.97 MB, 305.97 MB, 321.96 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 327.36 MB, 325.86 MB, 325.92 MB, 326.11 MB, 326.07 MB, 325.93 MB, 316.10 MB, 302.17 MB, 302.27 MB, 302.12 MB, 302.07 MB, 302.06 MB, 264.51 MB, 246.71 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 329.25 MB (345241371) - PerHostPeakMemUsage: 1.19 GB (1277924954) - RowsProduced: 15.09M (15088123) - TotalNetworkReceiveTime: 21s690ms - TotalNetworkSendTime: 1m36s - TotalStorageWaitTime: 72.918ms - TotalThreadsInvoluntaryContextSwitches: 20.12K (20121) - TotalThreadsTotalWallClockTime: 12m13s - TotalThreadsSysTime: 2s342ms - TotalThreadsUserTime: 2m59s - TotalThreadsVoluntaryContextSwitches: 143.77K (143769) Fragment Instance Lifecycle Timings: - ExecTime: 2m5s - ExecTreeExecTime: 2s599ms - OpenTime: 21s269ms - ExecTreeOpenTime: 20s781ms - PrepareTime: 49.688ms - ExecTreePrepareTime: 1.833ms DataStreamSender (dst_id=19):(Total: 15s268ms, non-child: 15s268ms, % non-child: 100.00%) - BytesSent: 2.05 GB (2204300015) - OverallThroughput: 137.68 MB/sec - PeakMemoryUsage: 7.89 MB (8269856) - RowsReturned: 15.09M (15088123) - SerializeBatchTime: 15s255ms - UncompressedRowBatchSize: 2.05 GB (2204300015) CodeGen:(Total: 518.159ms, non-child: 518.159ms, % non-child: 100.00%) - CodegenTime: 1.963ms - CompileTime: 158.575ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 328.160ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.900ms HASH_JOIN_NODE (id=9):(Total: 23s370ms, non-child: 2s279ms, % non-child: 9.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 272.993ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.09M (15088123) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s961ms - RowsReturned: 15.09M (15088123) - RowsReturnedRate: 645.60 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 232.644ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 519.736us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.474ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s495ms, non-child: 18.198ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.439ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.54 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.84 MB, 23.66 MB, 29.50 MB, 32.46 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s181ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s480ms - DataArrivalTimer: 20s477ms SenderSide: - DeserializeRowBatchTimer: 186.906ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s160ms, non-child: 495.805ms, % non-child: 9.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 591.956us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.09M (15088123) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 464.854ms - RowsReturned: 15.09M (15088123) - RowsReturnedRate: 2.92 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 33.100us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 111.610us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 58.715us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s209ms, non-child: 11.714us, % non-child: 0.00%) - ConvertRowBatchTime: 3.167us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 75.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s209ms - DataArrivalTimer: 1s209ms SenderSide: - DeserializeRowBatchTimer: 105.143us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s455ms, non-child: 3s455ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:13/2.97 GB 4:11/2.53 GB 3:19/4.44 GB 0:10/2.35 GB 1:25/5.45 GB 6:20/4.87 GB 7:13/2.89 GB 5:20/4.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s330ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 98.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB, 131.99 MB - FooterProcessingTime: (Avg: 2.360ms ; Min: 2.036ms ; Max: 2.556ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.88 - BytesRead: 131.99 MB (138397144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 131.99 MB (138397144) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 131.99 MB (138397144) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 678.064ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 166.95 MB (175058933) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.956ms - RowBatchQueuePutWaitTime: 6m50s - RowsRead: 15.09M (15089260) - RowsReturned: 15.09M (15088123) - RowsReturnedRate: 4.37 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 16.70K (16704) - ScannerThreadsTotalWallClockTime: 9m25s - MaterializeTupleTime(*): 2s312ms - ScannerThreadsSysTime: 1s325ms - ScannerThreadsUserTime: 2m30s - ScannerThreadsVoluntaryContextSwitches: 132.12K (132119) - TotalRawHdfsReadTime(*): 115.939ms - TotalReadThroughput: 925.71 KB/sec Filter 0 (8.00 KB): - Rows processed: 50.29K (50289) - Rows rejected: 1.14K (1137) - Rows total: 15.09M (15089260) Filter 5 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 15.09M (15088123) Filter 6 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 15.09M (15088123) Filter 7 (2.00 MB): - Rows processed: 28.67K (28672) - Rows rejected: 0 (0) - Rows total: 15.09M (15088123) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 15.09M (15088123) Filter 9 (8.00 KB): - Files processed: 131 (131) - Files rejected: 128 (128) - Files total: 131 (131) - RowGroups processed: 14.73K (14734) - RowGroups rejected: 0 (0) - RowGroups total: 14.73K (14734) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.09M (15088123) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000c2 (host=foo.234.41:22000):(Total: 2m23s, non-child: 1m44s, % non-child: 72.89%) Hdfs split stats (:<# splits>/): 7:12/2.88 GB 3:10/2.34 GB 1:18/4.25 GB 6:16/3.92 GB 4:16/3.95 GB 0:22/5.25 GB 2:17/3.78 GB 5:16/3.83 GB Filter 0 arrival: 702ms Filter 9 arrival: 1s014ms Filter 8 arrival: 19s005ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 2.88 MB, 242.11 MB, 319.09 MB, 319.12 MB, 323.86 MB, 339.78 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.79 MB, 339.48 MB, 339.12 MB, 339.19 MB, 339.17 MB, 339.14 MB, 339.20 MB, 321.29 MB, 315.25 MB, 315.27 MB, 315.32 MB, 296.35 MB, 290.23 MB, 275.38 MB ThreadUsage(4s000ms): 3, 6, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.10 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 342.45 MB (359082462) - PerHostPeakMemUsage: 1.21 GB (1302967025) - RowsProduced: 16.00M (15998422) - TotalNetworkReceiveTime: 18s789ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 94.155ms - TotalThreadsInvoluntaryContextSwitches: 5.63K (5634) - TotalThreadsTotalWallClockTime: 9m46s - TotalThreadsSysTime: 1s682ms - TotalThreadsUserTime: 42s483ms - TotalThreadsVoluntaryContextSwitches: 39.72K (39723) Fragment Instance Lifecycle Timings: - ExecTime: 2m4s - ExecTreeExecTime: 2s850ms - OpenTime: 19s014ms - ExecTreeOpenTime: 18s545ms - PrepareTime: 42.329ms - ExecTreePrepareTime: 1.747ms DataStreamSender (dst_id=19):(Total: 16s964ms, non-child: 16s964ms, % non-child: 100.00%) - BytesSent: 2.17 GB (2328730351) - OverallThroughput: 130.91 MB/sec - PeakMemoryUsage: 7.94 MB (8327200) - RowsReturned: 16.00M (15998422) - SerializeBatchTime: 16s946ms - UncompressedRowBatchSize: 2.17 GB (2328730351) CodeGen:(Total: 495.713ms, non-child: 495.713ms, % non-child: 100.00%) - CodegenTime: 1.567ms - CompileTime: 162.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 304.826ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.445ms HASH_JOIN_NODE (id=9):(Total: 21s384ms, non-child: 2s448ms, % non-child: 11.45%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 237.504ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.00 MB (161485568) - ProbeRows: 16.00M (15998422) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s190ms - RowsReturned: 16.00M (15998422) - RowsReturnedRate: 748.12 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 187.738ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 480.519us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.049ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s296ms, non-child: 14.932ms, % non-child: 0.08%) - ConvertRowBatchTime: 10.361ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.25 K/sec RecvrSide: BytesReceived(4s000ms): 177.32 KB, 10.95 MB, 26.99 MB, 30.77 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s869ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s284ms - DataArrivalTimer: 18s282ms SenderSide: - DeserializeRowBatchTimer: 211.364ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s202ms, non-child: 511.075ms, % non-child: 9.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 444.791us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.00M (15998422) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 480.480ms - RowsReturned: 16.00M (15998422) - RowsReturnedRate: 3.07 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 57.936us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 101.307us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.504us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 504.486ms, non-child: 14.391us, % non-child: 0.00%) - ConvertRowBatchTime: 3.565us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 180.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 504.475ms - DataArrivalTimer: 504.472ms SenderSide: - DeserializeRowBatchTimer: 208.084us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s187ms, non-child: 4s187ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:12/2.88 GB 3:10/2.34 GB 1:18/4.25 GB 6:16/3.92 GB 4:16/3.95 GB 0:22/5.25 GB 2:17/3.78 GB 5:16/3.83 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s057ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 109.04 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB, 145.38 MB - FooterProcessingTime: (Avg: 4.192ms ; Min: 2.052ms ; Max: 8.363ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.99 - BytesRead: 145.38 MB (152446718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.38 MB (152446718) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.38 MB (152446718) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 753.925ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 180.08 MB (188829002) - PerReadThreadRawHdfsThroughput: 1.00 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.302ms - RowBatchQueuePutWaitTime: 6m44s - RowsRead: 16.00M (15999548) - RowsReturned: 16.00M (15998422) - RowsReturnedRate: 3.82 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 1.63K (1634) - ScannerThreadsTotalWallClockTime: 7m3s - MaterializeTupleTime(*): 2s584ms - ScannerThreadsSysTime: 567.912ms - ScannerThreadsUserTime: 10s949ms - ScannerThreadsVoluntaryContextSwitches: 28.03K (28034) - TotalRawHdfsReadTime(*): 141.411ms - TotalReadThroughput: 1.02 MB/sec Filter 0 (8.00 KB): - Rows processed: 50.28K (50278) - Rows rejected: 1.13K (1126) - Rows total: 16.00M (15999548) Filter 5 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 16.00M (15998422) Filter 6 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 16.00M (15998422) Filter 7 (2.00 MB): - Rows processed: 19.46K (19456) - Rows rejected: 0 (0) - Rows total: 16.00M (15998422) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.00M (15998422) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 15.62K (15623) - RowGroups rejected: 0 (0) - RowGroups total: 15.62K (15623) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.00M (15998422) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000bb (host=foo.246.42:22000):(Total: 2m22s, non-child: 1m41s, % non-child: 71.60%) Hdfs split stats (:<# splits>/): 3:15/3.68 GB 2:15/3.39 GB 4:14/3.19 GB 5:21/5.02 GB 1:12/2.92 GB 7:15/3.71 GB 0:22/5.18 GB 6:13/3.08 GB Filter 0 arrival: 382ms Filter 9 arrival: 521ms Filter 8 arrival: 20s418ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.20 MB, 241.54 MB, 318.36 MB, 318.35 MB, 318.36 MB, 338.19 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 341.02 MB, 339.98 MB, 338.41 MB, 338.53 MB, 338.40 MB, 338.45 MB, 338.30 MB, 327.48 MB, 314.51 MB, 314.57 MB, 314.52 MB, 299.59 MB, 288.61 MB, 281.62 MB ThreadUsage(4s000ms): 4, 6, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.15 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 341.68 MB (358281772) - PerHostPeakMemUsage: 1.21 GB (1302713199) - RowsProduced: 15.99M (15992426) - TotalNetworkReceiveTime: 19s630ms - TotalNetworkSendTime: 1m29s - TotalStorageWaitTime: 80.224ms - TotalThreadsInvoluntaryContextSwitches: 5.61K (5606) - TotalThreadsTotalWallClockTime: 9m50s - TotalThreadsSysTime: 1s872ms - TotalThreadsUserTime: 41s251ms - TotalThreadsVoluntaryContextSwitches: 68.65K (68650) Fragment Instance Lifecycle Timings: - ExecTime: 2m1s - ExecTreeExecTime: 2s940ms - OpenTime: 20s410ms - ExecTreeOpenTime: 19s940ms - PrepareTime: 53.681ms - ExecTreePrepareTime: 1.761ms DataStreamSender (dst_id=19):(Total: 16s964ms, non-child: 16s964ms, % non-child: 100.00%) - BytesSent: 2.17 GB (2331908579) - OverallThroughput: 131.09 MB/sec - PeakMemoryUsage: 7.92 MB (8302624) - RowsReturned: 15.99M (15992426) - SerializeBatchTime: 16s950ms - UncompressedRowBatchSize: 2.17 GB (2331908579) CodeGen:(Total: 505.037ms, non-child: 505.037ms, % non-child: 100.00%) - CodegenTime: 2.187ms - CompileTime: 147.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 319.957ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 37.038ms HASH_JOIN_NODE (id=9):(Total: 22s869ms, non-child: 2s542ms, % non-child: 11.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 276.307ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 15.99M (15992426) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s253ms - RowsReturned: 15.99M (15992426) - RowsReturnedRate: 699.29 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 232.710ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 481.079us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.156ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s650ms, non-child: 24.054ms, % non-child: 0.12%) - ConvertRowBatchTime: 19.093ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.51 K/sec RecvrSide: BytesReceived(4s000ms): 233.58 KB, 11.36 MB, 27.13 MB, 30.84 MB, 32.80 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s535ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s630ms - DataArrivalTimer: 19s627ms SenderSide: - DeserializeRowBatchTimer: 179.807ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s222ms, non-child: 541.734ms, % non-child: 10.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 404.865us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 15.99M (15992426) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 512.362ms - RowsReturned: 15.99M (15992426) - RowsReturnedRate: 3.06 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.677us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 102.995us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.231us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 8.357us, non-child: 8.357us, % non-child: 100.00%) - ConvertRowBatchTime: 3.311us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 10.89 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1.302us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 284.856us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s680ms, non-child: 4s680ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:15/3.68 GB 2:15/3.39 GB 4:14/3.19 GB 5:21/5.02 GB 1:12/2.92 GB 7:15/3.71 GB 0:22/5.18 GB 6:13/3.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s557ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:124 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 109.13 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB, 145.51 MB - FooterProcessingTime: (Avg: 2.102ms ; Min: 1.589ms ; Max: 2.423ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.03 - BytesRead: 145.51 MB (152574357) - BytesReadDataNodeCache: 0 - BytesReadLocal: 145.51 MB (152574357) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 145.51 MB (152574357) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 748.817ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 179.34 MB (188054933) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.675ms - RowBatchQueuePutWaitTime: 6m42s - RowsRead: 15.99M (15993537) - RowsReturned: 15.99M (15992426) - RowsReturnedRate: 3.42 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 1.71K (1712) - ScannerThreadsTotalWallClockTime: 7m8s - MaterializeTupleTime(*): 2s454ms - ScannerThreadsSysTime: 714.889ms - ScannerThreadsUserTime: 9s718ms - ScannerThreadsVoluntaryContextSwitches: 56.61K (56612) - TotalRawHdfsReadTime(*): 124.476ms - TotalReadThroughput: 1.03 MB/sec Filter 0 (8.00 KB): - Rows processed: 50.26K (50263) - Rows rejected: 1.11K (1111) - Rows total: 15.99M (15993537) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 15.99M (15992426) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 15.99M (15992426) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 15.99M (15992426) Filter 8 (256.00 KB): - Rows processed: 4.10K (4096) - Rows rejected: 0 (0) - Rows total: 15.99M (15992426) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 124 (124) - Files total: 127 (127) - RowGroups processed: 15.62K (15617) - RowGroups rejected: 0 (0) - RowGroups total: 15.62K (15617) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 15.99M (15992426) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000098 (host=foo.246.45:22000):(Total: 2m21s, non-child: 1m43s, % non-child: 73.10%) Hdfs split stats (:<# splits>/): 0:11/2.72 GB 2:19/4.50 GB 4:20/4.70 GB 5:15/3.46 GB 7:14/3.25 GB 6:19/4.27 GB 1:18/4.17 GB 3:14/3.44 GB Filter 0 arrival: 295ms Filter 9 arrival: 499ms Filter 8 arrival: 18s421ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.06 MB, 256.64 MB, 317.11 MB, 317.12 MB, 326.72 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.85 MB, 337.44 MB, 337.01 MB, 337.20 MB, 337.27 MB, 337.10 MB, 337.12 MB, 314.32 MB, 313.22 MB, 313.10 MB, 310.45 MB, 289.37 MB, 287.43 MB, 268.55 MB ThreadUsage(4s000ms): 3, 6, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.12 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 340.46 MB (356995113) - PerHostPeakMemUsage: 1.20 GB (1285823699) - RowsProduced: 16.44M (16442385) - TotalNetworkReceiveTime: 17s679ms - TotalNetworkSendTime: 1m30s - TotalStorageWaitTime: 123.582ms - TotalThreadsInvoluntaryContextSwitches: 5.88K (5875) - TotalThreadsTotalWallClockTime: 9m41s - TotalThreadsSysTime: 1s524ms - TotalThreadsUserTime: 41s647ms - TotalThreadsVoluntaryContextSwitches: 31.29K (31290) Fragment Instance Lifecycle Timings: - ExecTime: 2m2s - ExecTreeExecTime: 2s858ms - OpenTime: 18s437ms - ExecTreeOpenTime: 17s974ms - PrepareTime: 39.765ms - ExecTreePrepareTime: 1.211ms DataStreamSender (dst_id=19):(Total: 16s708ms, non-child: 16s708ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2398452839) - OverallThroughput: 136.90 MB/sec - PeakMemoryUsage: 7.95 MB (8335392) - RowsReturned: 16.44M (16442385) - SerializeBatchTime: 16s692ms - UncompressedRowBatchSize: 2.23 GB (2398452839) CodeGen:(Total: 485.992ms, non-child: 485.992ms, % non-child: 100.00%) - CodegenTime: 1.737ms - CompileTime: 137.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 323.684ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 24.007ms HASH_JOIN_NODE (id=9):(Total: 20s821ms, non-child: 2s430ms, % non-child: 11.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 269.609ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.00 MB (161485568) - ProbeRows: 16.44M (16442385) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s160ms - RowsReturned: 16.44M (16442385) - RowsReturnedRate: 789.68 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.271ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 435.302us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.371ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s693ms, non-child: 18.142ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.295ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 26.11 K/sec RecvrSide: BytesReceived(4s000ms): 531.55 KB, 13.39 MB, 27.76 MB, 31.12 MB, 32.85 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s468ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s678ms - DataArrivalTimer: 17s675ms SenderSide: - DeserializeRowBatchTimer: 267.083ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s271ms, non-child: 551.818ms, % non-child: 10.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 474.871us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 16.44M (16442385) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 521.311ms - RowsReturned: 16.44M (16442385) - RowsReturnedRate: 3.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.405us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 149.742us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.548us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 12.218us, non-child: 12.218us, % non-child: 100.00%) - ConvertRowBatchTime: 3.885us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.45 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.155us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 36.348us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s719ms, non-child: 4s719ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:11/2.72 GB 2:19/4.50 GB 4:20/4.70 GB 5:15/3.46 GB 7:14/3.25 GB 6:19/4.27 GB 1:18/4.17 GB 3:14/3.44 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s575ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:15 BytesRead(4s000ms): 0, 106.84 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB, 142.45 MB - FooterProcessingTime: (Avg: 3.159ms ; Min: 2.739ms ; Max: 3.465ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.01 - BytesRead: 142.45 MB (149371672) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.45 MB (149371672) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.45 MB (149371672) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 747.634ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.08 MB (186730612) - PerReadThreadRawHdfsThroughput: 800.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.187ms - RowBatchQueuePutWaitTime: 6m40s - RowsRead: 16.44M (16443591) - RowsReturned: 16.44M (16442385) - RowsReturnedRate: 3.48 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 1.91K (1912) - ScannerThreadsTotalWallClockTime: 7m2s - MaterializeTupleTime(*): 2s548ms - ScannerThreadsSysTime: 411.936ms - ScannerThreadsUserTime: 10s332ms - ScannerThreadsVoluntaryContextSwitches: 17.63K (17627) - TotalRawHdfsReadTime(*): 177.924ms - TotalReadThroughput: 1.01 MB/sec Filter 0 (8.00 KB): - Rows processed: 50.36K (50358) - Rows rejected: 1.21K (1206) - Rows total: 16.44M (16443591) Filter 5 (2.00 MB): - Rows processed: 18.43K (18432) - Rows rejected: 0 (0) - Rows total: 16.44M (16442385) Filter 6 (2.00 MB): - Rows processed: 18.43K (18432) - Rows rejected: 0 (0) - Rows total: 16.44M (16442385) Filter 7 (2.00 MB): - Rows processed: 18.43K (18432) - Rows rejected: 0 (0) - Rows total: 16.44M (16442385) Filter 8 (256.00 KB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 16.44M (16442385) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 127 (127) - Files total: 130 (130) - RowGroups processed: 16.06K (16057) - RowGroups rejected: 0 (0) - RowGroups total: 16.06K (16057) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 16.44M (16442385) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce18000000a9 (host=foo.187.42:22000):(Total: 2m14s, non-child: 1m40s, % non-child: 74.63%) Hdfs split stats (:<# splits>/): 5:17/4.16 GB 1:17/3.85 GB 0:10/2.41 GB 4:12/2.97 GB 7:14/3.02 GB 3:15/3.54 GB 6:16/3.82 GB 2:27/6.53 GB Filter 9 arrival: 2s026ms Filter 0 arrival: 2s320ms Filter 8 arrival: 21s928ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 147.14 MB, 259.64 MB, 259.64 MB, 259.63 MB, 269.82 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.38 MB, 280.00 MB, 279.69 MB, 279.74 MB, 277.61 MB, 263.65 MB, 263.92 MB, 263.76 MB, 259.72 MB, 247.82 MB, 244.71 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.94 MB (296679679) - PerHostPeakMemUsage: 1.09 GB (1169337810) - RowsProduced: 10.60M (10598694) - TotalNetworkReceiveTime: 22s627ms - TotalNetworkSendTime: 1m32s - TotalStorageWaitTime: 57.360ms - TotalThreadsInvoluntaryContextSwitches: 29.88K (29880) - TotalThreadsTotalWallClockTime: 11m12s - TotalThreadsSysTime: 22s169ms - TotalThreadsUserTime: 4m14s - TotalThreadsVoluntaryContextSwitches: 2.26M (2261602) Fragment Instance Lifecycle Timings: - ExecTime: 1m52s - ExecTreeExecTime: 1s738ms - OpenTime: 21s922ms - ExecTreeOpenTime: 21s429ms - PrepareTime: 54.306ms - ExecTreePrepareTime: 1.717ms DataStreamSender (dst_id=19):(Total: 10s432ms, non-child: 10s432ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1545308957) - OverallThroughput: 141.27 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 10.60M (10598694) - SerializeBatchTime: 10s422ms - UncompressedRowBatchSize: 1.44 GB (1545308957) CodeGen:(Total: 526.650ms, non-child: 526.650ms, % non-child: 100.00%) - CodegenTime: 2.855ms - CompileTime: 158.577ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 332.561ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 34.816ms HASH_JOIN_NODE (id=9):(Total: 23s162ms, non-child: 1s594ms, % non-child: 6.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 256.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.60M (10598694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s298ms - RowsReturned: 10.60M (10598694) - RowsReturnedRate: 457.58 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 210.431ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 355.360us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.700ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 21s160ms, non-child: 17.766ms, % non-child: 0.08%) - ConvertRowBatchTime: 12.901ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 21.83 K/sec RecvrSide: BytesReceived(4s000ms): 0, 3.51 MB, 22.29 MB, 29.20 MB, 32.31 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s457ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 21s146ms - DataArrivalTimer: 21s143ms SenderSide: - DeserializeRowBatchTimer: 263.942ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s954ms, non-child: 341.296ms, % non-child: 6.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 1.074ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 10.60M (10598694) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 320.425ms - RowsReturned: 10.60M (10598694) - RowsReturnedRate: 2.14 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.371us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 727.460us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.456us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s481ms, non-child: 13.119us, % non-child: 0.00%) - ConvertRowBatchTime: 3.412us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 61.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 112.517ms - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s481ms - DataArrivalTimer: 1s481ms SenderSide: - DeserializeRowBatchTimer: 14.126us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s132ms, non-child: 3s132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/4.16 GB 1:17/3.85 GB 0:10/2.41 GB 4:12/2.97 GB 7:14/3.02 GB 3:15/3.54 GB 6:16/3.82 GB 2:27/6.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s033ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 72.64 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB, 96.86 MB - FooterProcessingTime: (Avg: 1.927ms ; Min: 1.919ms ; Max: 1.934ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 96.86 MB (101562864) - BytesReadDataNodeCache: 0 - BytesReadLocal: 96.86 MB (101562864) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 96.86 MB (101562864) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 505.184ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.63 MB (126490127) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.982ms - RowBatchQueuePutWaitTime: 4m14s - RowsRead: 10.60M (10599498) - RowsReturned: 10.60M (10598694) - RowsReturnedRate: 3.38 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 27.32K (27315) - ScannerThreadsTotalWallClockTime: 8m34s - MaterializeTupleTime(*): 1s645ms - ScannerThreadsSysTime: 21s398ms - ScannerThreadsUserTime: 3m54s - ScannerThreadsVoluntaryContextSwitches: 2.25M (2252044) - TotalRawHdfsReadTime(*): 89.645ms - TotalReadThroughput: 740.17 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.57K (33572) - Rows rejected: 804 (804) - Rows total: 10.60M (10599498) Filter 5 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.60M (10598694) Filter 6 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.60M (10598694) Filter 7 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.60M (10598694) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.60M (10598694) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 10.35K (10350) - RowGroups rejected: 0 (0) - RowGroups total: 10.35K (10350) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.60M (10598694) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000d7 (host=foo.187.54:22000):(Total: 2m12s, non-child: 1m41s, % non-child: 76.62%) Hdfs split stats (:<# splits>/): 7:11/2.64 GB 0:14/3.37 GB 2:9/2.23 GB 4:16/3.75 GB 1:22/5.10 GB 3:20/4.32 GB 6:23/5.46 GB 5:15/3.47 GB Filter 9 arrival: 1s805ms Filter 0 arrival: 2s101ms Filter 8 arrival: 20s464ms Filter 6 arrival: 1m30s Filter 5 arrival: 1m30s Filter 7 arrival: 1m30s MemoryUsage(4s000ms): 1.85 MB, 150.87 MB, 243.01 MB, 243.03 MB, 243.00 MB, 260.45 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.81 MB, 262.72 MB, 262.98 MB, 263.04 MB, 263.05 MB, 263.10 MB, 251.20 MB, 247.02 MB, 247.14 MB, 247.37 MB, 219.12 MB, 199.70 MB ThreadUsage(4s000ms): 2, 5, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.01 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 266.43 MB (279376594) - PerHostPeakMemUsage: 1.06 GB (1136922276) - RowsProduced: 9.17M (9166221) - TotalNetworkReceiveTime: 20s759ms - TotalNetworkSendTime: 1m34s - TotalStorageWaitTime: 47.972ms - TotalThreadsInvoluntaryContextSwitches: 30.07K (30069) - TotalThreadsTotalWallClockTime: 11m1s - TotalThreadsSysTime: 38s051ms - TotalThreadsUserTime: 3m57s - TotalThreadsVoluntaryContextSwitches: 2.25M (2246102) Fragment Instance Lifecycle Timings: - ExecTime: 1m51s - ExecTreeExecTime: 1s438ms - OpenTime: 20s478ms - ExecTreeOpenTime: 19s896ms - PrepareTime: 42.300ms - ExecTreePrepareTime: 1.246ms DataStreamSender (dst_id=19):(Total: 8s962ms, non-child: 8s962ms, % non-child: 100.00%) - BytesSent: 1.24 GB (1331558855) - OverallThroughput: 141.69 MB/sec - PeakMemoryUsage: 8.01 MB (8400928) - RowsReturned: 9.17M (9166221) - SerializeBatchTime: 8s954ms - UncompressedRowBatchSize: 1.24 GB (1331558855) CodeGen:(Total: 608.644ms, non-child: 608.644ms, % non-child: 100.00%) - CodegenTime: 1.658ms - CompileTime: 169.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 410.619ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.773ms HASH_JOIN_NODE (id=9):(Total: 21s330ms, non-child: 1s397ms, % non-child: 6.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 293.969ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 9.17M (9166221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s073ms - RowsReturned: 9.17M (9166221) - RowsReturnedRate: 429.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 239.399ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 372.295us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.555ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 19s590ms, non-child: 18.351ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.308ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.58 K/sec RecvrSide: BytesReceived(4s000ms): 0, 4.79 MB, 23.52 MB, 29.50 MB, 32.46 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s159ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 19s575ms - DataArrivalTimer: 19s572ms SenderSide: - DeserializeRowBatchTimer: 179.548ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s822ms, non-child: 285.270ms, % non-child: 5.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 405.878us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 9.17M (9166221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.248ms - RowsReturned: 9.17M (9166221) - RowsReturnedRate: 1.90 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.488us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 108.856us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.229us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s183ms, non-child: 11.491us, % non-child: 0.00%) - ConvertRowBatchTime: 3.207us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 76.00 /sec RecvrSide: BytesReceived(4s000ms): 1021.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s183ms - DataArrivalTimer: 1s183ms SenderSide: - DeserializeRowBatchTimer: 26.144us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s354ms, non-child: 3s354ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:11/2.64 GB 0:14/3.37 GB 2:9/2.23 GB 4:16/3.75 GB 1:22/5.10 GB 3:20/4.32 GB 6:23/5.46 GB 5:15/3.47 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s271ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:10 BytesRead(4s000ms): 0, 60.85 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB, 81.14 MB - FooterProcessingTime: (Avg: 2.257ms ; Min: 1.779ms ; Max: 2.735ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.86 - BytesRead: 81.14 MB (85076955) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.14 MB (85076955) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.14 MB (85076955) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 391.539ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.00 MB (109054407) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.535ms - RowBatchQueuePutWaitTime: 4m5s - RowsRead: 9.17M (9167002) - RowsReturned: 9.17M (9166221) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 27.87K (27866) - ScannerThreadsTotalWallClockTime: 8m27s - MaterializeTupleTime(*): 1s339ms - ScannerThreadsSysTime: 37s402ms - ScannerThreadsUserTime: 3m40s - ScannerThreadsVoluntaryContextSwitches: 2.24M (2236297) - TotalRawHdfsReadTime(*): 73.659ms - TotalReadThroughput: 629.42 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.55K (33549) - Rows rejected: 781 (781) - Rows total: 9.17M (9167002) Filter 5 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.17M (9166221) Filter 6 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.17M (9166221) Filter 7 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.17M (9166221) Filter 8 (256.00 KB): - Rows processed: 5.12K (5120) - Rows rejected: 0 (0) - Rows total: 9.17M (9166221) Filter 9 (8.00 KB): - Files processed: 130 (130) - Files rejected: 128 (128) - Files total: 130 (130) - RowGroups processed: 8.95K (8951) - RowGroups rejected: 0 (0) - RowGroups total: 8.95K (8951) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.17M (9166221) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000c7 (host=foo.221.26:22000):(Total: 2m11s, non-child: 1m43s, % non-child: 78.44%) Hdfs split stats (:<# splits>/): 7:13/3.01 GB 4:19/4.36 GB 5:20/4.63 GB 3:13/2.97 GB 2:17/3.96 GB 0:14/3.37 GB 6:16/3.87 GB 1:17/4.00 GB Filter 9 arrival: 1s768ms Filter 0 arrival: 1s904ms Filter 8 arrival: 21s135ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(4s000ms): 1.52 MB, 120.50 MB, 201.21 MB, 201.21 MB, 201.21 MB, 216.16 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 220.57 MB, 221.22 MB, 221.14 MB, 221.07 MB, 221.20 MB, 219.29 MB, 213.22 MB, 213.31 MB, 211.20 MB, 205.24 MB, 205.34 MB ThreadUsage(4s000ms): 2, 2, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.11 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 224.62 MB (235527238) - PerHostPeakMemUsage: 1.05 GB (1124036226) - RowsProduced: 5.43M (5427434) - TotalNetworkReceiveTime: 21s571ms - TotalNetworkSendTime: 1m38s - TotalStorageWaitTime: 38.185ms - TotalThreadsInvoluntaryContextSwitches: 2.13K (2131) - TotalThreadsTotalWallClockTime: 4m38s - TotalThreadsSysTime: 677.897ms - TotalThreadsUserTime: 13s027ms - TotalThreadsVoluntaryContextSwitches: 11.87K (11866) Fragment Instance Lifecycle Timings: - ExecTime: 1m50s - ExecTreeExecTime: 1s042ms - OpenTime: 21s143ms - ExecTreeOpenTime: 20s651ms - PrepareTime: 46.432ms - ExecTreePrepareTime: 1.449ms DataStreamSender (dst_id=19):(Total: 6s137ms, non-child: 6s137ms, % non-child: 100.00%) - BytesSent: 746.23 MB (782476805) - OverallThroughput: 121.59 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 5.43M (5427434) - SerializeBatchTime: 6s131ms - UncompressedRowBatchSize: 746.23 MB (782476805) CodeGen:(Total: 522.442ms, non-child: 522.442ms, % non-child: 100.00%) - CodegenTime: 1.861ms - CompileTime: 157.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 333.306ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.690ms HASH_JOIN_NODE (id=9):(Total: 21s690ms, non-child: 1s091ms, % non-child: 5.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 283.861ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 5.43M (5427434) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 787.968ms - RowsReturned: 5.43M (5427434) - RowsReturnedRate: 250.22 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 230.780ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 470.778us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.030ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s354ms, non-child: 19.132ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.211ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.70 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.25 MB, 24.11 MB, 29.64 MB, 32.52 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s049ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s339ms - DataArrivalTimer: 20s335ms SenderSide: - DeserializeRowBatchTimer: 240.069ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s803ms, non-child: 196.045ms, % non-child: 4.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 481.638us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 5.43M (5427434) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 183.357ms - RowsReturned: 5.43M (5427434) - RowsReturnedRate: 1.13 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.892us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 117.493us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 75.483us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s231ms, non-child: 13.168us, % non-child: 0.00%) - ConvertRowBatchTime: 3.134us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 73.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s230ms - DataArrivalTimer: 1s230ms SenderSide: - DeserializeRowBatchTimer: 230.754us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s376ms, non-child: 3s376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.01 GB 4:19/4.36 GB 5:20/4.63 GB 3:13/2.97 GB 2:17/3.96 GB 0:14/3.37 GB 6:16/3.87 GB 1:17/4.00 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s292ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:5 BytesRead(4s000ms): 0, 35.69 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB, 47.59 MB - FooterProcessingTime: (Avg: 1.923ms ; Min: 1.923ms ; Max: 1.923ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.96 - BytesRead: 47.59 MB (49896863) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.59 MB (49896863) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.59 MB (49896863) - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 244.450ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 62.17 MB (65188592) - PerReadThreadRawHdfsThroughput: 823.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.654ms - RowBatchQueuePutWaitTime: 2m3s - RowsRead: 5.43M (5427841) - RowsReturned: 5.43M (5427434) - RowsReturnedRate: 1.61 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 438 (438) - ScannerThreadsTotalWallClockTime: 2m5s - MaterializeTupleTime(*): 836.907ms - ScannerThreadsSysTime: 130.979ms - ScannerThreadsUserTime: 1s158ms - ScannerThreadsVoluntaryContextSwitches: 5.25K (5253) - TotalRawHdfsReadTime(*): 57.752ms - TotalReadThroughput: 373.39 KB/sec Filter 0 (8.00 KB): - Rows processed: 16.79K (16791) - Rows rejected: 407 (407) - Rows total: 5.43M (5427841) Filter 5 (2.00 MB): - Rows processed: 4.10K (4096) - Rows rejected: 0 (0) - Rows total: 5.43M (5427434) Filter 6 (2.00 MB): - Rows processed: 4.10K (4096) - Rows rejected: 0 (0) - Rows total: 5.43M (5427434) Filter 7 (2.00 MB): - Rows processed: 4.10K (4096) - Rows rejected: 0 (0) - Rows total: 5.43M (5427434) Filter 8 (256.00 KB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 5.43M (5427434) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 128 (128) - Files total: 129 (129) - RowGroups processed: 5.30K (5300) - RowGroups rejected: 0 (0) - RowGroups total: 5.30K (5300) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 5.43M (5427434) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce18000000cd (host=foo.246.46:22000):(Total: 2m8s, non-child: 1m35s, % non-child: 73.87%) Hdfs split stats (:<# splits>/): 7:13/3.14 GB 0:16/3.75 GB 4:10/2.46 GB 5:17/3.91 GB 3:18/4.09 GB 2:17/4.21 GB 1:13/3.15 GB 6:23/5.53 GB Filter 0 arrival: 304ms Filter 9 arrival: 540ms Filter 8 arrival: 20s841ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 3.88 MB, 213.43 MB, 259.55 MB, 259.57 MB, 259.55 MB, 278.31 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.99 MB, 280.74 MB, 279.48 MB, 279.51 MB, 279.61 MB, 274.55 MB, 263.60 MB, 263.73 MB, 260.48 MB, 247.67 MB, 193.43 MB ThreadUsage(4s000ms): 3, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.05 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 282.78 MB (296517389) - PerHostPeakMemUsage: 1.09 GB (1169931258) - RowsProduced: 10.53M (10530547) - TotalNetworkReceiveTime: 20s026ms - TotalNetworkSendTime: 1m27s - TotalStorageWaitTime: 52.820ms - TotalThreadsInvoluntaryContextSwitches: 29.01K (29008) - TotalThreadsTotalWallClockTime: 10m50s - TotalThreadsSysTime: 29s341ms - TotalThreadsUserTime: 3m57s - TotalThreadsVoluntaryContextSwitches: 1.46M (1462837) Fragment Instance Lifecycle Timings: - ExecTime: 1m47s - ExecTreeExecTime: 1s750ms - OpenTime: 20s850ms - ExecTreeOpenTime: 20s345ms - PrepareTime: 35.818ms - ExecTreePrepareTime: 795.342us DataStreamSender (dst_id=19):(Total: 11s064ms, non-child: 11s064ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1535470017) - OverallThroughput: 132.34 MB/sec - PeakMemoryUsage: 7.82 MB (8204320) - RowsReturned: 10.53M (10530547) - SerializeBatchTime: 11s055ms - UncompressedRowBatchSize: 1.43 GB (1535470017) CodeGen:(Total: 526.829ms, non-child: 526.829ms, % non-child: 100.00%) - CodegenTime: 1.696ms - CompileTime: 176.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 328.398ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 21.796ms HASH_JOIN_NODE (id=9):(Total: 22s088ms, non-child: 1s578ms, % non-child: 7.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 266.286ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 10.53M (10530547) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s321ms - RowsReturned: 10.53M (10530547) - RowsReturnedRate: 476.75 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 222.806ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 482.876us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 42.445ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s041ms, non-child: 17.534ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.943ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.05 K/sec RecvrSide: BytesReceived(4s000ms): 503.88 KB, 13.31 MB, 27.69 MB, 31.08 MB, 32.82 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s440ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s026ms - DataArrivalTimer: 20s023ms SenderSide: - DeserializeRowBatchTimer: 206.764ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s963ms, non-child: 331.800ms, % non-child: 6.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 306.503us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 10.53M (10530547) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 307.323ms - RowsReturned: 10.53M (10530547) - RowsReturnedRate: 2.12 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.846us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 101.093us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.682us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 11.714us, non-child: 11.714us, % non-child: 100.00%) - ConvertRowBatchTime: 3.331us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.77 M/sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.382us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 39.254us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s631ms, non-child: 4s631ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:13/3.14 GB 0:16/3.75 GB 4:10/2.46 GB 5:17/3.91 GB 3:18/4.09 GB 2:17/4.21 GB 1:13/3.15 GB 6:23/5.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s535ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:125 PARQUET/SNAPPY:10 BytesRead(2s000ms): 0, 0, 47.20 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB, 94.40 MB - FooterProcessingTime: (Avg: 2.507ms ; Min: 2.200ms ; Max: 2.814ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.94 - BytesRead: 94.40 MB (98990765) - BytesReadDataNodeCache: 0 - BytesReadLocal: 94.40 MB (98990765) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 94.40 MB (98990765) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 470.228ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.51 MB (126358692) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.125ms - RowBatchQueuePutWaitTime: 4m1s - RowsRead: 10.53M (10531278) - RowsReturned: 10.53M (10530547) - RowsReturnedRate: 2.27 M/sec - ScanRangesComplete: 127 (127) - ScannerThreadsInvoluntaryContextSwitches: 26.48K (26480) - ScannerThreadsTotalWallClockTime: 8m21s - MaterializeTupleTime(*): 1s571ms - ScannerThreadsSysTime: 28s566ms - ScannerThreadsUserTime: 3m37s - ScannerThreadsVoluntaryContextSwitches: 1.45M (1453853) - TotalRawHdfsReadTime(*): 81.128ms - TotalReadThroughput: 758.20 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.50K (33499) - Rows rejected: 731 (731) - Rows total: 10.53M (10531278) Filter 5 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.53M (10530547) Filter 6 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.53M (10530547) Filter 7 (2.00 MB): - Rows processed: 17.41K (17408) - Rows rejected: 0 (0) - Rows total: 10.53M (10530547) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 10.53M (10530547) Filter 9 (8.00 KB): - Files processed: 127 (127) - Files rejected: 125 (125) - Files total: 127 (127) - RowGroups processed: 10.28K (10284) - RowGroups rejected: 0 (0) - RowGroups total: 10.28K (10284) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 10.53M (10530547) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000ae (host=foo.234.36:22000):(Total: 2m8s, non-child: 1m38s, % non-child: 76.54%) Hdfs split stats (:<# splits>/): 5:17/3.92 GB 7:16/3.89 GB 2:15/3.50 GB 1:8/1.82 GB 0:13/3.16 GB 6:15/3.38 GB 3:20/4.69 GB 4:24/5.94 GB Filter 0 arrival: 723ms Filter 9 arrival: 1s039ms Filter 8 arrival: 18s912ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 1.50 MB, 156.77 MB, 242.55 MB, 242.53 MB, 247.42 MB, 262.89 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.98 MB, 262.90 MB, 262.52 MB, 262.68 MB, 262.82 MB, 259.52 MB, 247.62 MB, 246.70 MB, 225.87 MB, 206.37 MB, 200.37 MB ThreadUsage(4s000ms): 1, 6, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.07 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 266.00 MB (278917689) - PerHostPeakMemUsage: 1.09 GB (1166255591) - RowsProduced: 8.97M (8965260) - TotalNetworkReceiveTime: 18s549ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 48.974ms - TotalThreadsInvoluntaryContextSwitches: 17.83K (17827) - TotalThreadsTotalWallClockTime: 8m46s - TotalThreadsSysTime: 9s152ms - TotalThreadsUserTime: 2m28s - TotalThreadsVoluntaryContextSwitches: 959.38K (959384) Fragment Instance Lifecycle Timings: - ExecTime: 1m49s - ExecTreeExecTime: 1s549ms - OpenTime: 18s909ms - ExecTreeOpenTime: 18s378ms - PrepareTime: 45.912ms - ExecTreePrepareTime: 1.302ms DataStreamSender (dst_id=19):(Total: 9s732ms, non-child: 9s732ms, % non-child: 100.00%) - BytesSent: 1.21 GB (1300358349) - OverallThroughput: 127.42 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 8.97M (8965260) - SerializeBatchTime: 9s724ms - UncompressedRowBatchSize: 1.21 GB (1300358349) CodeGen:(Total: 559.955ms, non-child: 559.955ms, % non-child: 100.00%) - CodegenTime: 2.069ms - CompileTime: 166.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 362.455ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 30.090ms HASH_JOIN_NODE (id=9):(Total: 19s922ms, non-child: 1s437ms, % non-child: 7.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 265.819ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.00 MB (161485568) - ProbeRows: 8.97M (8965260) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s168ms - RowsReturned: 8.97M (8965260) - RowsReturnedRate: 450.00 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 224.656ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 352.821us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.173ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 18s100ms, non-child: 18.002ms, % non-child: 0.10%) - ConvertRowBatchTime: 13.619ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.52 K/sec RecvrSide: BytesReceived(4s000ms): 261.24 KB, 11.24 MB, 27.13 MB, 30.79 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s824ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 18s085ms - DataArrivalTimer: 18s082ms SenderSide: - DeserializeRowBatchTimer: 258.518ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s877ms, non-child: 294.225ms, % non-child: 6.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 784.998us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 8.97M (8965260) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 273.587ms - RowsReturned: 8.97M (8965260) - RowsReturnedRate: 1.84 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.508us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 484.298us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 53.113us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 463.689ms, non-child: 14.637us, % non-child: 0.00%) - ConvertRowBatchTime: 3.291us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 196.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 463.678ms - DataArrivalTimer: 463.675ms SenderSide: - DeserializeRowBatchTimer: 106.472us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s119ms, non-child: 4s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/3.92 GB 7:16/3.89 GB 2:15/3.50 GB 1:8/1.82 GB 0:13/3.16 GB 6:15/3.38 GB 3:20/4.69 GB 4:24/5.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s034ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(2s000ms): 0, 0, 38.43 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB, 76.87 MB - FooterProcessingTime: (Avg: 2.790ms ; Min: 2.626ms ; Max: 2.954ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.97 - BytesRead: 76.87 MB (80601915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.87 MB (80601915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.87 MB (80601915) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 395.909ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 103.51 MB (108542533) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.586ms - RowBatchQueuePutWaitTime: 3m52s - RowsRead: 8.97M (8966098) - RowsReturned: 8.97M (8965260) - RowsReturnedRate: 2.18 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 15.42K (15419) - ScannerThreadsTotalWallClockTime: 6m19s - MaterializeTupleTime(*): 1s390ms - ScannerThreadsSysTime: 8s452ms - ScannerThreadsUserTime: 2m9s - ScannerThreadsVoluntaryContextSwitches: 951.96K (951956) - TotalRawHdfsReadTime(*): 72.141ms - TotalReadThroughput: 617.35 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.61K (33606) - Rows rejected: 838 (838) - Rows total: 8.97M (8966098) Filter 5 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 8.97M (8965260) Filter 6 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 8.97M (8965260) Filter 7 (2.00 MB): - Rows processed: 20.48K (20480) - Rows rejected: 0 (0) - Rows total: 8.97M (8965260) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 8.97M (8965260) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 8.76K (8755) - RowGroups rejected: 0 (0) - RowGroups total: 8.76K (8755) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 8.97M (8965260) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000f3 (host=foo.234.44:22000):(Total: 2m8s, non-child: 1m38s, % non-child: 76.47%) Hdfs split stats (:<# splits>/): 5:20/4.95 GB 4:17/4.08 GB 2:7/1.66 GB 1:16/3.89 GB 6:14/3.31 GB 0:15/3.09 GB 3:17/3.84 GB 7:22/5.27 GB Filter 0 arrival: 412ms Filter 9 arrival: 723ms Filter 8 arrival: 18s596ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(4s000ms): 4.20 MB, 201.40 MB, 243.54 MB, 243.51 MB, 251.51 MB, 263.00 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.08 MB, 263.35 MB, 263.48 MB, 263.39 MB, 263.49 MB, 262.64 MB, 247.69 MB, 247.50 MB, 247.62 MB, 213.89 MB, 175.21 MB ThreadUsage(4s000ms): 2, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 5.00 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 266.90 MB (279860356) - PerHostPeakMemUsage: 1.08 GB (1164601842) - RowsProduced: 9.41M (9413624) - TotalNetworkReceiveTime: 17s932ms - TotalNetworkSendTime: 1m31s - TotalStorageWaitTime: 68.191ms - TotalThreadsInvoluntaryContextSwitches: 29.29K (29286) - TotalThreadsTotalWallClockTime: 10m44s - TotalThreadsSysTime: 37s955ms - TotalThreadsUserTime: 3m47s - TotalThreadsVoluntaryContextSwitches: 3.69M (3688345) Fragment Instance Lifecycle Timings: - ExecTime: 1m50s - ExecTreeExecTime: 1s570ms - OpenTime: 18s597ms - ExecTreeOpenTime: 18s063ms - PrepareTime: 40.883ms - ExecTreePrepareTime: 1.735ms DataStreamSender (dst_id=19):(Total: 10s094ms, non-child: 10s094ms, % non-child: 100.00%) - BytesSent: 1.27 GB (1366529006) - OverallThroughput: 129.10 MB/sec - PeakMemoryUsage: 7.97 MB (8359968) - RowsReturned: 9.41M (9413624) - SerializeBatchTime: 10s085ms - UncompressedRowBatchSize: 1.27 GB (1366529006) CodeGen:(Total: 558.797ms, non-child: 558.797ms, % non-child: 100.00%) - CodegenTime: 1.772ms - CompileTime: 170.151ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 363.006ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 25.095ms HASH_JOIN_NODE (id=9):(Total: 19s629ms, non-child: 1s431ms, % non-child: 7.29%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 257.345ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 9.41M (9413624) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s182ms - RowsReturned: 9.41M (9413624) - RowsReturnedRate: 479.58 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 217.926ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 374.828us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.562ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s795ms, non-child: 17.732ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.653ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.96 K/sec RecvrSide: BytesReceived(4s000ms): 382.02 KB, 12.19 MB, 27.48 MB, 30.94 MB, 32.82 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s513ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s780ms - DataArrivalTimer: 17s777ms SenderSide: - DeserializeRowBatchTimer: 271.650ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 5s000ms, non-child: 300.192ms, % non-child: 6.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 380.400us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 9.41M (9413624) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 278.906ms - RowsReturned: 9.41M (9413624) - RowsReturnedRate: 1.88 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.300us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 105.999us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.375us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 151.467ms, non-child: 13.010us, % non-child: 0.01%) - ConvertRowBatchTime: 2.993us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 600.00 /sec RecvrSide: BytesReceived(4s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 151.457ms - DataArrivalTimer: 151.455ms SenderSide: - DeserializeRowBatchTimer: 143.681us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s549ms, non-child: 4s549ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:20/4.95 GB 4:17/4.08 GB 2:7/1.66 GB 1:16/3.89 GB 6:14/3.31 GB 0:15/3.09 GB 3:17/3.84 GB 7:22/5.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s354ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:126 PARQUET/SNAPPY:10 BytesRead(2s000ms): 0, 0, 40.91 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB, 81.82 MB - FooterProcessingTime: (Avg: 2.829ms ; Min: 2.802ms ; Max: 2.856ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.91 - BytesRead: 81.82 MB (85796063) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.82 MB (85796063) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.82 MB (85796063) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 404.168ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.50 MB (109576617) - PerReadThreadRawHdfsThroughput: 856.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.339ms - RowBatchQueuePutWaitTime: 3m56s - RowsRead: 9.41M (9414467) - RowsReturned: 9.41M (9413624) - RowsReturnedRate: 2.07 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 26.86K (26862) - ScannerThreadsTotalWallClockTime: 8m17s - MaterializeTupleTime(*): 1s500ms - ScannerThreadsSysTime: 37s234ms - ScannerThreadsUserTime: 3m29s - ScannerThreadsVoluntaryContextSwitches: 3.68M (3679014) - TotalRawHdfsReadTime(*): 95.489ms - TotalReadThroughput: 657.14 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.61K (33611) - Rows rejected: 843 (843) - Rows total: 9.41M (9414467) Filter 5 (2.00 MB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 9.41M (9413624) Filter 6 (2.00 MB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 9.41M (9413624) Filter 7 (2.00 MB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 9.41M (9413624) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 9.41M (9413624) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 126 (126) - Files total: 128 (128) - RowGroups processed: 9.19K (9193) - RowGroups rejected: 0 (0) - RowGroups total: 9.19K (9193) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.41M (9413624) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000f9 (host=foo.221.19:22000):(Total: 2m7s, non-child: 1m40s, % non-child: 79.04%) Hdfs split stats (:<# splits>/): 6:16/3.80 GB 2:17/3.82 GB 1:20/4.45 GB 0:14/3.10 GB 5:14/3.47 GB 3:14/3.47 GB 4:18/4.38 GB 7:16/3.94 GB Filter 9 arrival: 1s549ms Filter 0 arrival: 1s917ms Filter 8 arrival: 21s153ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(2s000ms): 2.04 MB, 1.66 MB, 31.79 MB, 157.22 MB, 189.21 MB, 189.22 MB, 189.22 MB, 189.22 MB, 189.21 MB, 189.22 MB, 196.82 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.76 MB, 211.25 MB, 210.40 MB, 209.45 MB, 209.26 MB, 209.20 MB, 209.11 MB, 209.27 MB, 209.09 MB, 209.30 MB, 201.26 MB, 201.29 MB, 201.26 MB, 201.25 MB, 201.29 MB, 201.37 MB, 199.42 MB, 193.28 MB, 185.43 MB ThreadUsage(2s000ms): 2, 2, 2, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.12 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 212.62 MB (222952577) - PerHostPeakMemUsage: 1.03 GB (1102464445) - RowsProduced: 4.18M (4177840) - TotalNetworkReceiveTime: 21s419ms - TotalNetworkSendTime: 1m36s - TotalStorageWaitTime: 27.607ms - TotalThreadsInvoluntaryContextSwitches: 1.79K (1794) - TotalThreadsTotalWallClockTime: 4m29s - TotalThreadsSysTime: 543.917ms - TotalThreadsUserTime: 10s242ms - TotalThreadsVoluntaryContextSwitches: 9.93K (9925) Fragment Instance Lifecycle Timings: - ExecTime: 1m46s - ExecTreeExecTime: 784.679ms - OpenTime: 21s159ms - ExecTreeOpenTime: 20s689ms - PrepareTime: 43.595ms - ExecTreePrepareTime: 1.271ms DataStreamSender (dst_id=19):(Total: 4s729ms, non-child: 4s729ms, % non-child: 100.00%) - BytesSent: 575.16 MB (603099471) - OverallThroughput: 121.62 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 4.18M (4177840) - SerializeBatchTime: 4s724ms - UncompressedRowBatchSize: 575.16 MB (603099471) CodeGen:(Total: 498.922ms, non-child: 498.922ms, % non-child: 100.00%) - CodegenTime: 1.878ms - CompileTime: 156.569ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 312.143ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 29.351ms HASH_JOIN_NODE (id=9):(Total: 21s472ms, non-child: 893.541ms, % non-child: 4.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 282.205ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 4.18M (4177840) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 595.334ms - RowsReturned: 4.18M (4177840) - RowsReturnedRate: 194.56 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 233.229ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 385.393us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.011ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s396ms, non-child: 19.167ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.477ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.65 K/sec RecvrSide: BytesReceived(2s000ms): 0, 0, 1.20 MB, 7.74 MB, 19.65 MB, 27.07 MB, 28.70 MB, 30.44 MB, 32.05 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s121ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s380ms - DataArrivalTimer: 20s377ms SenderSide: - DeserializeRowBatchTimer: 179.679ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s760ms, non-child: 148.038ms, % non-child: 3.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 498.412us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 4.18M (4177840) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.122ms - RowsReturned: 4.18M (4177840) - RowsReturnedRate: 877.62 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 68.975us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 107.247us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 89.746us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s038ms, non-child: 12.855us, % non-child: 0.00%) - ConvertRowBatchTime: 3.728us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 87.00 /sec RecvrSide: BytesReceived(2s000ms): 875.00 B, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s038ms - DataArrivalTimer: 1s038ms SenderSide: - DeserializeRowBatchTimer: 118.546us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s574ms, non-child: 3s574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:16/3.80 GB 2:17/3.82 GB 1:20/4.45 GB 0:14/3.10 GB 5:14/3.47 GB 3:14/3.47 GB 4:18/4.38 GB 7:16/3.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s511ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:5 BytesRead(2s000ms): 0, 0, 18.83 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB, 37.65 MB - FooterProcessingTime: (Avg: 3.288ms ; Min: 3.288ms ; Max: 3.288ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.96 - BytesRead: 37.65 MB (39481162) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.65 MB (39481162) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.65 MB (39481162) - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 193.419ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 50.18 MB (52614829) - PerReadThreadRawHdfsThroughput: 991.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.604ms - RowBatchQueuePutWaitTime: 1m59s - RowsRead: 4.18M (4178215) - RowsReturned: 4.18M (4177840) - RowsReturnedRate: 1.17 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 370 (370) - ScannerThreadsTotalWallClockTime: 2m - MaterializeTupleTime(*): 650.122ms - ScannerThreadsSysTime: 117.982ms - ScannerThreadsUserTime: 881.865ms - ScannerThreadsVoluntaryContextSwitches: 4.01K (4012) - TotalRawHdfsReadTime(*): 37.978ms - TotalReadThroughput: 306.00 KB/sec Filter 0 (8.00 KB): - Rows processed: 16.76K (16759) - Rows rejected: 375 (375) - Rows total: 4.18M (4178215) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 4.18M (4177840) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 4.18M (4177840) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 4.18M (4177840) Filter 8 (256.00 KB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 4.18M (4177840) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 128 (128) - Files total: 129 (129) - RowGroups processed: 4.08K (4080) - RowGroups rejected: 0 (0) - RowGroups total: 4.08K (4080) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 4.18M (4177840) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce180000009f (host=foo.246.49:22000):(Total: 2m5s, non-child: 1m36s, % non-child: 76.44%) Hdfs split stats (:<# splits>/): 6:9/2.13 GB 1:17/3.95 GB 5:12/2.81 GB 2:24/5.90 GB 4:16/3.62 GB 7:11/2.34 GB 3:16/3.84 GB 0:24/5.77 GB Filter 0 arrival: 279ms Filter 9 arrival: 607ms Filter 8 arrival: 18s647ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(2s000ms): 2.05 MB, 4.36 MB, 158.80 MB, 242.61 MB, 242.50 MB, 242.53 MB, 242.53 MB, 242.53 MB, 242.53 MB, 253.80 MB, 262.52 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.40 MB, 262.56 MB, 262.58 MB, 262.65 MB, 262.56 MB, 262.56 MB, 262.38 MB, 262.59 MB, 262.44 MB, 256.50 MB, 246.42 MB, 246.65 MB, 246.51 MB, 246.74 MB, 238.54 MB, 209.28 MB, 205.33 MB, 205.38 MB, 94.06 MB ThreadUsage(2s000ms): 1, 4, 6, 6, 6, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 4.10 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 265.87 MB (278783068) - PerHostPeakMemUsage: 1.08 GB (1163706707) - RowsProduced: 8.80M (8803199) - TotalNetworkReceiveTime: 17s798ms - TotalNetworkSendTime: 1m28s - TotalStorageWaitTime: 55.075ms - TotalThreadsInvoluntaryContextSwitches: 17.04K (17035) - TotalThreadsTotalWallClockTime: 8m36s - TotalThreadsSysTime: 4s529ms - TotalThreadsUserTime: 2m26s - TotalThreadsVoluntaryContextSwitches: 369.83K (369830) Fragment Instance Lifecycle Timings: - ExecTime: 1m47s - ExecTreeExecTime: 1s545ms - OpenTime: 18s635ms - ExecTreeOpenTime: 18s080ms - PrepareTime: 57.488ms - ExecTreePrepareTime: 1.462ms DataStreamSender (dst_id=19):(Total: 9s407ms, non-child: 9s407ms, % non-child: 100.00%) - BytesSent: 1.19 GB (1280207400) - OverallThroughput: 129.77 MB/sec - PeakMemoryUsage: 7.94 MB (8327200) - RowsReturned: 8.80M (8803199) - SerializeBatchTime: 9s399ms - UncompressedRowBatchSize: 1.19 GB (1280207400) CodeGen:(Total: 587.196ms, non-child: 587.196ms, % non-child: 100.00%) - CodegenTime: 4.498ms - CompileTime: 190.711ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 362.057ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.831ms HASH_JOIN_NODE (id=9):(Total: 19s621ms, non-child: 1s411ms, % non-child: 7.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 257.566ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 8.80M (8803199) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s165ms - RowsReturned: 8.80M (8803199) - RowsReturnedRate: 448.65 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 216.470ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 518.546us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.172ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s812ms, non-child: 16.924ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.476ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.94 K/sec RecvrSide: BytesReceived(2s000ms): 0, 559.88 KB, 6.05 MB, 17.49 MB, 26.19 MB, 28.37 MB, 29.97 MB, 31.77 MB, 32.72 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s339ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s797ms - DataArrivalTimer: 17s795ms SenderSide: - DeserializeRowBatchTimer: 174.898ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s835ms, non-child: 294.511ms, % non-child: 6.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 591.251us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 8.80M (8803199) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 274.806ms - RowsReturned: 8.80M (8803199) - RowsReturnedRate: 1.82 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.939us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 205.330us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 57.179us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 13.424us, non-child: 13.424us, % non-child: 100.00%) - ConvertRowBatchTime: 4.794us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 6.78 M/sec RecvrSide: BytesReceived(2s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.790us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 16.444us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s541ms, non-child: 4s541ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:9/2.13 GB 1:17/3.95 GB 5:12/2.81 GB 2:24/5.90 GB 4:16/3.62 GB 7:11/2.34 GB 3:16/3.84 GB 0:24/5.77 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s455ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:10 BytesRead(2s000ms): 0, 0, 38.88 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB, 77.76 MB - FooterProcessingTime: (Avg: 2.122ms ; Min: 2.078ms ; Max: 2.166ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.99 - BytesRead: 77.76 MB (81534957) - BytesReadDataNodeCache: 0 - BytesReadLocal: 77.76 MB (81534957) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 77.76 MB (81534957) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 379.492ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 103.50 MB (108530005) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.119ms - RowBatchQueuePutWaitTime: 3m50s - RowsRead: 8.80M (8804018) - RowsReturned: 8.80M (8803199) - RowsReturnedRate: 1.94 M/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 14.71K (14706) - ScannerThreadsTotalWallClockTime: 6m12s - MaterializeTupleTime(*): 1s307ms - ScannerThreadsSysTime: 3s879ms - ScannerThreadsUserTime: 2m9s - ScannerThreadsVoluntaryContextSwitches: 361.25K (361249) - TotalRawHdfsReadTime(*): 74.780ms - TotalReadThroughput: 636.99 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.59K (33587) - Rows rejected: 819 (819) - Rows total: 8.80M (8804018) Filter 5 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 8.80M (8803199) Filter 6 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 8.80M (8803199) Filter 7 (2.00 MB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 8.80M (8803199) Filter 8 (256.00 KB): - Rows processed: 5.12K (5120) - Rows rejected: 0 (0) - Rows total: 8.80M (8803199) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 127 (127) - Files total: 129 (129) - RowGroups processed: 8.60K (8596) - RowGroups rejected: 0 (0) - RowGroups total: 8.60K (8596) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 8.80M (8803199) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000da (host=foo.221.27:22000):(Total: 2m5s, non-child: 1m37s, % non-child: 77.54%) Hdfs split stats (:<# splits>/): 4:11/2.57 GB 5:18/4.24 GB 2:11/2.70 GB 3:15/3.60 GB 6:13/3.00 GB 7:13/2.99 GB 0:24/5.94 GB 1:23/5.36 GB Filter 0 arrival: 1s903ms Filter 9 arrival: 2s009ms Filter 8 arrival: 21s499ms Filter 6 arrival: 1m29s Filter 5 arrival: 1m29s Filter 7 arrival: 1m29s MemoryUsage(2s000ms): 2.04 MB, 1.66 MB, 40.33 MB, 202.22 MB, 202.22 MB, 202.22 MB, 202.22 MB, 202.22 MB, 202.20 MB, 202.22 MB, 207.92 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 225.00 MB, 223.94 MB, 222.69 MB, 222.28 MB, 222.19 MB, 222.38 MB, 222.26 MB, 220.35 MB, 214.38 MB, 214.29 MB, 214.23 MB, 214.40 MB, 214.14 MB, 212.15 MB, 206.29 MB, 206.55 MB, 206.34 MB, 204.36 MB ThreadUsage(2s000ms): 2, 2, 5, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.00 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 225.54 MB (236492508) - PerHostPeakMemUsage: 1.03 GB (1108136549) - RowsProduced: 5.28M (5279709) - TotalNetworkReceiveTime: 22s237ms - TotalNetworkSendTime: 1m32s - TotalStorageWaitTime: 28.496ms - TotalThreadsInvoluntaryContextSwitches: 40.12K (40118) - TotalThreadsTotalWallClockTime: 10m26s - TotalThreadsSysTime: 2m1s - TotalThreadsUserTime: 3m50s - TotalThreadsVoluntaryContextSwitches: 12.03M (12029849) Fragment Instance Lifecycle Timings: - ExecTime: 1m44s - ExecTreeExecTime: 961.781ms - OpenTime: 21s505ms - ExecTreeOpenTime: 21s028ms - PrepareTime: 50.862ms - ExecTreePrepareTime: 1.515ms DataStreamSender (dst_id=19):(Total: 5s720ms, non-child: 5s720ms, % non-child: 100.00%) - BytesSent: 727.24 MB (762567348) - OverallThroughput: 127.13 MB/sec - PeakMemoryUsage: 7.91 MB (8294432) - RowsReturned: 5.28M (5279709) - SerializeBatchTime: 5s715ms - UncompressedRowBatchSize: 727.24 MB (762567348) CodeGen:(Total: 504.040ms, non-child: 504.040ms, % non-child: 100.00%) - CodegenTime: 1.853ms - CompileTime: 153.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 322.362ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.296ms HASH_JOIN_NODE (id=9):(Total: 21s987ms, non-child: 981.182ms, % non-child: 4.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 257.867ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 5.28M (5279709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 704.229ms - RowsReturned: 5.28M (5279709) - RowsReturnedRate: 240.12 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 211.880ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 564.976us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.163ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s759ms, non-child: 18.696ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.905ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.25 K/sec RecvrSide: BytesReceived(2s000ms): 0, 0, 1.57 MB, 8.85 MB, 20.80 MB, 27.25 MB, 28.76 MB, 30.47 MB, 32.15 MB, 32.79 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 4s060ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s745ms - DataArrivalTimer: 20s741ms SenderSide: - DeserializeRowBatchTimer: 167.949ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s815ms, non-child: 203.570ms, % non-child: 4.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 630.787us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 5.28M (5279709) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 190.996ms - RowsReturned: 5.28M (5279709) - RowsReturnedRate: 1.10 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.095us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 132.768us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 96.195us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 1s491ms, non-child: 12.385us, % non-child: 0.00%) - ConvertRowBatchTime: 3.342us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 61.00 /sec RecvrSide: BytesReceived(2s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 1s491ms - DataArrivalTimer: 1s491ms SenderSide: - DeserializeRowBatchTimer: 21.827us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s120ms, non-child: 3s120ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:11/2.57 GB 5:18/4.24 GB 2:11/2.70 GB 3:15/3.60 GB 6:13/3.00 GB 7:13/2.99 GB 0:24/5.94 GB 1:23/5.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 3s050ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:5 BytesRead(2s000ms): 0, 0, 24.31 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB, 48.62 MB - FooterProcessingTime: (Avg: 2.520ms ; Min: 2.520ms ; Max: 2.520ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 48.62 MB (50976613) - BytesReadDataNodeCache: 0 - BytesReadLocal: 48.62 MB (50976613) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 48.62 MB (50976613) - CachedFileHandlesHitCount: 9 (9) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 244.146ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 63.18 MB (66248582) - PerReadThreadRawHdfsThroughput: 991.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.983ms - RowBatchQueuePutWaitTime: 1m58s - RowsRead: 5.28M (5280112) - RowsReturned: 5.28M (5279709) - RowsReturnedRate: 1.69 M/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 38.53K (38526) - ScannerThreadsTotalWallClockTime: 7m58s - MaterializeTupleTime(*): 776.424ms - ScannerThreadsSysTime: 2m - ScannerThreadsUserTime: 3m39s - ScannerThreadsVoluntaryContextSwitches: 12.02M (12023649) - TotalRawHdfsReadTime(*): 49.012ms - TotalReadThroughput: 399.85 KB/sec Filter 0 (8.00 KB): - Rows processed: 16.79K (16787) - Rows rejected: 403 (403) - Rows total: 5.28M (5280112) Filter 5 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 5.28M (5279709) Filter 6 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 5.28M (5279709) Filter 7 (2.00 MB): - Rows processed: 14.34K (14336) - Rows rejected: 0 (0) - Rows total: 5.28M (5279709) Filter 8 (256.00 KB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 5.28M (5279709) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 127 (127) - Files total: 128 (128) - RowGroups processed: 5.16K (5156) - RowGroups rejected: 0 (0) - RowGroups total: 5.16K (5156) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 5.28M (5279709) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce18000000c6 (host=foo.246.51:22000):(Total: 2m4s, non-child: 1m34s, % non-child: 75.77%) Hdfs split stats (:<# splits>/): 4:15/3.62 GB 3:9/2.15 GB 2:16/3.26 GB 5:20/4.68 GB 7:23/5.29 GB 0:21/4.85 GB 1:10/2.45 GB 6:18/3.70 GB Filter 0 arrival: 309ms Filter 9 arrival: 495ms Filter 8 arrival: 18s711ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(2s000ms): 2.05 MB, 6.36 MB, 159.29 MB, 243.54 MB, 243.51 MB, 243.51 MB, 243.51 MB, 243.49 MB, 243.51 MB, 259.25 MB, 263.88 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 264.07 MB, 263.65 MB, 263.49 MB, 263.33 MB, 263.45 MB, 263.51 MB, 263.51 MB, 263.59 MB, 263.63 MB, 251.64 MB, 247.71 MB, 247.67 MB, 247.61 MB, 247.62 MB, 247.72 MB, 212.09 MB, 205.42 MB, 194.36 MB ThreadUsage(2s000ms): 3, 6, 6, 6, 6, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 3 - AverageThreadTokens: 4.19 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 266.98 MB (279948650) - PerHostPeakMemUsage: 1.07 GB (1151591290) - RowsProduced: 9.31M (9306478) - TotalNetworkReceiveTime: 17s973ms - TotalNetworkSendTime: 1m27s - TotalStorageWaitTime: 76.032ms - TotalThreadsInvoluntaryContextSwitches: 16.72K (16716) - TotalThreadsTotalWallClockTime: 8m39s - TotalThreadsSysTime: 3s850ms - TotalThreadsUserTime: 2m25s - TotalThreadsVoluntaryContextSwitches: 222.80K (222801) Fragment Instance Lifecycle Timings: - ExecTime: 1m45s - ExecTreeExecTime: 1s562ms - OpenTime: 18s715ms - ExecTreeOpenTime: 18s260ms - PrepareTime: 42.954ms - ExecTreePrepareTime: 1.204ms DataStreamSender (dst_id=19):(Total: 9s827ms, non-child: 9s827ms, % non-child: 100.00%) - BytesSent: 1.26 GB (1353087554) - OverallThroughput: 131.30 MB/sec - PeakMemoryUsage: 8.07 MB (8458272) - RowsReturned: 9.31M (9306478) - SerializeBatchTime: 9s817ms - UncompressedRowBatchSize: 1.26 GB (1353087554) CodeGen:(Total: 482.742ms, non-child: 482.742ms, % non-child: 100.00%) - CodegenTime: 1.664ms - CompileTime: 144.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 310.362ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 27.831ms HASH_JOIN_NODE (id=9):(Total: 19s815ms, non-child: 1s423ms, % non-child: 7.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 260.854ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.04 MB (161519360) - ProbeRows: 9.31M (9306478) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s169ms - RowsReturned: 9.31M (9306478) - RowsReturnedRate: 469.65 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 214.911ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 917.943us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.408ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 17s987ms, non-child: 17.342ms, % non-child: 0.10%) - ConvertRowBatchTime: 12.675ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 25.68 K/sec RecvrSide: BytesReceived(2s000ms): 0, 839.87 KB, 6.67 MB, 18.42 MB, 26.59 MB, 28.45 MB, 30.10 MB, 31.87 MB, 32.76 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s483ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 17s973ms - DataArrivalTimer: 17s970ms SenderSide: - DeserializeRowBatchTimer: 175.110ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s977ms, non-child: 302.465ms, % non-child: 6.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 343.825us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084992) - ProbeRows: 9.31M (9306478) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 282.357ms - RowsReturned: 9.31M (9306478) - RowsReturnedRate: 1.87 M/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 20.254us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 117.563us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.212us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 11.871us, non-child: 11.871us, % non-child: 100.00%) - ConvertRowBatchTime: 3.936us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 7.67 M/sec RecvrSide: BytesReceived(2s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 2.308us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTimer: 98.710us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s675ms, non-child: 4s675ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:15/3.62 GB 3:9/2.15 GB 2:16/3.26 GB 5:20/4.68 GB 7:23/5.29 GB 0:21/4.85 GB 1:10/2.45 GB 6:18/3.70 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s576ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:130 PARQUET/SNAPPY:10 BytesRead(2s000ms): 0, 0, 40.73 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB - FooterProcessingTime: (Avg: 2.799ms ; Min: 2.739ms ; Max: 2.859ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.05 - BytesRead: 81.45 MB (85410572) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.45 MB (85410572) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.45 MB (85410572) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 404.350ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.50 MB (109575579) - PerReadThreadRawHdfsThroughput: 776.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.869ms - RowBatchQueuePutWaitTime: 3m50s - RowsRead: 9.31M (9307194) - RowsReturned: 9.31M (9306478) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 14.34K (14340) - ScannerThreadsTotalWallClockTime: 6m17s - MaterializeTupleTime(*): 1s409ms - ScannerThreadsSysTime: 3s190ms - ScannerThreadsUserTime: 2m7s - ScannerThreadsVoluntaryContextSwitches: 214.19K (214186) - TotalRawHdfsReadTime(*): 104.883ms - TotalReadThroughput: 672.65 KB/sec Filter 0 (8.00 KB): - Rows processed: 33.48K (33484) - Rows rejected: 716 (716) - Rows total: 9.31M (9307194) Filter 5 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.31M (9306478) Filter 6 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.31M (9306478) Filter 7 (2.00 MB): - Rows processed: 12.29K (12288) - Rows rejected: 0 (0) - Rows total: 9.31M (9306478) Filter 8 (256.00 KB): - Rows processed: 21.50K (21504) - Rows rejected: 0 (0) - Rows total: 9.31M (9306478) Filter 9 (8.00 KB): - Files processed: 132 (132) - Files rejected: 130 (130) - Files total: 132 (132) - RowGroups processed: 9.09K (9088) - RowGroups rejected: 0 (0) - RowGroups total: 9.09K (9088) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.31M (9306478) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce18000000dc (host=foo.246.48:22000):(Total: 1m49s, non-child: 1m24s, % non-child: 76.80%) Hdfs split stats (:<# splits>/): 7:11/2.50 GB 3:15/3.57 GB 5:15/3.45 GB 6:14/3.47 GB 1:16/3.86 GB 2:13/3.16 GB 4:18/4.30 GB 0:26/6.10 GB Filter 0 arrival: 299ms Filter 9 arrival: 609ms Filter 8 arrival: 20s840ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(2s000ms): 1.40 MB, 6.36 MB, 133.13 MB, 191.24 MB, 191.19 MB, 191.20 MB, 191.21 MB, 191.20 MB, 191.19 MB, 191.20 MB, 206.74 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 212.07 MB, 211.70 MB, 211.33 MB, 211.37 MB, 211.28 MB, 211.26 MB, 205.36 MB, 203.11 MB, 203.21 MB, 203.24 MB ThreadUsage(2s000ms): 1, 3, 6, 6, 6, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.14 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 214.49 MB (224912537) - PerHostPeakMemUsage: 1.04 GB (1111365185) - RowsProduced: 3.89M (3888911) - TotalNetworkReceiveTime: 20s122ms - TotalNetworkSendTime: 1m21s - TotalStorageWaitTime: 31.999ms - TotalThreadsInvoluntaryContextSwitches: 23.73K (23730) - TotalThreadsTotalWallClockTime: 7m33s - TotalThreadsSysTime: 20s263ms - TotalThreadsUserTime: 3m18s - TotalThreadsVoluntaryContextSwitches: 2.50M (2496461) Fragment Instance Lifecycle Timings: - ExecTime: 1m29s - ExecTreeExecTime: 650.364ms - OpenTime: 20s834ms - ExecTreeOpenTime: 20s336ms - PrepareTime: 47.882ms - ExecTreePrepareTime: 1.623ms DataStreamSender (dst_id=19):(Total: 3s979ms, non-child: 3s979ms, % non-child: 100.00%) - BytesSent: 535.89 MB (561922887) - OverallThroughput: 134.66 MB/sec - PeakMemoryUsage: 7.89 MB (8278048) - RowsReturned: 3.89M (3888911) - SerializeBatchTime: 3s975ms - UncompressedRowBatchSize: 535.89 MB (561922887) CodeGen:(Total: 529.950ms, non-child: 529.950ms, % non-child: 100.00%) - CodegenTime: 1.761ms - CompileTime: 184.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 311.590ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 32.992ms HASH_JOIN_NODE (id=9):(Total: 20s986ms, non-child: 719.952ms, % non-child: 3.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 254.958ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 3.89M (3888911) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 488.800ms - RowsReturned: 3.89M (3888911) - RowsReturnedRate: 185.30 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 216.507ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 530.708us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.463ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s069ms, non-child: 17.093ms, % non-child: 0.09%) - ConvertRowBatchTime: 12.801ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 23.02 K/sec RecvrSide: BytesReceived(2s000ms): 0, 858.14 KB, 7.34 MB, 18.99 MB, 26.75 MB, 28.50 MB, 30.16 MB, 31.91 MB, 32.74 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s429ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s055ms - DataArrivalTimer: 20s052ms SenderSide: - DeserializeRowBatchTimer: 179.247ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s713ms, non-child: 123.906ms, % non-child: 2.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 495.960us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 3.89M (3888911) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 115.247ms - RowsReturned: 3.89M (3888911) - RowsReturnedRate: 825.02 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.945us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 176.744us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 67.638us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 66.575ms, non-child: 10.954us, % non-child: 0.02%) - ConvertRowBatchTime: 3.470us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 1.37 K/sec RecvrSide: BytesReceived(2s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 66.567ms - DataArrivalTimer: 66.565ms SenderSide: - DeserializeRowBatchTimer: 135.703us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s523ms, non-child: 4s523ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:11/2.50 GB 3:15/3.57 GB 5:15/3.45 GB 6:14/3.47 GB 1:16/3.86 GB 2:13/3.16 GB 4:18/4.30 GB 0:26/6.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s457ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:5 BytesRead(2s000ms): 0, 0, 18.80 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB, 37.61 MB - FooterProcessingTime: (Avg: 3.578ms ; Min: 3.578ms ; Max: 3.578ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.98 - BytesRead: 37.61 MB (39431845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.61 MB (39431845) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.61 MB (39431845) - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 182.855ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 52.18 MB (54716285) - PerReadThreadRawHdfsThroughput: 839.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.219ms - RowBatchQueuePutWaitTime: 1m43s - RowsRead: 3.89M (3889282) - RowsReturned: 3.89M (3888911) - RowsReturnedRate: 859.76 K/sec - ScanRangesComplete: 128 (128) - ScannerThreadsInvoluntaryContextSwitches: 22.75K (22747) - ScannerThreadsTotalWallClockTime: 5m23s - MaterializeTupleTime(*): 569.320ms - ScannerThreadsSysTime: 19s912ms - ScannerThreadsUserTime: 3m10s - ScannerThreadsVoluntaryContextSwitches: 2.49M (2492210) - TotalRawHdfsReadTime(*): 44.790ms - TotalReadThroughput: 353.28 KB/sec Filter 0 (8.00 KB): - Rows processed: 16.75K (16755) - Rows rejected: 371 (371) - Rows total: 3.89M (3889282) Filter 5 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 3.89M (3888911) Filter 6 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 3.89M (3888911) Filter 7 (2.00 MB): - Rows processed: 3.07K (3072) - Rows rejected: 0 (0) - Rows total: 3.89M (3888911) Filter 8 (256.00 KB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 3.89M (3888911) Filter 9 (8.00 KB): - Files processed: 128 (128) - Files rejected: 127 (127) - Files total: 128 (128) - RowGroups processed: 3.80K (3798) - RowGroups rejected: 0 (0) - RowGroups total: 3.80K (3798) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 3.89M (3888911) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce180000009e (host=foo.234.45:22000):(Total: 1m48s, non-child: 1m22s, % non-child: 76.22%) Hdfs split stats (:<# splits>/): 0:10/2.46 GB 6:14/3.23 GB 5:16/3.96 GB 2:20/4.69 GB 7:15/3.42 GB 4:24/5.53 GB 1:15/3.71 GB 3:15/3.22 GB Filter 0 arrival: 604ms Filter 9 arrival: 942ms Filter 8 arrival: 21s344ms Filter 5 arrival: 1m28s Filter 6 arrival: 1m28s Filter 7 arrival: 1m28s MemoryUsage(2s000ms): 1.40 MB, 4.36 MB, 101.14 MB, 191.23 MB, 191.20 MB, 191.23 MB, 191.23 MB, 191.23 MB, 191.23 MB, 191.23 MB, 202.67 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 214.10 MB, 212.18 MB, 211.12 MB, 211.27 MB, 211.29 MB, 203.42 MB, 203.08 MB, 203.31 MB, 203.22 MB, 189.51 MB ThreadUsage(2s000ms): 1, 4, 6, 6, 6, 4, 4, 4, 4, 4, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 3.25 - BloomFilterBytes: 272.00 KB (278528) - PeakMemoryUsage: 214.64 MB (225061251) - PerHostPeakMemUsage: 1.03 GB (1105528255) - RowsProduced: 3.89M (3894176) - TotalNetworkReceiveTime: 21s003ms - TotalNetworkSendTime: 1m20s - TotalStorageWaitTime: 24.438ms - TotalThreadsInvoluntaryContextSwitches: 13.50K (13504) - TotalThreadsTotalWallClockTime: 5m54s - TotalThreadsSysTime: 7s071ms - TotalThreadsUserTime: 1m53s - TotalThreadsVoluntaryContextSwitches: 615.09K (615093) Fragment Instance Lifecycle Timings: - ExecTime: 1m27s - ExecTreeExecTime: 596.579ms - OpenTime: 21s346ms - ExecTreeOpenTime: 20s871ms - PrepareTime: 44.067ms - ExecTreePrepareTime: 1.374ms DataStreamSender (dst_id=19):(Total: 3s877ms, non-child: 3s877ms, % non-child: 100.00%) - BytesSent: 533.82 MB (559746433) - OverallThroughput: 137.66 MB/sec - PeakMemoryUsage: 8.00 MB (8392736) - RowsReturned: 3.89M (3894176) - SerializeBatchTime: 3s874ms - UncompressedRowBatchSize: 533.82 MB (559746433) CodeGen:(Total: 502.981ms, non-child: 502.981ms, % non-child: 100.00%) - CodegenTime: 1.786ms - CompileTime: 156.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 117 (117) - NumInstructions: 5.30K (5296) - OptimizationTime: 317.345ms - PeakMemoryUsage: 2.59 MB (2711552) - PrepareTime: 28.552ms HASH_JOIN_NODE (id=9):(Total: 21s467ms, non-child: 703.274ms, % non-child: 3.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 462.00K (462000) - BuildTime: 267.575ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 154.07 MB (161553152) - ProbeRows: 3.89M (3894176) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 447.621ms - RowsReturned: 3.89M (3894176) - RowsReturnedRate: 181.40 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 223.137ms - BuildRowsPartitioned: 462.00K (462000) - GetNewBlockTime: 591.082us - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.263ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 153.02 MB (160453760) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 20s591ms, non-child: 18.647ms, % non-child: 0.09%) - ConvertRowBatchTime: 13.133ms - PeakMemoryUsage: 0 - RowsReturned: 462.00K (462000) - RowsReturnedRate: 22.44 K/sec RecvrSide: BytesReceived(2s000ms): 0, 542.08 KB, 5.95 MB, 17.16 MB, 26.05 MB, 28.28 MB, 29.87 MB, 31.71 MB, 32.63 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB, 32.90 MB - FirstBatchArrivalWaitTime: 2s760ms - TotalBytesReceived: 32.90 MB (34502843) - TotalGetBatchTime: 20s577ms - DataArrivalTimer: 20s573ms SenderSide: - DeserializeRowBatchTimer: 172.559ms - NumBatchesAccepted: 458 (458) - NumBatchesRejected: 0 (0) HASH_JOIN_NODE (id=8):(Total: 4s716ms, non-child: 111.048ms, % non-child: 2.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 91 (91) - BuildTime: 354.094us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.96 MB (2051200) - ProbeRows: 3.89M (3894176) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 102.034ms - RowsReturned: 3.89M (3894176) - RowsReturnedRate: 825.57 K/sec Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 43.785us - BuildRowsPartitioned: 91 (91) - GetNewBlockTime: 80.531us - HashBuckets: 216 (216) - HashCollisions: 0 (0) - HashTablesBuildTime: 72.414us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1069568) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=17):(Total: 425.957ms, non-child: 17.896us, % non-child: 0.00%) - ConvertRowBatchTime: 2.893us - PeakMemoryUsage: 0 - RowsReturned: 91 (91) - RowsReturnedRate: 213.00 /sec RecvrSide: BytesReceived(2s000ms): 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB, 1.14 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 1.14 KB (1167) - TotalGetBatchTime: 425.942ms - DataArrivalTimer: 425.940ms SenderSide: - DeserializeRowBatchTimer: 128.051us - NumBatchesAccepted: 1 (1) - NumBatchesRejected: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 4s180ms, non-child: 4s180ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:10/2.46 GB 6:14/3.23 GB 5:16/3.96 GB 2:20/4.69 GB 7:15/3.42 GB 4:24/5.53 GB 1:15/3.71 GB 3:15/3.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [0, 9], missing [5, 6, 7, 8]), waited for 4s117ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:128 PARQUET/SNAPPY:5 BytesRead(2s000ms): 0, 0, 19.43 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB, 38.85 MB - FooterProcessingTime: (Avg: 2.560ms ; Min: 2.560ms ; Max: 2.560ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.08 - BytesRead: 38.85 MB (40738125) - BytesReadDataNodeCache: 0 - BytesReadLocal: 38.85 MB (40738125) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 38.85 MB (40738125) - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 127.360ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 52.18 MB (54715983) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.266ms - RowBatchQueuePutWaitTime: 1m42s - RowsRead: 3.89M (3894585) - RowsReturned: 3.89M (3894176) - RowsReturnedRate: 931.60 K/sec - ScanRangesComplete: 129 (129) - ScannerThreadsInvoluntaryContextSwitches: 12.52K (12524) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 429.789ms - ScannerThreadsSysTime: 6s724ms - ScannerThreadsUserTime: 1m46s - ScannerThreadsVoluntaryContextSwitches: 610.52K (610518) - TotalRawHdfsReadTime(*): 35.049ms - TotalReadThroughput: 368.36 KB/sec Filter 0 (8.00 KB): - Rows processed: 16.79K (16793) - Rows rejected: 409 (409) - Rows total: 3.89M (3894585) Filter 5 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 3.89M (3894176) Filter 6 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 3.89M (3894176) Filter 7 (2.00 MB): - Rows processed: 15.36K (15360) - Rows rejected: 0 (0) - Rows total: 3.89M (3894176) Filter 8 (256.00 KB): - Rows processed: 6.14K (6144) - Rows rejected: 0 (0) - Rows total: 3.89M (3894176) Filter 9 (8.00 KB): - Files processed: 129 (129) - Files rejected: 128 (128) - Files total: 129 (129) - RowGroups processed: 3.80K (3803) - RowGroups rejected: 0 (0) - RowGroups total: 3.80K (3803) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 3.89M (3894176) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Averaged Fragment F02:(Total: 2s717ms, non-child: 2s638ms, % non-child: 97.07%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:2s745ms max:2s745ms mean: 2s745ms stddev:0.000ns execution rates: min:801.69 KB/sec max:801.69 KB/sec mean:801.69 KB/sec stddev:0.17 B/sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643496) - PerHostPeakMemUsage: 317.87 MB (333306281) - RowsProduced: 91 (91) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s420ms - TotalStorageWaitTime: 4.256ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 2s684ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 41.993ms - TotalThreadsVoluntaryContextSwitches: 192 (192) Fragment Instance Lifecycle Timings: - ExecTime: 2s643ms - ExecTreeExecTime: 8.839ms - OpenTime: 32.510ms - ExecTreeOpenTime: 64.673us - PrepareTime: 42.000ms - ExecTreePrepareTime: 128.578us DataStreamSender (dst_id=17):(Total: 146.742us, non-child: 146.742us, % non-child: 100.00%) - BytesSent: 147.01 KB (150543) - OverallThroughput: 978.38 MB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 91 (91) - SerializeBatchTime: 12.221us - UncompressedRowBatchSize: 147.01 KB (150543) CodeGen:(Total: 70.185ms, non-child: 70.185ms, % non-child: 100.00%) - CodegenTime: 1.570ms - CompileTime: 8.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 31 (31) - NumInstructions: 476 (476) - OptimizationTime: 22.680ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 38.382ms HDFS_SCAN_NODE (id=3):(Total: 9.196ms, non-child: 9.196ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 119.903us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 108.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.621ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 91 (91) - RowsReturnedRate: 9.89 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.966ms - MaterializeTupleTime(*): 2.617ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 4.216ms - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 5f429df048b5534b:41bcce1800000082 (host=foo.221.36:22000):(Total: 2s717ms, non-child: 2s638ms, % non-child: 97.07%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB MemoryUsage(500.000ms): 798.84 KB, 798.84 KB, 798.84 KB, 798.84 KB, 798.84 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643496) - PerHostPeakMemUsage: 317.87 MB (333306281) - RowsProduced: 91 (91) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s420ms - TotalStorageWaitTime: 4.256ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 2s684ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 41.993ms - TotalThreadsVoluntaryContextSwitches: 192 (192) Fragment Instance Lifecycle Timings: - ExecTime: 2s643ms - ExecTreeExecTime: 8.839ms - OpenTime: 32.510ms - ExecTreeOpenTime: 64.673us - PrepareTime: 42.000ms - ExecTreePrepareTime: 128.578us DataStreamSender (dst_id=17):(Total: 146.742us, non-child: 146.742us, % non-child: 100.00%) - BytesSent: 147.01 KB (150543) - OverallThroughput: 978.38 MB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 91 (91) - SerializeBatchTime: 12.221us - UncompressedRowBatchSize: 147.01 KB (150543) CodeGen:(Total: 70.185ms, non-child: 70.185ms, % non-child: 100.00%) - CodegenTime: 1.570ms - CompileTime: 8.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 31 (31) - NumInstructions: 476 (476) - OptimizationTime: 22.680ms - PeakMemoryUsage: 238.00 KB (243712) - PrepareTime: 38.382ms HDFS_SCAN_NODE (id=3):(Total: 9.196ms, non-child: 9.196ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.835ms ; Min: 2.835ms ; Max: 2.835ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 119.903us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 108.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.621ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 91 (91) - RowsReturnedRate: 9.89 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.966ms - MaterializeTupleTime(*): 2.617ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 4.216ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F03:(Total: 13s095ms, non-child: 8s008ms, % non-child: 61.16%) split sizes: min: 2.59 MB, max: 3.58 MB, avg: 3.41 MB, stddev: 247.14 KB completion times: min:7s814ms max:22s172ms mean: 13s117ms stddev:4s455ms execution rates: min:158.89 KB/sec max:461.20 KB/sec mean:298.29 KB/sec stddev:99.48 KB/sec num instances: 13 - AverageThreadTokens: 1.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.65 MB (9065011) - PerHostPeakMemUsage: 853.40 MB (894858111) - RowsProduced: 35.54K (35538) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s085ms - TotalStorageWaitTime: 4.905ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 16s163ms - TotalThreadsSysTime: 27.687ms - TotalThreadsUserTime: 155.129ms - TotalThreadsVoluntaryContextSwitches: 840 (840) Fragment Instance Lifecycle Timings: - ExecTime: 13s038ms - ExecTreeExecTime: 4s990ms - OpenTime: 25.924ms - ExecTreeOpenTime: 35.879us - PrepareTime: 31.068ms - ExecTreePrepareTime: 122.061us DataStreamSender (dst_id=18):(Total: 44.213ms, non-child: 44.213ms, % non-child: 100.00%) - BytesSent: 326.51 MB (342374365) - OverallThroughput: 7.23 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 35.54K (35538) - SerializeBatchTime: 44.045ms - UncompressedRowBatchSize: 326.51 MB (342374365) CodeGen:(Total: 51.605ms, non-child: 51.605ms, % non-child: 100.00%) - CodegenTime: 1.239ms - CompileTime: 6.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 18.149ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 26.188ms HDFS_SCAN_NODE (id=7):(Total: 4s990ms, non-child: 4s990ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.26 - BytesRead: 2.19 MB (2293476) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2293476) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2293476) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 235.942us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.20 MB (8602449) - PerReadThreadRawHdfsThroughput: 284.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.334ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 35.54K (35538) - RowsReturned: 35.54K (35538) - RowsReturnedRate: 7.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 3s099ms - MaterializeTupleTime(*): 3.206ms - ScannerThreadsSysTime: 7.613ms - ScannerThreadsUserTime: 15.843ms - ScannerThreadsVoluntaryContextSwitches: 174 (174) - TotalRawHdfsReadTime(*): 8.013ms - TotalReadThroughput: 200.33 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.54K (35538) Fragment F03: Instance 5f429df048b5534b:41bcce180000008f (host=foo.232.32:22000):(Total: 22s145ms, non-child: 17s070ms, % non-child: 77.08%) Hdfs split stats (:<# splits>/): 2:1/3.44 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.09 MB, 6.09 MB, 6.04 MB, 6.00 MB, 5.95 MB, 5.80 MB, 5.76 MB, 5.71 MB, 5.61 MB, 5.61 MB, 5.52 MB, 5.47 MB, 5.42 MB, 5.37 MB, 5.33 MB, 5.28 MB, 5.23 MB, 5.23 MB, 5.18 MB, 5.09 MB, 5.04 MB, 4.99 MB, 4.85 MB, 4.80 MB, 4.66 MB, 4.61 MB, 4.56 MB, 4.51 MB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.72 MB (9141065) - PerHostPeakMemUsage: 984.00 MB (1031798095) - RowsProduced: 35.84K (35845) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s556ms - TotalStorageWaitTime: 3.921ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 26s338ms - TotalThreadsSysTime: 31.995ms - TotalThreadsUserTime: 170.973ms - TotalThreadsVoluntaryContextSwitches: 1.03K (1029) Fragment Instance Lifecycle Timings: - ExecTime: 22s096ms - ExecTreeExecTime: 4s979ms - OpenTime: 24.884ms - ExecTreeOpenTime: 33.558us - PrepareTime: 23.464ms - ExecTreePrepareTime: 135.184us DataStreamSender (dst_id=18):(Total: 49.721ms, non-child: 49.721ms, % non-child: 100.00%) - BytesSent: 328.90 MB (344876211) - OverallThroughput: 6.46 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 35.84K (35845) - SerializeBatchTime: 49.547ms - UncompressedRowBatchSize: 328.90 MB (344876211) CodeGen:(Total: 45.106ms, non-child: 45.106ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 7.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 16.801ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 20.778ms HDFS_SCAN_NODE (id=7):(Total: 4s979ms, non-child: 4s979ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.44 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s959ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB, 2.20 MB - FooterProcessingTime: (Avg: 2.843ms ; Min: 2.843ms ; Max: 2.843ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.21 - BytesRead: 2.20 MB (2308223) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.20 MB (2308223) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.20 MB (2308223) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 113.205us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.28 MB (8678503) - PerReadThreadRawHdfsThroughput: 281.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.496ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 35.84K (35845) - RowsReturned: 35.84K (35845) - RowsReturnedRate: 7.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 4s217ms - MaterializeTupleTime(*): 1.685ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 220 (220) - TotalRawHdfsReadTime(*): 7.815ms - TotalReadThroughput: 118.64 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.84K (35845) Instance 5f429df048b5534b:41bcce1800000083 (host=foo.232.43:22000):(Total: 19s352ms, non-child: 14s286ms, % non-child: 73.82%) Hdfs split stats (:<# splits>/): 0:1/3.49 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.14 MB, 6.14 MB, 5.99 MB, 5.71 MB, 5.71 MB, 5.61 MB, 5.52 MB, 5.42 MB, 5.37 MB, 5.32 MB, 5.18 MB, 5.18 MB, 5.18 MB, 5.09 MB, 5.04 MB, 5.04 MB, 4.94 MB, 4.94 MB, 4.89 MB, 4.80 MB, 4.65 MB, 4.61 MB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.05 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.77 MB (9191503) - PerHostPeakMemUsage: 850.22 MB (891524938) - RowsProduced: 36.34K (36344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11s540ms - TotalStorageWaitTime: 6.237ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 20s570ms - TotalThreadsSysTime: 28.996ms - TotalThreadsUserTime: 144.978ms - TotalThreadsVoluntaryContextSwitches: 805 (805) Fragment Instance Lifecycle Timings: - ExecTime: 19s300ms - ExecTreeExecTime: 4s975ms - OpenTime: 22.166ms - ExecTreeOpenTime: 44.192us - PrepareTime: 29.604ms - ExecTreePrepareTime: 106.278us DataStreamSender (dst_id=18):(Total: 47.432ms, non-child: 47.432ms, % non-child: 100.00%) - BytesSent: 333.68 MB (349888248) - OverallThroughput: 6.87 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.34K (36344) - SerializeBatchTime: 47.230ms - UncompressedRowBatchSize: 333.68 MB (349888248) CodeGen:(Total: 42.969ms, non-child: 42.969ms, % non-child: 100.00%) - CodegenTime: 1.071ms - CompileTime: 6.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 15.023ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 20.996ms HDFS_SCAN_NODE (id=7):(Total: 4s975ms, non-child: 4s975ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/3.49 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s956ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB - FooterProcessingTime: (Avg: 3.235ms ; Min: 3.235ms ; Max: 3.235ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.06 - BytesRead: 2.23 MB (2343286) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.23 MB (2343286) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.23 MB (2343286) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 210.443us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.32 MB (8728941) - PerReadThreadRawHdfsThroughput: 265.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.244ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.34K (36344) - RowsReturned: 36.34K (36344) - RowsReturnedRate: 7.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 1s247ms - MaterializeTupleTime(*): 2.296ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 74 (74) - TotalRawHdfsReadTime(*): 8.420ms - TotalReadThroughput: 143.02 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.34K (36344) Instance 5f429df048b5534b:41bcce180000008e (host=foo.221.30:22000):(Total: 18s222ms, non-child: 13s143ms, % non-child: 72.13%) Hdfs split stats (:<# splits>/): 3:1/3.45 MB MemoryUsage(500.000ms): 638.12 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 8.03 MB, 6.06 MB, 6.01 MB, 5.96 MB, 5.92 MB, 5.82 MB, 5.82 MB, 5.77 MB, 5.68 MB, 5.53 MB, 5.49 MB, 5.44 MB, 5.34 MB, 5.25 MB, 5.20 MB, 5.20 MB, 5.15 MB, 5.10 MB, 5.06 MB, 5.01 MB, 4.96 MB, 4.86 MB, 4.67 MB, 4.58 MB, 4.53 MB, 4.48 MB, 410.72 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.73 MB (9158821) - PerHostPeakMemUsage: 972.63 MB (1019880062) - RowsProduced: 35.68K (35682) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s422ms - TotalStorageWaitTime: 4.825ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 22s901ms - TotalThreadsSysTime: 33.994ms - TotalThreadsUserTime: 157.976ms - TotalThreadsVoluntaryContextSwitches: 1.00K (1002) Fragment Instance Lifecycle Timings: - ExecTime: 18s166ms - ExecTreeExecTime: 4s982ms - OpenTime: 30.423ms - ExecTreeOpenTime: 35.957us - PrepareTime: 24.957ms - ExecTreePrepareTime: 122.510us DataStreamSender (dst_id=18):(Total: 44.631ms, non-child: 44.631ms, % non-child: 100.00%) - BytesSent: 329.97 MB (346002381) - OverallThroughput: 7.22 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 35.68K (35682) - SerializeBatchTime: 44.479ms - UncompressedRowBatchSize: 329.97 MB (346002381) CodeGen:(Total: 51.978ms, non-child: 51.978ms, % non-child: 100.00%) - CodegenTime: 1.292ms - CompileTime: 6.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 22.753ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 22.080ms HDFS_SCAN_NODE (id=7):(Total: 4s982ms, non-child: 4s982ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/3.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s957ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB - FooterProcessingTime: (Avg: 3.348ms ; Min: 3.348ms ; Max: 3.348ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.29 - BytesRead: 2.21 MB (2318962) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.21 MB (2318962) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.21 MB (2318962) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 102.029us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.29 MB (8696259) - PerReadThreadRawHdfsThroughput: 248.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.846ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 35.68K (35682) - RowsReturned: 35.68K (35682) - RowsReturnedRate: 7.16 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 4s704ms - MaterializeTupleTime(*): 2.428ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 246 (246) - TotalRawHdfsReadTime(*): 8.897ms - TotalReadThroughput: 125.81 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.68K (35682) Instance 5f429df048b5534b:41bcce180000008b (host=foo.221.50:22000):(Total: 15s770ms, non-child: 10s720ms, % non-child: 67.98%) Hdfs split stats (:<# splits>/): 4:1/2.59 MB MemoryUsage(500.000ms): 638.12 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 4.92 MB, 4.92 MB, 4.87 MB, 4.82 MB, 4.77 MB, 4.72 MB, 4.63 MB, 4.53 MB, 4.48 MB, 4.29 MB, 4.20 MB, 4.15 MB, 4.10 MB, 4.05 MB, 4.01 MB, 3.91 MB, 3.91 MB, 3.86 MB, 3.77 MB, 3.72 MB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.25 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.48 MB (7838839) - PerHostPeakMemUsage: 933.30 MB (978635871) - RowsProduced: 26.95K (26955) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9s753ms - TotalStorageWaitTime: 4.752ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 19s802ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 142.978ms - TotalThreadsVoluntaryContextSwitches: 902 (902) Fragment Instance Lifecycle Timings: - ExecTime: 15s703ms - ExecTreeExecTime: 4s950ms - OpenTime: 42.930ms - ExecTreeOpenTime: 30.175us - PrepareTime: 24.391ms - ExecTreePrepareTime: 121.546us DataStreamSender (dst_id=18):(Total: 35.524ms, non-child: 35.524ms, % non-child: 100.00%) - BytesSent: 247.11 MB (259110432) - OverallThroughput: 6.79 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 26.95K (26955) - SerializeBatchTime: 35.329ms - UncompressedRowBatchSize: 247.11 MB (259110432) CodeGen:(Total: 64.019ms, non-child: 64.019ms, % non-child: 100.00%) - CodegenTime: 1.319ms - CompileTime: 9.353ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 32.202ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 21.835ms HDFS_SCAN_NODE (id=7):(Total: 4s950ms, non-child: 4s950ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/2.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s936ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB, 1.68 MB - FooterProcessingTime: (Avg: 2.882ms ; Min: 2.882ms ; Max: 2.882ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.28 - BytesRead: 1.68 MB (1759856) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.68 MB (1759856) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.68 MB (1759856) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 170.649us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.03 MB (7376277) - PerReadThreadRawHdfsThroughput: 251.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.432ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 26.95K (26955) - RowsReturned: 26.95K (26955) - RowsReturnedRate: 5.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 4s056ms - MaterializeTupleTime(*): 1.925ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 230 (230) - TotalRawHdfsReadTime(*): 6.667ms - TotalReadThroughput: 114.57 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 26.95K (26955) Instance 5f429df048b5534b:41bcce180000008a (host=foo.221.18:22000):(Total: 15s650ms, non-child: 10s556ms, % non-child: 67.45%) Hdfs split stats (:<# splits>/): 1:1/3.47 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.11 MB, 6.01 MB, 6.01 MB, 5.92 MB, 5.87 MB, 5.77 MB, 5.73 MB, 5.68 MB, 5.63 MB, 5.53 MB, 5.15 MB, 5.10 MB, 5.06 MB, 5.06 MB, 5.01 MB, 4.91 MB, 4.86 MB, 4.82 MB, 4.67 MB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.74 MB (9159915) - PerHostPeakMemUsage: 861.23 MB (903060236) - RowsProduced: 36.27K (36266) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9s366ms - TotalStorageWaitTime: 4.531ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 20s137ms - TotalThreadsSysTime: 26.995ms - TotalThreadsUserTime: 156.975ms - TotalThreadsVoluntaryContextSwitches: 932 (932) Fragment Instance Lifecycle Timings: - ExecTime: 15s594ms - ExecTreeExecTime: 4s997ms - OpenTime: 24.315ms - ExecTreeOpenTime: 31.194us - PrepareTime: 31.681ms - ExecTreePrepareTime: 99.001us DataStreamSender (dst_id=18):(Total: 43.174ms, non-child: 43.174ms, % non-child: 100.00%) - BytesSent: 331.42 MB (347519292) - OverallThroughput: 7.50 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.27K (36266) - SerializeBatchTime: 43.015ms - UncompressedRowBatchSize: 331.42 MB (347519292) CodeGen:(Total: 52.461ms, non-child: 52.461ms, % non-child: 100.00%) - CodegenTime: 1.140ms - CompileTime: 6.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 17.251ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 28.609ms HDFS_SCAN_NODE (id=7):(Total: 4s997ms, non-child: 4s997ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.47 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s958ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB - FooterProcessingTime: (Avg: 3.216ms ; Min: 3.216ms ; Max: 3.216ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 2.22 MB (2323460) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.22 MB (2323460) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.22 MB (2323460) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 191.752us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.29 MB (8697353) - PerReadThreadRawHdfsThroughput: 294.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.886ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.27K (36266) - RowsReturned: 36.27K (36266) - RowsReturnedRate: 7.26 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 4s518ms - MaterializeTupleTime(*): 3.075ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 251 (251) - TotalRawHdfsReadTime(*): 7.518ms - TotalReadThroughput: 156.48 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.27K (36266) Instance 5f429df048b5534b:41bcce1800000088 (host=foo.187.43:22000):(Total: 11s672ms, non-child: 6s577ms, % non-child: 56.35%) Hdfs split stats (:<# splits>/): 5:1/3.48 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.13 MB, 5.99 MB, 5.94 MB, 5.84 MB, 5.70 MB, 5.46 MB, 5.32 MB, 5.03 MB, 4.89 MB, 4.74 MB, 4.65 MB, 4.50 MB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.12 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.72 MB (9140803) - PerHostPeakMemUsage: 911.61 MB (955896136) - RowsProduced: 36.33K (36329) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s594ms - TotalStorageWaitTime: 10.950ms - TotalThreadsInvoluntaryContextSwitches: 30 (30) - TotalThreadsTotalWallClockTime: 13s503ms - TotalThreadsSysTime: 23.996ms - TotalThreadsUserTime: 163.975ms - TotalThreadsVoluntaryContextSwitches: 756 (756) Fragment Instance Lifecycle Timings: - ExecTime: 11s603ms - ExecTreeExecTime: 4s992ms - OpenTime: 25.293ms - ExecTreeOpenTime: 45.259us - PrepareTime: 42.944ms - ExecTreePrepareTime: 149.040us DataStreamSender (dst_id=18):(Total: 46.015ms, non-child: 46.015ms, % non-child: 100.00%) - BytesSent: 333.42 MB (349611414) - OverallThroughput: 7.08 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.33K (36329) - SerializeBatchTime: 45.783ms - UncompressedRowBatchSize: 333.42 MB (349611414) CodeGen:(Total: 55.845ms, non-child: 55.845ms, % non-child: 100.00%) - CodegenTime: 1.519ms - CompileTime: 6.106ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 17.443ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 31.709ms HDFS_SCAN_NODE (id=7):(Total: 4s992ms, non-child: 4s992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/3.48 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s956ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB, 2.23 MB - FooterProcessingTime: (Avg: 3.096ms ; Min: 3.096ms ; Max: 3.096ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.14 - BytesRead: 2.23 MB (2334301) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.23 MB (2334301) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.23 MB (2334301) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 201.290us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.28 MB (8678241) - PerReadThreadRawHdfsThroughput: 149.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.262ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.33K (36329) - RowsReturned: 36.33K (36329) - RowsReturnedRate: 7.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s874ms - MaterializeTupleTime(*): 4.089ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 111 (111) - TotalRawHdfsReadTime(*): 14.935ms - TotalReadThroughput: 207.24 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.33K (36329) Instance 5f429df048b5534b:41bcce1800000084 (host=foo.187.40:22000):(Total: 11s274ms, non-child: 6s190ms, % non-child: 54.91%) Hdfs split stats (:<# splits>/): 2:1/3.58 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.22 MB, 6.13 MB, 5.98 MB, 5.93 MB, 5.74 MB, 5.74 MB, 5.55 MB, 5.31 MB, 5.22 MB, 5.12 MB, 4.93 MB, 4.74 MB, 4.59 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.85 MB (9280684) - PerHostPeakMemUsage: 703.45 MB (737624302) - RowsProduced: 37.24K (37239) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s064ms - TotalStorageWaitTime: 3.822ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 16s065ms - TotalThreadsSysTime: 35.994ms - TotalThreadsUserTime: 150.976ms - TotalThreadsVoluntaryContextSwitches: 914 (914) Fragment Instance Lifecycle Timings: - ExecTime: 11s211ms - ExecTreeExecTime: 4s984ms - OpenTime: 22.339ms - ExecTreeOpenTime: 34.331us - PrepareTime: 41.129ms - ExecTreePrepareTime: 193.545us DataStreamSender (dst_id=18):(Total: 44.880ms, non-child: 44.880ms, % non-child: 100.00%) - BytesSent: 342.95 MB (359604786) - OverallThroughput: 7.46 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 37.24K (37239) - SerializeBatchTime: 44.749ms - UncompressedRowBatchSize: 342.95 MB (359604786) CodeGen:(Total: 54.565ms, non-child: 54.565ms, % non-child: 100.00%) - CodegenTime: 1.588ms - CompileTime: 6.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 14.777ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 32.783ms HDFS_SCAN_NODE (id=7):(Total: 4s984ms, non-child: 4s984ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s958ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB - FooterProcessingTime: (Avg: 2.472ms ; Min: 2.472ms ; Max: 2.472ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.39 - BytesRead: 2.30 MB (2407097) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.30 MB (2407097) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.30 MB (2407097) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 178.179us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.41 MB (8818122) - PerReadThreadRawHdfsThroughput: 310.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.354ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 37.24K (37239) - RowsReturned: 37.24K (37239) - RowsReturnedRate: 7.47 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 4s831ms - MaterializeTupleTime(*): 2.344ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 19.996ms - ScannerThreadsVoluntaryContextSwitches: 257 (257) - TotalRawHdfsReadTime(*): 7.394ms - TotalReadThroughput: 204.41 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 37.24K (37239) Instance 5f429df048b5534b:41bcce1800000085 (host=foo.187.48:22000):(Total: 10s755ms, non-child: 5s681ms, % non-child: 52.82%) Hdfs split stats (:<# splits>/): 4:1/3.45 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.00 MB, 5.90 MB, 5.71 MB, 5.52 MB, 5.38 MB, 5.14 MB, 4.80 MB, 4.66 MB, 4.52 MB, 410.72 KB, 410.72 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.72 MB (9145983) - PerHostPeakMemUsage: 903.48 MB (947363412) - RowsProduced: 35.77K (35768) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s411ms - TotalStorageWaitTime: 3.502ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 15s073ms - TotalThreadsSysTime: 22.996ms - TotalThreadsUserTime: 149.977ms - TotalThreadsVoluntaryContextSwitches: 853 (853) Fragment Instance Lifecycle Timings: - ExecTime: 10s699ms - ExecTreeExecTime: 4s977ms - OpenTime: 23.501ms - ExecTreeOpenTime: 31.319us - PrepareTime: 32.850ms - ExecTreePrepareTime: 102.870us DataStreamSender (dst_id=18):(Total: 44.757ms, non-child: 44.757ms, % non-child: 100.00%) - BytesSent: 328.84 MB (344809002) - OverallThroughput: 7.17 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 35.77K (35768) - SerializeBatchTime: 44.557ms - UncompressedRowBatchSize: 328.84 MB (344809002) CodeGen:(Total: 52.515ms, non-child: 52.515ms, % non-child: 100.00%) - CodegenTime: 1.261ms - CompileTime: 6.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 16.321ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 29.473ms HDFS_SCAN_NODE (id=7):(Total: 4s977ms, non-child: 4s977ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/3.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s957ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB, 2.21 MB - FooterProcessingTime: (Avg: 2.325ms ; Min: 2.325ms ; Max: 2.325ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.47 - BytesRead: 2.21 MB (2312633) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.21 MB (2312633) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.21 MB (2312633) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 102.026us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.28 MB (8683421) - PerReadThreadRawHdfsThroughput: 349.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.757ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 35.77K (35768) - RowsReturned: 35.77K (35768) - RowsReturnedRate: 7.18 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 4s350ms - MaterializeTupleTime(*): 1.880ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 12.998ms - ScannerThreadsVoluntaryContextSwitches: 232 (232) - TotalRawHdfsReadTime(*): 6.317ms - TotalReadThroughput: 237.73 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.77K (35768) Instance 5f429df048b5534b:41bcce1800000086 (host=foo.187.53:22000):(Total: 10s730ms, non-child: 5s645ms, % non-child: 52.61%) Hdfs split stats (:<# splits>/): 1:1/3.47 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 5.97 MB, 5.82 MB, 5.73 MB, 5.54 MB, 5.34 MB, 5.34 MB, 5.01 MB, 5.01 MB, 4.77 MB, 4.63 MB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.05 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.69 MB (9112114) - PerHostPeakMemUsage: 798.49 MB (837275072) - RowsProduced: 36.23K (36228) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s006ms - TotalStorageWaitTime: 4.052ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 11s246ms - TotalThreadsSysTime: 30.995ms - TotalThreadsUserTime: 153.976ms - TotalThreadsVoluntaryContextSwitches: 689 (689) Fragment Instance Lifecycle Timings: - ExecTime: 10s673ms - ExecTreeExecTime: 4s990ms - OpenTime: 21.769ms - ExecTreeOpenTime: 29.391us - PrepareTime: 35.760ms - ExecTreePrepareTime: 120.882us DataStreamSender (dst_id=18):(Total: 43.725ms, non-child: 43.725ms, % non-child: 100.00%) - BytesSent: 331.48 MB (347583276) - OverallThroughput: 7.40 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.23K (36228) - SerializeBatchTime: 43.571ms - UncompressedRowBatchSize: 331.48 MB (347583276) CodeGen:(Total: 51.744ms, non-child: 51.744ms, % non-child: 100.00%) - CodegenTime: 1.056ms - CompileTime: 5.523ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 15.443ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 30.310ms HDFS_SCAN_NODE (id=7):(Total: 4s990ms, non-child: 4s990ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.47 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s959ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB - FooterProcessingTime: (Avg: 2.819ms ; Min: 2.819ms ; Max: 2.819ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.05 - BytesRead: 2.22 MB (2323122) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.22 MB (2323122) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.22 MB (2323122) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 320.727us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.25 MB (8649552) - PerReadThreadRawHdfsThroughput: 313.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.343ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.23K (36228) - RowsReturned: 36.23K (36228) - RowsReturnedRate: 7.26 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 551.169ms - MaterializeTupleTime(*): 5.379ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 16.997ms - ScannerThreadsVoluntaryContextSwitches: 53 (53) - TotalRawHdfsReadTime(*): 7.059ms - TotalReadThroughput: 226.87 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.23K (36228) Instance 5f429df048b5534b:41bcce180000008c (host=foo.187.55:22000):(Total: 9s762ms, non-child: 4s678ms, % non-child: 47.92%) Hdfs split stats (:<# splits>/): 1:1/3.43 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.03 MB, 5.79 MB, 5.55 MB, 5.46 MB, 5.27 MB, 5.08 MB, 5.03 MB, 4.79 MB, 4.64 MB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.71 MB (9129155) - PerHostPeakMemUsage: 820.91 MB (860781712) - RowsProduced: 35.52K (35524) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s533ms - TotalStorageWaitTime: 4.798ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 9s767ms - TotalThreadsSysTime: 24.995ms - TotalThreadsUserTime: 167.974ms - TotalThreadsVoluntaryContextSwitches: 647 (647) Fragment Instance Lifecycle Timings: - ExecTime: 9s709ms - ExecTreeExecTime: 4s987ms - OpenTime: 25.849ms - ExecTreeOpenTime: 41.551us - PrepareTime: 27.026ms - ExecTreePrepareTime: 103.087us DataStreamSender (dst_id=18):(Total: 47.890ms, non-child: 47.890ms, % non-child: 100.00%) - BytesSent: 327.31 MB (343205274) - OverallThroughput: 6.67 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 35.52K (35524) - SerializeBatchTime: 47.758ms - UncompressedRowBatchSize: 327.31 MB (343205274) CodeGen:(Total: 49.470ms, non-child: 49.470ms, % non-child: 100.00%) - CodegenTime: 1.236ms - CompileTime: 7.697ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 17.262ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 23.986ms HDFS_SCAN_NODE (id=7):(Total: 4s987ms, non-child: 4s987ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.43 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s959ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB, 2.19 MB - FooterProcessingTime: (Avg: 3.115ms ; Min: 3.115ms ; Max: 3.115ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.19 MB (2300189) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.19 MB (2300189) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.19 MB (2300189) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 323.663us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.27 MB (8666593) - PerReadThreadRawHdfsThroughput: 281.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.301ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 35.52K (35524) - RowsReturned: 35.52K (35524) - RowsReturnedRate: 7.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 31.796ms - MaterializeTupleTime(*): 3.078ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 15.997ms - ScannerThreadsVoluntaryContextSwitches: 31 (31) - TotalRawHdfsReadTime(*): 7.798ms - TotalReadThroughput: 236.45 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 35.52K (35524) Instance 5f429df048b5534b:41bcce1800000089 (host=foo.246.38:22000):(Total: 8s866ms, non-child: 3s795ms, % non-child: 42.80%) Hdfs split stats (:<# splits>/): 2:1/3.47 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.13 MB, 6.08 MB, 5.94 MB, 5.74 MB, 5.50 MB, 5.46 MB, 5.22 MB, 4.69 MB ThreadUsage(500.000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.75 MB (9179740) - PerHostPeakMemUsage: 776.11 MB (813807736) - RowsProduced: 36.12K (36122) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s674ms - TotalStorageWaitTime: 4.564ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 12s645ms - TotalThreadsSysTime: 28.995ms - TotalThreadsUserTime: 144.978ms - TotalThreadsVoluntaryContextSwitches: 786 (786) Fragment Instance Lifecycle Timings: - ExecTime: 8s816ms - ExecTreeExecTime: 4s981ms - OpenTime: 21.619ms - ExecTreeOpenTime: 30.470us - PrepareTime: 28.145ms - ExecTreePrepareTime: 114.220us DataStreamSender (dst_id=18):(Total: 44.374ms, non-child: 44.374ms, % non-child: 100.00%) - BytesSent: 332.64 MB (348796263) - OverallThroughput: 7.32 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.12K (36122) - SerializeBatchTime: 44.227ms - UncompressedRowBatchSize: 332.64 MB (348796263) CodeGen:(Total: 45.612ms, non-child: 45.612ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 6.152ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 14.710ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 24.270ms HDFS_SCAN_NODE (id=7):(Total: 4s981ms, non-child: 4s981ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.47 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s958ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB, 2.22 MB - FooterProcessingTime: (Avg: 2.727ms ; Min: 2.727ms ; Max: 2.727ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.39 - BytesRead: 2.22 MB (2332492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.22 MB (2332492) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.22 MB (2332492) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 283.446us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.31 MB (8717178) - PerReadThreadRawHdfsThroughput: 304.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.577ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.12K (36122) - RowsReturned: 36.12K (36122) - RowsReturnedRate: 7.25 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 3s806ms - MaterializeTupleTime(*): 3.208ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 196 (196) - TotalRawHdfsReadTime(*): 7.314ms - TotalReadThroughput: 253.09 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.12K (36122) Instance 5f429df048b5534b:41bcce1800000087 (host=foo.246.40:22000):(Total: 8s239ms, non-child: 3s163ms, % non-child: 38.40%) Hdfs split stats (:<# splits>/): 0:1/3.55 MB MemoryUsage(500.000ms): 402.12 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 6.05 MB, 5.86 MB, 5.38 MB, 5.09 MB, 4.76 MB, 410.72 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.77 MB (9198352) - PerHostPeakMemUsage: 691.54 MB (725135221) - RowsProduced: 37.07K (37072) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s785ms - TotalStorageWaitTime: 4.394ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 10s388ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 158.975ms - TotalThreadsVoluntaryContextSwitches: 768 (768) Fragment Instance Lifecycle Timings: - ExecTime: 8s180ms - ExecTreeExecTime: 4s981ms - OpenTime: 26.834ms - ExecTreeOpenTime: 40.015us - PrepareTime: 32.904ms - ExecTreePrepareTime: 114.630us DataStreamSender (dst_id=18):(Total: 39.548ms, non-child: 39.548ms, % non-child: 100.00%) - BytesSent: 340.27 MB (356803164) - OverallThroughput: 8.40 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 37.07K (37072) - SerializeBatchTime: 39.375ms - UncompressedRowBatchSize: 340.27 MB (356803164) CodeGen:(Total: 54.580ms, non-child: 54.580ms, % non-child: 100.00%) - CodegenTime: 1.263ms - CompileTime: 6.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 19.166ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 28.284ms HDFS_SCAN_NODE (id=7):(Total: 4s982ms, non-child: 4s982ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/3.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s956ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB, 2.28 MB - FooterProcessingTime: (Avg: 2.922ms ; Min: 2.922ms ; Max: 2.922ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.33 - BytesRead: 2.28 MB (2386093) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.28 MB (2386093) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.28 MB (2386093) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 347.752us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.33 MB (8735790) - PerReadThreadRawHdfsThroughput: 316.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.777ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 37.07K (37072) - RowsReturned: 37.07K (37072) - RowsReturnedRate: 7.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 2s181ms - MaterializeTupleTime(*): 4.480ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 16.997ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsReadTime(*): 7.196ms - TotalReadThroughput: 291.27 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 37.07K (37072) Instance 5f429df048b5534b:41bcce180000008d (host=foo.234.47:22000):(Total: 7s794ms, non-child: 2s601ms, % non-child: 33.38%) Hdfs split stats (:<# splits>/): 1:1/3.52 MB MemoryUsage(500.000ms): 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 410.72 KB, 5.99 MB, 5.68 MB, 5.45 MB, 5.11 MB, 4.68 MB, 4.54 MB ThreadUsage(500.000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.74 MB (9168177) - PerHostPeakMemUsage: 887.27 MB (930372654) - RowsProduced: 36.63K (36626) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s398ms - TotalStorageWaitTime: 3.418ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 11s691ms - TotalThreadsSysTime: 29.996ms - TotalThreadsUserTime: 151.976ms - TotalThreadsVoluntaryContextSwitches: 837 (837) Fragment Instance Lifecycle Timings: - ExecTime: 7s740ms - ExecTreeExecTime: 5s099ms - OpenTime: 25.084ms - ExecTreeOpenTime: 39.023us - PrepareTime: 29.027ms - ExecTreePrepareTime: 104.006us DataStreamSender (dst_id=18):(Total: 43.094ms, non-child: 43.094ms, % non-child: 100.00%) - BytesSent: 336.70 MB (353057004) - OverallThroughput: 7.63 GB/sec - PeakMemoryUsage: 402.12 KB (411768) - RowsReturned: 36.63K (36626) - SerializeBatchTime: 42.959ms - UncompressedRowBatchSize: 336.70 MB (353057004) CodeGen:(Total: 50.002ms, non-child: 50.002ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 7.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 456 (456) - OptimizationTime: 16.782ms - PeakMemoryUsage: 228.00 KB (233472) - PrepareTime: 25.336ms HDFS_SCAN_NODE (id=7):(Total: 5s099ms, non-child: 5s099ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.52 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [6]), waited for 4s959ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB - FooterProcessingTime: (Avg: 2.504ms ; Min: 2.504ms ; Max: 2.504ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 2.26 MB (2365480) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.26 MB (2365480) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.26 MB (2365480) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 522.087us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 8.30 MB (8705615) - PerReadThreadRawHdfsThroughput: 330.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 139.060ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 36.63K (36626) - RowsReturned: 36.63K (36626) - RowsReturnedRate: 7.18 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 3s926ms - MaterializeTupleTime(*): 5.816ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 249 (249) - TotalRawHdfsReadTime(*): 6.835ms - TotalReadThroughput: 288.75 KB/sec Filter 6 (2.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 36.63K (36626) Averaged Fragment F04:(Total: 32s330ms, non-child: 29s365ms, % non-child: 90.83%) split sizes: min: 3.05 GB, max: 3.80 GB, avg: 3.39 GB, stddev: 143.93 MB completion times: min:3s299ms max:1m31s mean: 32s354ms stddev:17s510ms execution rates: min:38.06 MB/sec max:1019.26 MB/sec mean:148.85 MB/sec stddev:112.96 MB/sec num instances: 129 - AverageThreadTokens: 4.06 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 163.51 MB (171447677) - PerHostPeakMemUsage: 873.85 MB (916297454) - RowsProduced: 9.50M (9501356) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26s482ms - TotalStorageWaitTime: 94.329ms - TotalThreadsInvoluntaryContextSwitches: 4.16K (4162) - TotalThreadsTotalWallClockTime: 2m16s - TotalThreadsSysTime: 6s222ms - TotalThreadsUserTime: 28s630ms - TotalThreadsVoluntaryContextSwitches: 618.60K (618596) Fragment Instance Lifecycle Timings: - ExecTime: 32s272ms - ExecTreeExecTime: 1s205ms - OpenTime: 26.770ms - ExecTreeOpenTime: 86.855us - PrepareTime: 31.018ms - ExecTreePrepareTime: 360.094us DataStreamSender (dst_id=20):(Total: 1s714ms, non-child: 1s714ms, % non-child: 100.00%) - BytesSent: 224.23 MB (235124469) - OverallThroughput: 130.24 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.50M (9501356) - SerializeBatchTime: 1s711ms - UncompressedRowBatchSize: 224.23 MB (235124469) CodeGen:(Total: 53.235ms, non-child: 53.235ms, % non-child: 100.00%) - CodegenTime: 1.278ms - CompileTime: 7.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.618ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.929ms HDFS_SCAN_NODE (id=1):(Total: 1s197ms, non-child: 1s197ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 3.29 - BytesRead: 135.58 MB (142165557) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.58 MB (142165557) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.58 MB (142165557) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 492.241ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 159.47 MB (167212204) - PerReadThreadRawHdfsThroughput: 905.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.160ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 9.50M (9501356) - RowsReturned: 9.50M (9501356) - RowsReturnedRate: 13.87 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 3.52K (3521) - ScannerThreadsTotalWallClockTime: 1m44s - MaterializeTupleTime(*): 829.919ms - ScannerThreadsSysTime: 6s052ms - ScannerThreadsUserTime: 24s614ms - ScannerThreadsVoluntaryContextSwitches: 616.67K (616673) - TotalRawHdfsReadTime(*): 149.429ms - TotalReadThroughput: 5.31 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 9.28K (9280) - RowGroups rejected: 0 (0) - RowGroups total: 9.28K (9280) - Rows processed: 50.55K (50549) - Rows rejected: 0 (0) - Rows total: 9.50M (9501356) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Fragment F04: Instance 5f429df048b5534b:41bcce180000017c (host=foo.221.47:22000):(Total: 1m31s, non-child: 1m26s, % non-child: 94.87%) Hdfs split stats (:<# splits>/): 1:1/4.04 MB 6:3/419.07 MB 5:3/404.30 MB 2:2/462.37 MB 0:7/989.40 MB 7:5/761.78 MB 4:2/74.39 MB 3:4/356.31 MB Filter 4 arrival: 1s481ms MemoryUsage(2s000ms): 68.38 MB, 270.54 MB, 270.87 MB, 270.41 MB, 270.55 MB, 270.61 MB, 270.15 MB, 270.31 MB, 270.48 MB, 270.43 MB, 270.36 MB, 270.40 MB, 244.54 MB, 238.60 MB, 238.67 MB, 238.65 MB, 238.62 MB, 228.60 MB, 206.76 MB, 206.69 MB, 194.76 MB, 177.01 MB, 174.89 MB, 174.98 MB, 175.00 MB, 174.91 MB, 155.09 MB, 147.18 MB, 143.19 MB, 143.21 MB, 143.12 MB, 143.24 MB, 143.15 MB, 132.79 MB, 121.75 MB, 121.54 MB, 121.37 MB, 93.03 MB, 92.60 MB, 91.98 MB, 84.09 MB, 66.10 MB, 59.97 MB, 54.16 MB, 29.31 MB ThreadUsage(2s000ms): 2, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4 - AverageThreadTokens: 4.87 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 271.98 MB (285194718) - PerHostPeakMemUsage: 1.10 GB (1179369864) - RowsProduced: 16.14M (16142248) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m21s - TotalStorageWaitTime: 132.053ms - TotalThreadsInvoluntaryContextSwitches: 5.60K (5596) - TotalThreadsTotalWallClockTime: 7m22s - TotalThreadsSysTime: 4s058ms - TotalThreadsUserTime: 44s260ms - TotalThreadsVoluntaryContextSwitches: 218.16K (218155) Fragment Instance Lifecycle Timings: - ExecTime: 1m31s - ExecTreeExecTime: 1s597ms - OpenTime: 27.216ms - ExecTreeOpenTime: 86.477us - PrepareTime: 27.341ms - ExecTreePrepareTime: 238.215us DataStreamSender (dst_id=20):(Total: 3s042ms, non-child: 3s042ms, % non-child: 100.00%) - BytesSent: 384.57 MB (403248506) - OverallThroughput: 126.38 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 16.14M (16142248) - SerializeBatchTime: 3s037ms - UncompressedRowBatchSize: 384.57 MB (403248506) CodeGen:(Total: 49.759ms, non-child: 49.759ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 7.987ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.306ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.984ms HDFS_SCAN_NODE (id=1):(Total: 1s584ms, non-child: 1s584ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/4.04 MB 6:3/419.07 MB 5:3/404.30 MB 2:2/462.37 MB 0:7/989.40 MB 7:5/761.78 MB 4:2/74.39 MB 3:4/356.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s445ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:16 BytesRead(2s000ms): 57.78 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB, 231.12 MB - FooterProcessingTime: (Avg: 3.139ms ; Min: 2.971ms ; Max: 3.241ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.93 - BytesRead: 231.12 MB (242351314) - BytesReadDataNodeCache: 0 - BytesReadLocal: 231.12 MB (242351314) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 231.12 MB (242351314) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 867.817ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 267.90 MB (280918247) - PerReadThreadRawHdfsThroughput: 932.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.782ms - RowBatchQueuePutWaitTime: 5m10s - RowsRead: 16.14M (16142248) - RowsReturned: 16.14M (16142248) - RowsReturnedRate: 10.19 M/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 4.36K (4362) - ScannerThreadsTotalWallClockTime: 5m51s - MaterializeTupleTime(*): 1s456ms - ScannerThreadsSysTime: 3s783ms - ScannerThreadsUserTime: 36s713ms - ScannerThreadsVoluntaryContextSwitches: 215.10K (215097) - TotalRawHdfsReadTime(*): 247.814ms - TotalReadThroughput: 2.58 MB/sec Filter 4 (8.00 KB): - Files processed: 27 (27) - Files rejected: 23 (23) - Files total: 27 (27) - RowGroups processed: 15.77K (15767) - RowGroups rejected: 0 (0) - RowGroups total: 15.77K (15767) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 16.14M (16142248) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000144 (host=foo.221.35:22000):(Total: 1m21s, non-child: 1m16s, % non-child: 93.76%) Hdfs split stats (:<# splits>/): 0:1/4.26 MB 7:2/207.95 MB 3:2/313.86 MB 2:1/253.94 MB 4:5/923.39 MB 5:4/801.75 MB 1:2/508.16 MB 6:3/411.22 MB Filter 4 arrival: 1s609ms MemoryUsage(2s000ms): 579.87 KB, 289.73 MB, 288.92 MB, 289.03 MB, 288.94 MB, 288.77 MB, 289.00 MB, 288.66 MB, 288.93 MB, 288.87 MB, 288.84 MB, 271.05 MB, 257.05 MB, 257.09 MB, 257.16 MB, 257.03 MB, 251.11 MB, 223.24 MB, 201.43 MB, 197.44 MB, 191.44 MB, 173.57 MB, 161.49 MB, 161.49 MB, 161.49 MB, 161.48 MB, 161.65 MB, 161.46 MB, 161.54 MB, 161.62 MB, 161.55 MB, 161.55 MB, 161.52 MB, 132.51 MB, 132.01 MB, 118.07 MB, 94.27 MB, 82.33 MB, 66.16 MB, 28.90 MB ThreadUsage(2s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3 - AverageThreadTokens: 4.78 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 290.47 MB (304579221) - PerHostPeakMemUsage: 1.05 GB (1127027551) - RowsProduced: 17.76M (17757471) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 165.359ms - TotalThreadsInvoluntaryContextSwitches: 3.56K (3561) - TotalThreadsTotalWallClockTime: 6m31s - TotalThreadsSysTime: 1s911ms - TotalThreadsUserTime: 26s030ms - TotalThreadsVoluntaryContextSwitches: 161.66K (161664) Fragment Instance Lifecycle Timings: - ExecTime: 1m21s - ExecTreeExecTime: 1s733ms - OpenTime: 27.679ms - ExecTreeOpenTime: 79.533us - PrepareTime: 35.524ms - ExecTreePrepareTime: 299.135us DataStreamSender (dst_id=20):(Total: 3s290ms, non-child: 3s290ms, % non-child: 100.00%) - BytesSent: 420.07 MB (440477525) - OverallThroughput: 127.66 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 17.76M (17757471) - SerializeBatchTime: 3s284ms - UncompressedRowBatchSize: 420.07 MB (440477525) CodeGen:(Total: 56.603ms, non-child: 56.603ms, % non-child: 100.00%) - CodegenTime: 1.301ms - CompileTime: 7.802ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.977ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.213ms HDFS_SCAN_NODE (id=1):(Total: 1s718ms, non-child: 1s718ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/4.26 MB 7:2/207.95 MB 3:2/313.86 MB 2:1/253.94 MB 4:5/923.39 MB 5:4/801.75 MB 1:2/508.16 MB 6:3/411.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s567ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:16 BytesRead(2s000ms): 0, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB, 248.78 MB - FooterProcessingTime: (Avg: 3.243ms ; Min: 2.595ms ; Max: 4.538ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.90 - BytesRead: 248.78 MB (260860503) - BytesReadDataNodeCache: 0 - BytesReadLocal: 248.78 MB (260860503) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 248.78 MB (260860503) - CachedFileHandlesHitCount: 44 (44) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 972.896ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 286.41 MB (300319712) - PerReadThreadRawHdfsThroughput: 968.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.651ms - RowBatchQueuePutWaitTime: 4m49s - RowsRead: 17.76M (17757471) - RowsReturned: 17.76M (17757471) - RowsReturnedRate: 10.33 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 2.27K (2271) - ScannerThreadsTotalWallClockTime: 5m9s - MaterializeTupleTime(*): 1s618ms - ScannerThreadsSysTime: 1s648ms - ScannerThreadsUserTime: 18s226ms - ScannerThreadsVoluntaryContextSwitches: 158.45K (158450) - TotalRawHdfsReadTime(*): 256.859ms - TotalReadThroughput: 3.13 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 16 (16) - Files total: 20 (20) - RowGroups processed: 17.34K (17344) - RowGroups rejected: 0 (0) - RowGroups total: 17.34K (17344) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 17.76M (17757471) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000111 (host=foo.221.13:22000):(Total: 1m20s, non-child: 1m14s, % non-child: 93.09%) Hdfs split stats (:<# splits>/): 4:2/207.79 MB 0:2/395.19 MB 1:3/646.29 MB 7:1/253.94 MB 2:3/495.18 MB 3:2/79.94 MB 6:2/257.99 MB 5:5/1.16 GB Filter 4 arrival: 1s941ms MemoryUsage(2s000ms): 581.02 KB, 313.09 MB, 313.65 MB, 313.55 MB, 312.95 MB, 313.58 MB, 313.50 MB, 313.27 MB, 313.21 MB, 313.35 MB, 313.30 MB, 291.38 MB, 273.57 MB, 273.45 MB, 273.50 MB, 273.60 MB, 273.56 MB, 267.81 MB, 228.15 MB, 212.26 MB, 194.36 MB, 186.40 MB, 186.55 MB, 175.70 MB, 148.85 MB, 142.71 MB, 142.67 MB, 142.71 MB, 142.65 MB, 142.69 MB, 142.72 MB, 142.68 MB, 134.85 MB, 124.84 MB, 96.89 MB, 90.85 MB, 69.81 MB, 10.21 MB, 2.58 MB, 2.58 MB ThreadUsage(2s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 2, 1, 1 - AverageThreadTokens: 5.04 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 314.80 MB (330089056) - PerHostPeakMemUsage: 1.04 GB (1120639107) - RowsProduced: 18.94M (18939426) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 215.302ms - TotalThreadsInvoluntaryContextSwitches: 4.88K (4881) - TotalThreadsTotalWallClockTime: 6m44s - TotalThreadsSysTime: 975.850ms - TotalThreadsUserTime: 39s527ms - TotalThreadsVoluntaryContextSwitches: 87.95K (87952) Fragment Instance Lifecycle Timings: - ExecTime: 1m20s - ExecTreeExecTime: 2s068ms - OpenTime: 29.191ms - ExecTreeOpenTime: 88.600us - PrepareTime: 31.025ms - ExecTreePrepareTime: 332.114us DataStreamSender (dst_id=20):(Total: 3s428ms, non-child: 3s428ms, % non-child: 100.00%) - BytesSent: 451.61 MB (473545666) - OverallThroughput: 131.73 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 18.94M (18939426) - SerializeBatchTime: 3s421ms - UncompressedRowBatchSize: 451.61 MB (473545666) CodeGen:(Total: 56.165ms, non-child: 56.165ms, % non-child: 100.00%) - CodegenTime: 1.368ms - CompileTime: 8.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.867ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.394ms HDFS_SCAN_NODE (id=1):(Total: 2s049ms, non-child: 2s049ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/207.79 MB 0:2/395.19 MB 1:3/646.29 MB 7:1/253.94 MB 2:3/495.18 MB 3:2/79.94 MB 6:2/257.99 MB 5:5/1.16 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 1s886ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:20 BytesRead(2s000ms): 0, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB, 270.00 MB - FooterProcessingTime: (Avg: 3.967ms ; Min: 3.423ms ; Max: 5.741ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.31 - BytesRead: 270.00 MB (283112994) - BytesReadDataNodeCache: 0 - BytesReadLocal: 270.00 MB (283112994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 270.00 MB (283112994) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 999.725ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 310.78 MB (325879167) - PerReadThreadRawHdfsThroughput: 799.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.760ms - RowBatchQueuePutWaitTime: 4m52s - RowsRead: 18.94M (18939426) - RowsReturned: 18.94M (18939426) - RowsReturnedRate: 9.24 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 3.61K (3613) - ScannerThreadsTotalWallClockTime: 5m24s - MaterializeTupleTime(*): 1s682ms - ScannerThreadsSysTime: 663.897ms - ScannerThreadsUserTime: 31s356ms - ScannerThreadsVoluntaryContextSwitches: 84.81K (84806) - TotalRawHdfsReadTime(*): 337.905ms - TotalReadThroughput: 3.60 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 15 (15) - Files total: 20 (20) - RowGroups processed: 18.50K (18498) - RowGroups rejected: 0 (0) - RowGroups total: 18.50K (18498) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 18.94M (18939426) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000115 (host=foo.232.24:22000):(Total: 1m14s, non-child: 1m10s, % non-child: 94.06%) Hdfs split stats (:<# splits>/): 6:3/511.22 MB 3:2/315.15 MB 5:2/268.90 MB 2:4/612.59 MB 7:4/706.11 MB 0:2/42.56 MB 1:5/848.63 MB Filter 4 arrival: 1s302ms MemoryUsage(2s000ms): 133.66 MB, 266.58 MB, 266.81 MB, 266.66 MB, 266.64 MB, 266.72 MB, 266.88 MB, 266.77 MB, 266.70 MB, 266.71 MB, 266.77 MB, 266.60 MB, 236.22 MB, 215.48 MB, 207.50 MB, 207.54 MB, 207.64 MB, 199.65 MB, 175.72 MB, 173.80 MB, 163.77 MB, 148.01 MB, 144.02 MB, 140.11 MB, 112.34 MB, 112.39 MB, 109.12 MB, 91.70 MB, 83.15 MB, 83.10 MB, 83.07 MB, 83.16 MB, 83.12 MB, 50.84 MB, 37.05 MB, 21.66 MB, 2.47 MB ThreadUsage(2s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1 - AverageThreadTokens: 5.07 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 268.31 MB (281347472) - PerHostPeakMemUsage: 1.01 GB (1088272236) - RowsProduced: 15.92M (15924539) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m5s - TotalStorageWaitTime: 275.471ms - TotalThreadsInvoluntaryContextSwitches: 5.41K (5408) - TotalThreadsTotalWallClockTime: 6m18s - TotalThreadsSysTime: 6s045ms - TotalThreadsUserTime: 41s818ms - TotalThreadsVoluntaryContextSwitches: 541.49K (541492) Fragment Instance Lifecycle Timings: - ExecTime: 1m14s - ExecTreeExecTime: 1s416ms - OpenTime: 26.602ms - ExecTreeOpenTime: 79.654us - PrepareTime: 32.562ms - ExecTreePrepareTime: 371.726us DataStreamSender (dst_id=20):(Total: 2s976ms, non-child: 2s976ms, % non-child: 100.00%) - BytesSent: 378.19 MB (396565891) - OverallThroughput: 127.08 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 15.92M (15924539) - SerializeBatchTime: 2s970ms - UncompressedRowBatchSize: 378.19 MB (396565891) CodeGen:(Total: 53.840ms, non-child: 53.840ms, % non-child: 100.00%) - CodegenTime: 1.449ms - CompileTime: 6.336ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.792ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.030ms HDFS_SCAN_NODE (id=1):(Total: 1s402ms, non-child: 1s402ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:3/511.22 MB 3:2/315.15 MB 5:2/268.90 MB 2:4/612.59 MB 7:4/706.11 MB 0:2/42.56 MB 1:5/848.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 1s265ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:20 BytesRead(2s000ms): 113.39 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB, 226.78 MB - FooterProcessingTime: (Avg: 4.042ms ; Min: 3.029ms ; Max: 5.220ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.22 - BytesRead: 226.78 MB (237790879) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.78 MB (237790879) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.78 MB (237790879) - CachedFileHandlesHitCount: 46 (46) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 839.238ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 264.27 MB (277107867) - PerReadThreadRawHdfsThroughput: 891.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.678ms - RowBatchQueuePutWaitTime: 4m22s - RowsRead: 15.92M (15924539) - RowsReturned: 15.92M (15924539) - RowsReturnedRate: 11.36 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 4.28K (4279) - ScannerThreadsTotalWallClockTime: 5m3s - MaterializeTupleTime(*): 1s417ms - ScannerThreadsSysTime: 5s787ms - ScannerThreadsUserTime: 34s788ms - ScannerThreadsVoluntaryContextSwitches: 538.60K (538601) - TotalRawHdfsReadTime(*): 254.421ms - TotalReadThroughput: 3.15 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 17 (17) - Files total: 22 (22) - RowGroups processed: 15.55K (15554) - RowGroups rejected: 0 (0) - RowGroups total: 15.55K (15554) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 15.92M (15924539) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce180000016c (host=foo.232.29:22000):(Total: 1m9s, non-child: 1m6s, % non-child: 94.65%) Hdfs split stats (:<# splits>/): 1:1/144.42 MB 4:2/353.62 MB 0:2/302.75 MB 2:3/761.82 MB 3:1/199.39 MB 6:4/558.94 MB 5:5/960.90 MB Filter 4 arrival: 976ms MemoryUsage(2s000ms): 119.03 MB, 236.01 MB, 236.37 MB, 236.43 MB, 236.37 MB, 236.26 MB, 236.34 MB, 236.48 MB, 236.39 MB, 234.47 MB, 214.52 MB, 204.67 MB, 204.46 MB, 204.44 MB, 179.18 MB, 157.28 MB, 155.24 MB, 135.42 MB, 129.37 MB, 125.41 MB, 105.11 MB, 95.95 MB, 95.96 MB, 95.92 MB, 95.90 MB, 95.98 MB, 95.98 MB, 95.89 MB, 93.99 MB, 73.92 MB, 64.04 MB, 64.13 MB, 51.73 MB, 3.88 MB, 2.27 MB ThreadUsage(2s000ms): 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 4.71 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 237.98 MB (249540677) - PerHostPeakMemUsage: 1.04 GB (1121104139) - RowsProduced: 14.38M (14378782) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 113.604ms - TotalThreadsInvoluntaryContextSwitches: 7.77K (7772) - TotalThreadsTotalWallClockTime: 5m30s - TotalThreadsSysTime: 3s903ms - TotalThreadsUserTime: 1m7s - TotalThreadsVoluntaryContextSwitches: 350.68K (350684) Fragment Instance Lifecycle Timings: - ExecTime: 1m9s - ExecTreeExecTime: 1s058ms - OpenTime: 27.005ms - ExecTreeOpenTime: 85.611us - PrepareTime: 33.142ms - ExecTreePrepareTime: 369.433us DataStreamSender (dst_id=20):(Total: 2s646ms, non-child: 2s646ms, % non-child: 100.00%) - BytesSent: 339.48 MB (355970055) - OverallThroughput: 128.30 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 14.38M (14378782) - SerializeBatchTime: 2s640ms - UncompressedRowBatchSize: 339.48 MB (355970055) CodeGen:(Total: 53.480ms, non-child: 53.480ms, % non-child: 100.00%) - CodegenTime: 1.129ms - CompileTime: 6.735ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.364ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.820ms HDFS_SCAN_NODE (id=1):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/144.42 MB 4:2/353.62 MB 0:2/302.75 MB 2:3/761.82 MB 3:1/199.39 MB 6:4/558.94 MB 5:5/960.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 925ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:16 BytesRead(2s000ms): 101.59 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB, 203.18 MB - FooterProcessingTime: (Avg: 2.725ms ; Min: 2.366ms ; Max: 3.215ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.88 - BytesRead: 203.18 MB (213049333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 203.18 MB (213049333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 203.18 MB (213049333) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 769.177ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 233.90 MB (245266397) - PerReadThreadRawHdfsThroughput: 898.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.146ms - RowBatchQueuePutWaitTime: 3m15s - RowsRead: 14.38M (14378782) - RowsReturned: 14.38M (14378782) - RowsReturnedRate: 13.73 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 6.75K (6754) - ScannerThreadsTotalWallClockTime: 4m20s - MaterializeTupleTime(*): 1s263ms - ScannerThreadsSysTime: 3s654ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 347.82K (347819) - TotalRawHdfsReadTime(*): 226.121ms - TotalReadThroughput: 3.03 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 14 (14) - Files total: 18 (18) - RowGroups processed: 14.04K (14043) - RowGroups rejected: 0 (0) - RowGroups total: 14.04K (14043) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 14.38M (14378782) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000164 (host=foo.221.30:22000):(Total: 1m9s, non-child: 1m4s, % non-child: 93.75%) Hdfs split stats (:<# splits>/): 3:1/106.00 MB 5:3/712.21 MB 2:2/172.35 MB 6:3/639.50 MB 4:3/336.64 MB 1:2/265.37 MB 7:5/855.92 MB 0:3/337.59 MB Filter 4 arrival: 1s689ms MemoryUsage(2s000ms): 637.37 KB, 223.32 MB, 223.99 MB, 224.12 MB, 223.71 MB, 223.64 MB, 223.46 MB, 223.52 MB, 223.19 MB, 223.59 MB, 223.54 MB, 209.49 MB, 191.59 MB, 191.62 MB, 191.62 MB, 174.26 MB, 158.19 MB, 144.32 MB, 140.25 MB, 120.49 MB, 120.36 MB, 120.49 MB, 120.39 MB, 118.43 MB, 100.60 MB, 96.74 MB, 81.58 MB, 81.08 MB, 81.15 MB, 81.17 MB, 81.15 MB, 73.12 MB, 59.20 MB, 35.41 MB ThreadUsage(2s000ms): 4, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 5.06 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 224.90 MB (235828804) - PerHostPeakMemUsage: 1004.19 MB (1052974577) - RowsProduced: 13.49M (13489536) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m1s - TotalStorageWaitTime: 138.861ms - TotalThreadsInvoluntaryContextSwitches: 7.92K (7916) - TotalThreadsTotalWallClockTime: 5m51s - TotalThreadsSysTime: 3s461ms - TotalThreadsUserTime: 1m9s - TotalThreadsVoluntaryContextSwitches: 293.94K (293941) Fragment Instance Lifecycle Timings: - ExecTime: 1m9s - ExecTreeExecTime: 1s775ms - OpenTime: 27.493ms - ExecTreeOpenTime: 93.448us - PrepareTime: 23.896ms - ExecTreePrepareTime: 282.147us DataStreamSender (dst_id=20):(Total: 2s516ms, non-child: 2s516ms, % non-child: 100.00%) - BytesSent: 321.55 MB (337168735) - OverallThroughput: 127.76 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.49M (13489536) - SerializeBatchTime: 2s512ms - UncompressedRowBatchSize: 321.55 MB (337168735) CodeGen:(Total: 47.684ms, non-child: 47.684ms, % non-child: 100.00%) - CodegenTime: 1.226ms - CompileTime: 7.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.765ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.589ms HDFS_SCAN_NODE (id=1):(Total: 1s764ms, non-child: 1s764ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/106.00 MB 5:3/712.21 MB 2:2/172.35 MB 6:3/639.50 MB 4:3/336.64 MB 1:2/265.37 MB 7:5/855.92 MB 0:3/337.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s646ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:16 BytesRead(2s000ms): 0, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB, 195.03 MB - FooterProcessingTime: (Avg: 4.009ms ; Min: 3.436ms ; Max: 5.594ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.12 - BytesRead: 195.03 MB (204508226) - BytesReadDataNodeCache: 0 - BytesReadLocal: 195.03 MB (204508226) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 195.03 MB (204508226) - CachedFileHandlesHitCount: 38 (38) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 707.237ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 220.90 MB (231634566) - PerReadThreadRawHdfsThroughput: 823.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.174ms - RowBatchQueuePutWaitTime: 3m27s - RowsRead: 13.49M (13489536) - RowsReturned: 13.49M (13489536) - RowsReturnedRate: 7.64 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 6.94K (6943) - ScannerThreadsTotalWallClockTime: 4m41s - MaterializeTupleTime(*): 1s205ms - ScannerThreadsSysTime: 3s217ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 291.06K (291059) - TotalRawHdfsReadTime(*): 236.747ms - TotalReadThroughput: 2.83 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 18 (18) - Files total: 22 (22) - RowGroups processed: 13.18K (13175) - RowGroups rejected: 0 (0) - RowGroups total: 13.18K (13175) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 13.49M (13489536) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000171 (host=foo.221.29:22000):(Total: 1m7s, non-child: 1m3s, % non-child: 93.66%) Hdfs split stats (:<# splits>/): 5:1/54.52 MB 0:3/500.79 MB 3:2/215.14 MB 2:5/601.78 MB 6:2/130.38 MB 1:4/757.52 MB 7:4/539.33 MB 4:2/475.38 MB Filter 4 arrival: 1s683ms MemoryUsage(2s000ms): 59.22 MB, 234.15 MB, 234.00 MB, 234.00 MB, 224.92 MB, 223.86 MB, 210.29 MB, 205.60 MB, 205.41 MB, 205.53 MB, 187.62 MB, 181.65 MB, 181.62 MB, 177.70 MB, 153.81 MB, 141.82 MB, 133.90 MB, 127.95 MB, 109.86 MB, 109.79 MB, 109.93 MB, 99.17 MB, 88.56 MB, 88.43 MB, 88.40 MB, 88.38 MB, 80.46 MB, 64.53 MB, 56.38 MB, 46.85 MB, 34.89 MB, 4.40 MB, 2.50 MB, 2.50 MB ThreadUsage(2s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 4.35 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 235.32 MB (246751088) - PerHostPeakMemUsage: 903.76 MB (947663087) - RowsProduced: 13.94M (13942630) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s820ms - TotalStorageWaitTime: 123.660ms - TotalThreadsInvoluntaryContextSwitches: 6.65K (6647) - TotalThreadsTotalWallClockTime: 4m55s - TotalThreadsSysTime: 3s358ms - TotalThreadsUserTime: 53s984ms - TotalThreadsVoluntaryContextSwitches: 188.62K (188615) Fragment Instance Lifecycle Timings: - ExecTime: 1m7s - ExecTreeExecTime: 1s751ms - OpenTime: 23.131ms - ExecTreeOpenTime: 87.991us - PrepareTime: 24.920ms - ExecTreePrepareTime: 304.140us DataStreamSender (dst_id=20):(Total: 2s520ms, non-child: 2s520ms, % non-child: 100.00%) - BytesSent: 328.16 MB (344096360) - OverallThroughput: 130.18 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.94M (13942630) - SerializeBatchTime: 2s515ms - UncompressedRowBatchSize: 328.16 MB (344096360) CodeGen:(Total: 44.765ms, non-child: 44.765ms, % non-child: 100.00%) - CodegenTime: 1.065ms - CompileTime: 6.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.588ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.938ms HDFS_SCAN_NODE (id=1):(Total: 1s740ms, non-child: 1s740ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/54.52 MB 0:3/500.79 MB 3:2/215.14 MB 2:5/601.78 MB 6:2/130.38 MB 1:4/757.52 MB 7:4/539.33 MB 4:2/475.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 1s646ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:24 BytesRead(1s000ms): 0, 98.25 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB, 196.49 MB - FooterProcessingTime: (Avg: 3.032ms ; Min: 2.433ms ; Max: 3.743ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.62 - BytesRead: 196.49 MB (206038885) - BytesReadDataNodeCache: 0 - BytesReadLocal: 196.49 MB (206038885) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 196.49 MB (206038885) - CachedFileHandlesHitCount: 47 (47) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 732.935ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 231.28 MB (242510679) - PerReadThreadRawHdfsThroughput: 760.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.946ms - RowBatchQueuePutWaitTime: 2m54s - RowsRead: 13.94M (13942630) - RowsReturned: 13.94M (13942630) - RowsReturnedRate: 8.01 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 5.51K (5511) - ScannerThreadsTotalWallClockTime: 3m47s - MaterializeTupleTime(*): 1s211ms - ScannerThreadsSysTime: 3s161ms - ScannerThreadsUserTime: 48s008ms - ScannerThreadsVoluntaryContextSwitches: 185.44K (185444) - TotalRawHdfsReadTime(*): 258.217ms - TotalReadThroughput: 3.12 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 17 (17) - Files total: 23 (23) - RowGroups processed: 13.62K (13618) - RowGroups rejected: 0 (0) - RowGroups total: 13.62K (13618) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 13.94M (13942630) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce180000015c (host=foo.232.37:22000):(Total: 1m6s, non-child: 1m2s, % non-child: 94.87%) Hdfs split stats (:<# splits>/): 0:1/254.00 MB 1:3/673.22 MB 2:2/395.10 MB 5:6/934.77 MB 6:5/759.95 MB 4:4/561.06 MB Filter 4 arrival: 744ms MemoryUsage(2s000ms): 169.58 MB, 225.70 MB, 225.35 MB, 225.29 MB, 225.65 MB, 225.57 MB, 225.50 MB, 225.52 MB, 225.40 MB, 223.40 MB, 197.56 MB, 172.17 MB, 172.14 MB, 154.27 MB, 148.23 MB, 124.40 MB, 124.48 MB, 108.57 MB, 100.50 MB, 100.58 MB, 90.40 MB, 79.06 MB, 78.98 MB, 79.01 MB, 78.80 MB, 78.96 MB, 79.12 MB, 39.97 MB, 33.46 MB, 27.58 MB, 20.74 MB, 3.21 MB, 2.31 MB ThreadUsage(2s000ms): 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 1, 1 - AverageThreadTokens: 4.70 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 226.95 MB (237974046) - PerHostPeakMemUsage: 985.25 MB (1033109981) - RowsProduced: 13.42M (13422459) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 59s027ms - TotalStorageWaitTime: 140.342ms - TotalThreadsInvoluntaryContextSwitches: 8.26K (8259) - TotalThreadsTotalWallClockTime: 5m10s - TotalThreadsSysTime: 12s861ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 1.24M (1238175) Fragment Instance Lifecycle Timings: - ExecTime: 1m6s - ExecTreeExecTime: 835.586ms - OpenTime: 25.079ms - ExecTreeOpenTime: 85.128us - PrepareTime: 31.729ms - ExecTreePrepareTime: 492.593us DataStreamSender (dst_id=20):(Total: 2s519ms, non-child: 2s519ms, % non-child: 100.00%) - BytesSent: 319.24 MB (334748116) - OverallThroughput: 126.71 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.42M (13422459) - SerializeBatchTime: 2s513ms - UncompressedRowBatchSize: 319.24 MB (334748116) CodeGen:(Total: 52.795ms, non-child: 52.795ms, % non-child: 100.00%) - CodegenTime: 1.255ms - CompileTime: 6.925ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.174ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.174ms HDFS_SCAN_NODE (id=1):(Total: 824.203ms, non-child: 824.203ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/254.00 MB 1:3/673.22 MB 2:2/395.10 MB 5:6/934.77 MB 6:5/759.95 MB 4:4/561.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 702ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(1s000ms): 96.45 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB, 192.90 MB - FooterProcessingTime: (Avg: 3.149ms ; Min: 2.574ms ; Max: 4.508ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.87 - BytesRead: 192.90 MB (202265283) - BytesReadDataNodeCache: 0 - BytesReadLocal: 192.90 MB (202265283) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 192.90 MB (202265283) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 702.897ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 222.90 MB (233731775) - PerReadThreadRawHdfsThroughput: 890.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.722ms - RowBatchQueuePutWaitTime: 2m54s - RowsRead: 13.42M (13422459) - RowsReturned: 13.42M (13422459) - RowsReturnedRate: 16.29 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 7.27K (7266) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 1s186ms - ScannerThreadsSysTime: 12s621ms - ScannerThreadsUserTime: 55s190ms - ScannerThreadsVoluntaryContextSwitches: 1.24M (1235248) - TotalRawHdfsReadTime(*): 216.558ms - TotalReadThroughput: 3.06 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 13.11K (13110) - RowGroups rejected: 0 (0) - RowGroups total: 13.11K (13110) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 13.42M (13422459) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000012f (host=foo.232.52:22000):(Total: 1m2s, non-child: 59s140ms, % non-child: 95.09%) Hdfs split stats (:<# splits>/): 1:1/48.39 MB 0:2/189.59 MB 3:1/214.97 MB 5:4/798.10 MB 4:3/615.80 MB 2:1/218.65 MB 6:3/389.01 MB 7:5/1.08 GB Filter 4 arrival: 313ms MemoryUsage(1s000ms): 113.26 MB, 225.83 MB, 225.78 MB, 226.15 MB, 224.90 MB, 225.85 MB, 225.34 MB, 225.08 MB, 225.33 MB, 225.31 MB, 225.42 MB, 225.47 MB, 225.44 MB, 225.43 MB, 225.38 MB, 225.52 MB, 225.34 MB, 225.36 MB, 225.53 MB, 225.33 MB, 209.41 MB, 197.53 MB, 193.63 MB, 193.67 MB, 193.56 MB, 193.75 MB, 193.64 MB, 193.63 MB, 185.68 MB, 169.75 MB, 161.72 MB, 161.64 MB, 149.74 MB, 133.85 MB, 130.00 MB, 129.87 MB, 129.82 MB, 129.97 MB, 120.57 MB, 102.55 MB, 98.41 MB, 86.58 MB, 86.65 MB, 86.56 MB, 86.56 MB, 86.47 MB, 60.57 MB, 49.46 MB, 49.49 MB, 37.36 MB, 33.43 MB, 33.51 MB, 33.36 MB, 25.39 MB, 25.50 MB, 6.39 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(1s000ms): 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.49 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 226.99 MB (238017227) - PerHostPeakMemUsage: 1.02 GB (1098909891) - RowsProduced: 13.52M (13518750) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s833ms - TotalStorageWaitTime: 125.854ms - TotalThreadsInvoluntaryContextSwitches: 4.68K (4677) - TotalThreadsTotalWallClockTime: 4m39s - TotalThreadsSysTime: 9s958ms - TotalThreadsUserTime: 30s136ms - TotalThreadsVoluntaryContextSwitches: 894.28K (894284) Fragment Instance Lifecycle Timings: - ExecTime: 1m2s - ExecTreeExecTime: 414.292ms - OpenTime: 25.204ms - ExecTreeOpenTime: 105.049us - PrepareTime: 27.116ms - ExecTreePrepareTime: 351.088us DataStreamSender (dst_id=20):(Total: 2s602ms, non-child: 2s602ms, % non-child: 100.00%) - BytesSent: 321.40 MB (337011270) - OverallThroughput: 123.50 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.52M (13518750) - SerializeBatchTime: 2s597ms - UncompressedRowBatchSize: 321.40 MB (337011270) CodeGen:(Total: 47.886ms, non-child: 47.886ms, % non-child: 100.00%) - CodegenTime: 1.196ms - CompileTime: 7.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.937ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.144ms HDFS_SCAN_NODE (id=1):(Total: 401.773ms, non-child: 401.773ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/48.39 MB 0:2/189.59 MB 3:1/214.97 MB 5:4/798.10 MB 4:3/615.80 MB 2:1/218.65 MB 6:3/389.01 MB 7:5/1.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 281ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:16 BytesRead(1s000ms): 97.09 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB, 194.17 MB - FooterProcessingTime: (Avg: 3.503ms ; Min: 2.872ms ; Max: 5.067ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 194.17 MB (203605404) - BytesReadDataNodeCache: 0 - BytesReadLocal: 194.17 MB (203605404) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 194.17 MB (203605404) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 726.363ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 222.91 MB (233740901) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.030ms - RowBatchQueuePutWaitTime: 3m1s - RowsRead: 13.52M (13518750) - RowsReturned: 13.52M (13518750) - RowsReturnedRate: 33.65 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 3.71K (3711) - ScannerThreadsTotalWallClockTime: 3m37s - MaterializeTupleTime(*): 1s254ms - ScannerThreadsSysTime: 9s682ms - ScannerThreadsUserTime: 23s939ms - ScannerThreadsVoluntaryContextSwitches: 891.64K (891637) - TotalRawHdfsReadTime(*): 188.251ms - TotalReadThroughput: 3.47 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 16 (16) - Files total: 20 (20) - RowGroups processed: 13.20K (13204) - RowGroups rejected: 0 (0) - RowGroups total: 13.20K (13204) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 13.52M (13518750) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000012e (host=foo.232.49:22000):(Total: 1m1s, non-child: 57s586ms, % non-child: 94.16%) Hdfs split stats (:<# splits>/): 4:2/508.15 MB 0:2/309.09 MB 3:1/254.06 MB 6:3/605.56 MB 7:3/503.17 MB 2:2/76.35 MB 5:3/262.83 MB 1:5/785.28 MB Filter 4 arrival: 743ms MemoryUsage(1s000ms): 581.02 KB, 235.38 MB, 236.09 MB, 235.50 MB, 236.06 MB, 236.10 MB, 235.71 MB, 235.88 MB, 235.97 MB, 235.66 MB, 235.44 MB, 235.82 MB, 235.69 MB, 235.74 MB, 235.81 MB, 235.77 MB, 235.90 MB, 235.57 MB, 235.59 MB, 235.74 MB, 211.91 MB, 211.84 MB, 203.67 MB, 204.01 MB, 203.84 MB, 203.89 MB, 203.85 MB, 195.82 MB, 187.73 MB, 161.64 MB, 143.74 MB, 143.51 MB, 127.73 MB, 127.72 MB, 127.73 MB, 109.86 MB, 91.98 MB, 92.00 MB, 92.00 MB, 92.04 MB, 91.96 MB, 92.12 MB, 92.20 MB, 91.95 MB, 92.13 MB, 91.97 MB, 92.08 MB, 92.11 MB, 84.04 MB, 84.13 MB, 68.10 MB, 52.16 MB, 52.06 MB, 52.29 MB, 35.37 MB, 17.16 MB, 5.73 MB, 2.46 MB, 2.46 MB, 2.46 MB, 2.46 MB ThreadUsage(1s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.54 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 237.12 MB (248633753) - PerHostPeakMemUsage: 1.04 GB (1116945895) - RowsProduced: 14.16M (14159331) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 53s413ms - TotalStorageWaitTime: 143.575ms - TotalThreadsInvoluntaryContextSwitches: 6.16K (6163) - TotalThreadsTotalWallClockTime: 4m40s - TotalThreadsSysTime: 7s298ms - TotalThreadsUserTime: 47s850ms - TotalThreadsVoluntaryContextSwitches: 638.05K (638048) Fragment Instance Lifecycle Timings: - ExecTime: 1m1s - ExecTreeExecTime: 829.399ms - OpenTime: 26.425ms - ExecTreeOpenTime: 77.124us - PrepareTime: 47.656ms - ExecTreePrepareTime: 384.430us DataStreamSender (dst_id=20):(Total: 2s690ms, non-child: 2s690ms, % non-child: 100.00%) - BytesSent: 337.55 MB (353947373) - OverallThroughput: 125.44 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 14.16M (14159331) - SerializeBatchTime: 2s685ms - UncompressedRowBatchSize: 337.55 MB (353947373) CodeGen:(Total: 64.741ms, non-child: 64.741ms, % non-child: 100.00%) - CodegenTime: 1.407ms - CompileTime: 6.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.081ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.139ms HDFS_SCAN_NODE (id=1):(Total: 815.527ms, non-child: 815.527ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/508.15 MB 0:2/309.09 MB 3:1/254.06 MB 6:3/605.56 MB 7:3/503.17 MB 2:2/76.35 MB 5:3/262.83 MB 1:5/785.28 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 682ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB, 203.88 MB - FooterProcessingTime: (Avg: 3.976ms ; Min: 3.277ms ; Max: 5.757ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.82 - BytesRead: 203.88 MB (213788634) - BytesReadDataNodeCache: 0 - BytesReadLocal: 203.88 MB (213788634) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 203.88 MB (213788634) - CachedFileHandlesHitCount: 40 (40) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 749.912ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 233.16 MB (244482291) - PerReadThreadRawHdfsThroughput: 983.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.340ms - RowBatchQueuePutWaitTime: 2m49s - RowsRead: 14.16M (14159331) - RowsReturned: 14.16M (14159331) - RowsReturnedRate: 17.36 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 5.16K (5157) - ScannerThreadsTotalWallClockTime: 3m39s - MaterializeTupleTime(*): 1s275ms - ScannerThreadsSysTime: 7s022ms - ScannerThreadsUserTime: 41s552ms - ScannerThreadsVoluntaryContextSwitches: 635.18K (635181) - TotalRawHdfsReadTime(*): 207.381ms - TotalReadThroughput: 3.58 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 13.83K (13829) - RowGroups rejected: 0 (0) - RowGroups total: 13.83K (13829) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 14.16M (14159331) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000132 (host=foo.232.13:22000):(Total: 1m, non-child: 56s743ms, % non-child: 93.39%) Hdfs split stats (:<# splits>/): 6:2/507.85 MB 7:5/845.98 MB 4:3/542.90 MB 0:3/231.33 MB 2:3/451.49 MB 1:3/671.74 MB 3:2/193.22 MB Filter 4 arrival: 1s400ms MemoryUsage(1s000ms): 693.71 KB, 115.76 MB, 230.07 MB, 229.66 MB, 230.08 MB, 229.69 MB, 229.72 MB, 229.94 MB, 229.73 MB, 229.63 MB, 229.49 MB, 229.30 MB, 229.47 MB, 229.46 MB, 229.45 MB, 229.31 MB, 229.29 MB, 229.30 MB, 229.51 MB, 229.42 MB, 217.48 MB, 178.17 MB, 177.18 MB, 177.16 MB, 177.14 MB, 173.13 MB, 169.27 MB, 165.26 MB, 161.23 MB, 153.33 MB, 141.20 MB, 133.46 MB, 129.54 MB, 129.51 MB, 105.45 MB, 97.09 MB, 96.95 MB, 96.98 MB, 96.98 MB, 97.11 MB, 96.88 MB, 97.03 MB, 97.03 MB, 97.03 MB, 97.10 MB, 92.96 MB, 89.02 MB, 89.05 MB, 64.91 MB, 57.00 MB, 56.94 MB, 53.13 MB, 39.97 MB, 19.04 MB, 3.33 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(1s000ms): 1, 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.41 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 230.98 MB (242203715) - PerHostPeakMemUsage: 1.02 GB (1096524711) - RowsProduced: 13.44M (13441288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 52s712ms - TotalStorageWaitTime: 122.118ms - TotalThreadsInvoluntaryContextSwitches: 6.69K (6688) - TotalThreadsTotalWallClockTime: 4m28s - TotalThreadsSysTime: 12s421ms - TotalThreadsUserTime: 45s134ms - TotalThreadsVoluntaryContextSwitches: 1.47M (1474504) Fragment Instance Lifecycle Timings: - ExecTime: 1m - ExecTreeExecTime: 1s463ms - OpenTime: 30.813ms - ExecTreeOpenTime: 98.823us - PrepareTime: 31.231ms - ExecTreePrepareTime: 240.266us DataStreamSender (dst_id=20):(Total: 2s507ms, non-child: 2s507ms, % non-child: 100.00%) - BytesSent: 318.51 MB (333986260) - OverallThroughput: 127.04 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.44M (13441288) - SerializeBatchTime: 2s501ms - UncompressedRowBatchSize: 318.51 MB (333986260) CodeGen:(Total: 58.886ms, non-child: 58.886ms, % non-child: 100.00%) - CodegenTime: 1.607ms - CompileTime: 7.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 21.839ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.267ms HDFS_SCAN_NODE (id=1):(Total: 1s451ms, non-child: 1s451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/507.85 MB 7:5/845.98 MB 4:3/542.90 MB 0:3/231.33 MB 2:3/451.49 MB 1:3/671.74 MB 3:2/193.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s345ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 96.41 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB, 192.82 MB - FooterProcessingTime: (Avg: 2.712ms ; Min: 2.429ms ; Max: 3.448ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.85 - BytesRead: 192.82 MB (202183534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 192.82 MB (202183534) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 192.82 MB (202183534) - CachedFileHandlesHitCount: 38 (38) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 696.813ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 226.90 MB (237925015) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.709ms - RowBatchQueuePutWaitTime: 2m32s - RowsRead: 13.44M (13441288) - RowsReturned: 13.44M (13441288) - RowsReturnedRate: 9.26 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 5.74K (5738) - ScannerThreadsTotalWallClockTime: 3m27s - MaterializeTupleTime(*): 1s166ms - ScannerThreadsSysTime: 12s215ms - ScannerThreadsUserTime: 39s274ms - ScannerThreadsVoluntaryContextSwitches: 1.47M (1471977) - TotalRawHdfsReadTime(*): 181.813ms - TotalReadThroughput: 3.54 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 13.13K (13129) - RowGroups rejected: 0 (0) - RowGroups total: 13.13K (13129) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 13.44M (13441288) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000150 (host=foo.221.33:22000):(Total: 1m, non-child: 56s354ms, % non-child: 93.41%) Hdfs split stats (:<# splits>/): 4:3/573.89 MB 7:2/198.10 MB 6:3/444.81 MB 5:2/450.01 MB 3:7/885.88 MB 2:1/99.03 MB 1:3/473.90 MB 0:3/443.28 MB Filter 4 arrival: 1s583ms MemoryUsage(1s000ms): 581.02 KB, 61.88 MB, 204.32 MB, 204.52 MB, 204.60 MB, 204.28 MB, 204.24 MB, 204.09 MB, 204.73 MB, 204.46 MB, 204.32 MB, 204.59 MB, 204.14 MB, 204.23 MB, 204.45 MB, 204.37 MB, 204.35 MB, 204.19 MB, 204.37 MB, 204.44 MB, 204.31 MB, 192.39 MB, 176.73 MB, 172.52 MB, 152.79 MB, 152.15 MB, 152.12 MB, 152.19 MB, 152.17 MB, 140.28 MB, 132.27 MB, 128.37 MB, 128.29 MB, 128.34 MB, 112.37 MB, 104.48 MB, 104.39 MB, 104.45 MB, 104.31 MB, 96.50 MB, 84.70 MB, 68.99 MB, 68.35 MB, 53.69 MB, 53.51 MB, 52.69 MB, 52.81 MB, 52.77 MB, 52.79 MB, 52.92 MB, 52.92 MB, 52.93 MB, 36.80 MB, 28.96 MB, 6.19 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.92 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 205.91 MB (215908008) - PerHostPeakMemUsage: 1.02 GB (1091530566) - RowsProduced: 12.02M (12021815) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 52s084ms - TotalStorageWaitTime: 147.737ms - TotalThreadsInvoluntaryContextSwitches: 8.94K (8936) - TotalThreadsTotalWallClockTime: 4m58s - TotalThreadsSysTime: 11s417ms - TotalThreadsUserTime: 1m10s - TotalThreadsVoluntaryContextSwitches: 1.05M (1053307) Fragment Instance Lifecycle Timings: - ExecTime: 1m - ExecTreeExecTime: 1s682ms - OpenTime: 24.111ms - ExecTreeOpenTime: 95.127us - PrepareTime: 29.353ms - ExecTreePrepareTime: 304.243us DataStreamSender (dst_id=20):(Total: 2s258ms, non-child: 2s258ms, % non-child: 100.00%) - BytesSent: 283.77 MB (297556156) - OverallThroughput: 125.63 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.02M (12021815) - SerializeBatchTime: 2s254ms - UncompressedRowBatchSize: 283.77 MB (297556156) CodeGen:(Total: 47.805ms, non-child: 47.805ms, % non-child: 100.00%) - CodegenTime: 1.187ms - CompileTime: 6.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.387ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.512ms HDFS_SCAN_NODE (id=1):(Total: 1s671ms, non-child: 1s671ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:3/573.89 MB 7:2/198.10 MB 6:3/444.81 MB 5:2/450.01 MB 3:7/885.88 MB 2:1/99.03 MB 1:3/473.90 MB 0:3/443.28 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s547ms Hdfs Read Thread Concurrency Bucket: 0:99.09% 1:0% 2:0% 3:0.9091% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 43.74 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB, 171.36 MB - FooterProcessingTime: (Avg: 3.096ms ; Min: 3.031ms ; Max: 3.187ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.31 - BytesRead: 171.36 MB (179686194) - BytesReadDataNodeCache: 0 - BytesReadLocal: 171.36 MB (179686194) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 171.36 MB (179686194) - CachedFileHandlesHitCount: 36 (36) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 635.308ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 201.91 MB (211713536) - PerReadThreadRawHdfsThroughput: 753.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.464ms - RowBatchQueuePutWaitTime: 2m33s - RowsRead: 12.02M (12021815) - RowsReturned: 12.02M (12021815) - RowsReturnedRate: 7.19 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 8.11K (8114) - ScannerThreadsTotalWallClockTime: 3m57s - MaterializeTupleTime(*): 1s075ms - ScannerThreadsSysTime: 11s165ms - ScannerThreadsUserTime: 1m5s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1050863) - TotalRawHdfsReadTime(*): 227.549ms - TotalReadThroughput: 3.12 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 20 (20) - Files total: 24 (24) - RowGroups processed: 11.74K (11743) - RowGroups rejected: 0 (0) - RowGroups total: 11.74K (11743) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 12.02M (12021815) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000014f (host=foo.221.46:22000):(Total: 1m, non-child: 56s276ms, % non-child: 93.42%) Hdfs split stats (:<# splits>/): 7:3/483.70 MB 5:2/170.81 MB 2:3/594.99 MB 0:2/458.84 MB 4:2/420.95 MB 1:3/501.99 MB 6:3/459.64 MB 3:3/304.70 MB Filter 4 arrival: 1s485ms MemoryUsage(1s000ms): 581.02 KB, 104.20 MB, 209.01 MB, 207.88 MB, 208.80 MB, 208.65 MB, 208.87 MB, 208.51 MB, 208.41 MB, 208.80 MB, 208.75 MB, 208.58 MB, 208.55 MB, 208.51 MB, 196.60 MB, 188.69 MB, 184.71 MB, 184.68 MB, 184.70 MB, 184.80 MB, 184.70 MB, 176.72 MB, 172.83 MB, 160.69 MB, 160.44 MB, 152.77 MB, 148.74 MB, 140.80 MB, 136.81 MB, 136.97 MB, 125.11 MB, 121.08 MB, 113.26 MB, 106.73 MB, 99.55 MB, 99.59 MB, 99.60 MB, 99.59 MB, 99.39 MB, 99.55 MB, 99.42 MB, 99.59 MB, 87.44 MB, 79.45 MB, 67.47 MB, 67.55 MB, 67.60 MB, 67.60 MB, 67.49 MB, 67.47 MB, 59.67 MB, 59.61 MB, 59.65 MB, 44.84 MB, 29.41 MB, 3.92 MB, 2.51 MB, 2.51 MB, 2.51 MB, 2.51 MB ThreadUsage(1s000ms): 1, 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.67 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 210.09 MB (220292135) - PerHostPeakMemUsage: 1010.05 MB (1059118673) - RowsProduced: 12.60M (12597143) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 51s630ms - TotalStorageWaitTime: 89.848ms - TotalThreadsInvoluntaryContextSwitches: 3.62K (3615) - TotalThreadsTotalWallClockTime: 3m41s - TotalThreadsSysTime: 756.884ms - TotalThreadsUserTime: 30s095ms - TotalThreadsVoluntaryContextSwitches: 78.80K (78804) Fragment Instance Lifecycle Timings: - ExecTime: 1m - ExecTreeExecTime: 1s563ms - OpenTime: 28.540ms - ExecTreeOpenTime: 103.022us - PrepareTime: 29.035ms - ExecTreePrepareTime: 557.015us DataStreamSender (dst_id=20):(Total: 2s359ms, non-child: 2s359ms, % non-child: 100.00%) - BytesSent: 297.07 MB (311499533) - OverallThroughput: 125.89 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.60M (12597143) - SerializeBatchTime: 2s354ms - UncompressedRowBatchSize: 297.07 MB (311499533) CodeGen:(Total: 50.778ms, non-child: 50.778ms, % non-child: 100.00%) - CodegenTime: 1.338ms - CompileTime: 8.993ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.757ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.444ms HDFS_SCAN_NODE (id=1):(Total: 1s554ms, non-child: 1s554ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:3/483.70 MB 5:2/170.81 MB 2:3/594.99 MB 0:2/458.84 MB 4:2/420.95 MB 1:3/501.99 MB 6:3/459.64 MB 3:3/304.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s444ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 88.69 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB, 177.39 MB - FooterProcessingTime: (Avg: 3.578ms ; Min: 3.160ms ; Max: 3.798ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.89 - BytesRead: 177.39 MB (186001970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.39 MB (186001970) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.39 MB (186001970) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 665.363ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 206.02 MB (216031843) - PerReadThreadRawHdfsThroughput: 874.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.681ms - RowBatchQueuePutWaitTime: 2m15s - RowsRead: 12.60M (12597143) - RowsReturned: 12.60M (12597143) - RowsReturnedRate: 8.11 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 2.76K (2757) - ScannerThreadsTotalWallClockTime: 2m40s - MaterializeTupleTime(*): 1s097ms - ScannerThreadsSysTime: 551.915ms - ScannerThreadsUserTime: 24s593ms - ScannerThreadsVoluntaryContextSwitches: 76.00K (75995) - TotalRawHdfsReadTime(*): 202.861ms - TotalReadThroughput: 3.20 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 12.30K (12304) - RowGroups rejected: 0 (0) - RowGroups total: 12.30K (12304) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.60M (12597143) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000011d (host=foo.232.51:22000):(Total: 58s912ms, non-child: 55s751ms, % non-child: 94.63%) Hdfs split stats (:<# splits>/): 1:2/347.69 MB 7:2/325.91 MB 4:1/254.02 MB 5:4/579.61 MB 3:3/761.84 MB 2:5/467.79 MB 6:3/742.35 MB Filter 4 arrival: 360ms MemoryUsage(1s000ms): 209.59 MB, 230.50 MB, 230.59 MB, 229.99 MB, 230.50 MB, 230.57 MB, 230.08 MB, 230.18 MB, 230.35 MB, 230.52 MB, 230.31 MB, 230.56 MB, 230.39 MB, 230.36 MB, 230.46 MB, 230.38 MB, 230.32 MB, 206.44 MB, 198.53 MB, 198.62 MB, 198.56 MB, 187.32 MB, 175.77 MB, 175.17 MB, 159.35 MB, 155.40 MB, 151.28 MB, 135.35 MB, 127.55 MB, 127.40 MB, 127.40 MB, 127.47 MB, 100.49 MB, 92.09 MB, 92.11 MB, 92.05 MB, 92.12 MB, 92.07 MB, 92.06 MB, 92.09 MB, 92.20 MB, 92.02 MB, 92.12 MB, 92.08 MB, 80.16 MB, 76.17 MB, 60.05 MB, 60.23 MB, 60.23 MB, 60.10 MB, 60.16 MB, 52.26 MB, 44.38 MB, 44.28 MB, 44.28 MB, 16.53 MB, 2.45 MB, 2.45 MB ThreadUsage(1s000ms): 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1 - AverageThreadTokens: 4.79 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 231.98 MB (243247520) - PerHostPeakMemUsage: 989.62 MB (1037691702) - RowsProduced: 13.94M (13939588) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 51s800ms - TotalStorageWaitTime: 120.546ms - TotalThreadsInvoluntaryContextSwitches: 7.20K (7196) - TotalThreadsTotalWallClockTime: 4m39s - TotalThreadsSysTime: 5s747ms - TotalThreadsUserTime: 59s205ms - TotalThreadsVoluntaryContextSwitches: 604.43K (604430) Fragment Instance Lifecycle Timings: - ExecTime: 58s852ms - ExecTreeExecTime: 458.294ms - OpenTime: 25.398ms - ExecTreeOpenTime: 71.422us - PrepareTime: 34.958ms - ExecTreePrepareTime: 341.974us DataStreamSender (dst_id=20):(Total: 2s663ms, non-child: 2s663ms, % non-child: 100.00%) - BytesSent: 331.58 MB (347686545) - OverallThroughput: 124.50 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.94M (13939588) - SerializeBatchTime: 2s658ms - UncompressedRowBatchSize: 331.58 MB (347686545) CodeGen:(Total: 53.420ms, non-child: 53.420ms, % non-child: 100.00%) - CodegenTime: 1.106ms - CompileTime: 6.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.022ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.438ms HDFS_SCAN_NODE (id=1):(Total: 444.949ms, non-child: 444.949ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/347.69 MB 7:2/325.91 MB 4:1/254.02 MB 5:4/579.61 MB 3:3/761.84 MB 2:5/467.79 MB 6:3/742.35 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 321ms Hdfs Read Thread Concurrency Bucket: 0:99.11% 1:0% 2:0% 3:0.8929% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:16 BytesRead(1s000ms): 167.95 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB, 199.67 MB - FooterProcessingTime: (Avg: 2.617ms ; Min: 2.459ms ; Max: 3.024ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 3.96 - BytesRead: 199.67 MB (209369738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 199.67 MB (209369738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 199.67 MB (209369738) - CachedFileHandlesHitCount: 38 (38) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 722.235ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 227.90 MB (238971722) - PerReadThreadRawHdfsThroughput: 913.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.788ms - RowBatchQueuePutWaitTime: 2m41s - RowsRead: 13.94M (13939588) - RowsReturned: 13.94M (13939588) - RowsReturnedRate: 31.33 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 6.19K (6186) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 1s221ms - ScannerThreadsSysTime: 5s527ms - ScannerThreadsUserTime: 53s019ms - ScannerThreadsVoluntaryContextSwitches: 601.76K (601760) - TotalRawHdfsReadTime(*): 218.521ms - TotalReadThroughput: 3.57 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 16 (16) - Files total: 20 (20) - RowGroups processed: 13.62K (13615) - RowGroups rejected: 0 (0) - RowGroups total: 13.62K (13615) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 13.94M (13939588) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000154 (host=foo.221.50:22000):(Total: 56s611ms, non-child: 52s958ms, % non-child: 93.55%) Hdfs split stats (:<# splits>/): 3:2/215.33 MB 6:4/292.72 MB 4:3/477.68 MB 1:2/332.87 MB 7:3/331.98 MB 0:5/884.76 MB 2:3/526.86 MB 5:3/462.36 MB Filter 4 arrival: 1s424ms MemoryUsage(1s000ms): 578.71 KB, 99.69 MB, 196.73 MB, 196.68 MB, 198.38 MB, 197.38 MB, 197.24 MB, 197.32 MB, 197.79 MB, 197.36 MB, 197.31 MB, 197.59 MB, 197.05 MB, 197.22 MB, 197.60 MB, 197.36 MB, 197.19 MB, 197.63 MB, 197.75 MB, 197.40 MB, 197.43 MB, 197.37 MB, 193.39 MB, 173.58 MB, 165.53 MB, 165.44 MB, 154.37 MB, 131.49 MB, 110.84 MB, 102.89 MB, 102.86 MB, 98.81 MB, 94.80 MB, 86.95 MB, 86.98 MB, 86.94 MB, 79.00 MB, 75.09 MB, 70.96 MB, 70.87 MB, 71.02 MB, 70.97 MB, 71.15 MB, 60.77 MB, 49.39 MB, 49.31 MB, 49.32 MB, 49.36 MB, 49.36 MB, 37.36 MB, 25.56 MB, 6.56 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(1s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.68 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 198.98 MB (208644209) - PerHostPeakMemUsage: 972.84 MB (1020096324) - RowsProduced: 11.73M (11729551) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 49s192ms - TotalStorageWaitTime: 114.492ms - TotalThreadsInvoluntaryContextSwitches: 7.84K (7836) - TotalThreadsTotalWallClockTime: 4m26s - TotalThreadsSysTime: 9s491ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 873.39K (873391) Fragment Instance Lifecycle Timings: - ExecTime: 56s550ms - ExecTreeExecTime: 1s476ms - OpenTime: 25.416ms - ExecTreeOpenTime: 86.820us - PrepareTime: 35.906ms - ExecTreePrepareTime: 257.283us DataStreamSender (dst_id=20):(Total: 2s128ms, non-child: 2s128ms, % non-child: 100.00%) - BytesSent: 278.71 MB (292249239) - OverallThroughput: 130.97 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.73M (11729551) - SerializeBatchTime: 2s124ms - UncompressedRowBatchSize: 278.71 MB (292249239) CodeGen:(Total: 57.728ms, non-child: 57.728ms, % non-child: 100.00%) - CodegenTime: 1.258ms - CompileTime: 6.892ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.491ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.906ms HDFS_SCAN_NODE (id=1):(Total: 1s467ms, non-child: 1s467ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/215.33 MB 6:4/292.72 MB 4:3/477.68 MB 1:2/332.87 MB 7:3/331.98 MB 0:5/884.76 MB 2:3/526.86 MB 5:3/462.36 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s364ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 84.09 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB, 168.18 MB - FooterProcessingTime: (Avg: 2.481ms ; Min: 2.269ms ; Max: 2.680ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.08 - BytesRead: 168.18 MB (176346587) - BytesReadDataNodeCache: 0 - BytesReadLocal: 168.18 MB (176346587) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 168.18 MB (176346587) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 614.072ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 194.90 MB (204371356) - PerReadThreadRawHdfsThroughput: 901.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.856ms - RowBatchQueuePutWaitTime: 2m20s - RowsRead: 11.73M (11729551) - RowsReturned: 11.73M (11729551) - RowsReturnedRate: 7.99 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 6.97K (6969) - ScannerThreadsTotalWallClockTime: 3m29s - MaterializeTupleTime(*): 1s030ms - ScannerThreadsSysTime: 9s314ms - ScannerThreadsUserTime: 56s519ms - ScannerThreadsVoluntaryContextSwitches: 870.66K (870663) - TotalRawHdfsReadTime(*): 186.471ms - TotalReadThroughput: 3.23 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 21 (21) - Files total: 25 (25) - RowGroups processed: 11.46K (11456) - RowGroups rejected: 0 (0) - RowGroups total: 11.46K (11456) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 11.73M (11729551) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000178 (host=foo.221.51:22000):(Total: 54s928ms, non-child: 51s123ms, % non-child: 93.07%) Hdfs split stats (:<# splits>/): 4:4/671.26 MB 0:2/275.79 MB 5:1/253.84 MB 2:3/523.23 MB 6:1/254.01 MB 3:4/837.30 MB 1:4/678.17 MB 7:1/175.03 MB Filter 4 arrival: 1s416ms MemoryUsage(1s000ms): 581.02 KB, 110.87 MB, 197.20 MB, 197.65 MB, 197.75 MB, 197.24 MB, 196.98 MB, 197.68 MB, 197.62 MB, 197.21 MB, 197.90 MB, 197.85 MB, 197.32 MB, 197.50 MB, 185.60 MB, 173.69 MB, 173.87 MB, 173.78 MB, 173.92 MB, 173.60 MB, 169.69 MB, 157.73 MB, 149.77 MB, 141.91 MB, 133.99 MB, 125.89 MB, 125.84 MB, 122.04 MB, 99.44 MB, 95.36 MB, 91.47 MB, 91.47 MB, 91.44 MB, 91.22 MB, 91.48 MB, 91.50 MB, 91.43 MB, 79.50 MB, 75.47 MB, 75.55 MB, 75.40 MB, 59.63 MB, 59.59 MB, 59.80 MB, 51.79 MB, 45.14 MB, 34.10 MB, 18.83 MB, 3.28 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.59 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 199.16 MB (208839192) - PerHostPeakMemUsage: 947.23 MB (993240948) - RowsProduced: 12.14M (12138974) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 46s966ms - TotalStorageWaitTime: 93.972ms - TotalThreadsInvoluntaryContextSwitches: 3.47K (3469) - TotalThreadsTotalWallClockTime: 3m14s - TotalThreadsSysTime: 1s420ms - TotalThreadsUserTime: 28s002ms - TotalThreadsVoluntaryContextSwitches: 142.64K (142636) Fragment Instance Lifecycle Timings: - ExecTime: 54s864ms - ExecTreeExecTime: 1s494ms - OpenTime: 27.692ms - ExecTreeOpenTime: 107.878us - PrepareTime: 36.723ms - ExecTreePrepareTime: 285.324us DataStreamSender (dst_id=20):(Total: 2s268ms, non-child: 2s268ms, % non-child: 100.00%) - BytesSent: 287.18 MB (301129610) - OverallThroughput: 126.61 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.14M (12138974) - SerializeBatchTime: 2s263ms - UncompressedRowBatchSize: 287.18 MB (301129610) CodeGen:(Total: 53.911ms, non-child: 53.911ms, % non-child: 100.00%) - CodegenTime: 1.691ms - CompileTime: 7.045ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.598ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.607ms HDFS_SCAN_NODE (id=1):(Total: 1s483ms, non-child: 1s483ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:4/671.26 MB 0:2/275.79 MB 5:1/253.84 MB 2:3/523.23 MB 6:1/254.01 MB 3:4/837.30 MB 1:4/678.17 MB 7:1/175.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s364ms Hdfs Read Thread Concurrency Bucket: 0:98.97% 1:0% 2:0% 3:1.031% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 87.43 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB, 172.29 MB - FooterProcessingTime: (Avg: 3.160ms ; Min: 2.982ms ; Max: 3.514ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 172.29 MB (180663000) - BytesReadDataNodeCache: 0 - BytesReadLocal: 172.29 MB (180663000) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 172.29 MB (180663000) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 646.526ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 195.09 MB (204568132) - PerReadThreadRawHdfsThroughput: 862.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.345ms - RowBatchQueuePutWaitTime: 1m55s - RowsRead: 12.14M (12138974) - RowsReturned: 12.14M (12138974) - RowsReturnedRate: 8.19 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 2.57K (2572) - ScannerThreadsTotalWallClockTime: 2m19s - MaterializeTupleTime(*): 1s081ms - ScannerThreadsSysTime: 1s205ms - ScannerThreadsUserTime: 22s542ms - ScannerThreadsVoluntaryContextSwitches: 139.92K (139917) - TotalRawHdfsReadTime(*): 199.813ms - TotalReadThroughput: 3.55 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 17 (17) - Files total: 20 (20) - RowGroups processed: 11.86K (11856) - RowGroups rejected: 0 (0) - RowGroups total: 11.86K (11856) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.14M (12138974) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000018c (host=foo.232.12:22000):(Total: 54s509ms, non-child: 50s528ms, % non-child: 92.70%) Hdfs split stats (:<# splits>/): 7:1/182.89 MB 0:3/459.28 MB 3:3/631.13 MB 4:3/442.50 MB 5:5/697.15 MB 1:5/701.12 MB 2:2/392.98 MB Filter 4 arrival: 1s424ms MemoryUsage(1s000ms): 581.02 KB, 118.40 MB, 217.94 MB, 216.85 MB, 217.09 MB, 217.32 MB, 217.35 MB, 216.89 MB, 216.80 MB, 217.00 MB, 217.09 MB, 217.27 MB, 216.74 MB, 205.09 MB, 193.24 MB, 193.04 MB, 193.17 MB, 193.12 MB, 193.14 MB, 193.24 MB, 181.16 MB, 177.24 MB, 169.15 MB, 161.23 MB, 157.33 MB, 153.40 MB, 145.40 MB, 145.53 MB, 121.48 MB, 121.78 MB, 121.79 MB, 121.46 MB, 121.54 MB, 121.71 MB, 121.54 MB, 109.26 MB, 96.06 MB, 96.22 MB, 95.99 MB, 92.14 MB, 88.31 MB, 84.27 MB, 72.19 MB, 64.27 MB, 64.32 MB, 64.32 MB, 56.29 MB, 29.40 MB, 2.49 MB, 2.49 MB, 2.49 MB, 2.49 MB, 2.49 MB, 2.49 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.87 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 218.58 MB (229198565) - PerHostPeakMemUsage: 979.97 MB (1027574542) - RowsProduced: 12.92M (12922848) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 46s225ms - TotalStorageWaitTime: 96.078ms - TotalThreadsInvoluntaryContextSwitches: 10.03K (10028) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 9s010ms - TotalThreadsUserTime: 1m18s - TotalThreadsVoluntaryContextSwitches: 524.31K (524309) Fragment Instance Lifecycle Timings: - ExecTime: 54s459ms - ExecTreeExecTime: 1s515ms - OpenTime: 27.109ms - ExecTreeOpenTime: 100.116us - PrepareTime: 22.010ms - ExecTreePrepareTime: 326.901us DataStreamSender (dst_id=20):(Total: 2s431ms, non-child: 2s431ms, % non-child: 100.00%) - BytesSent: 305.56 MB (320400425) - OverallThroughput: 125.67 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.92M (12922848) - SerializeBatchTime: 2s426ms - UncompressedRowBatchSize: 305.56 MB (320400425) CodeGen:(Total: 45.852ms, non-child: 45.852ms, % non-child: 100.00%) - CodegenTime: 1.087ms - CompileTime: 7.137ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.133ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.124ms HDFS_SCAN_NODE (id=1):(Total: 1s503ms, non-child: 1s503ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/182.89 MB 0:3/459.28 MB 3:3/631.13 MB 4:3/442.50 MB 5:5/697.15 MB 1:5/701.12 MB 2:2/392.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s386ms Hdfs Read Thread Concurrency Bucket: 0:98.95% 1:0% 2:0% 3:1.053% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 92.13 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB, 183.96 MB - FooterProcessingTime: (Avg: 2.965ms ; Min: 2.873ms ; Max: 3.013ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 183.96 MB (192900555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.96 MB (192900555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.96 MB (192900555) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 686.311ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 214.52 MB (224944551) - PerReadThreadRawHdfsThroughput: 851.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.049ms - RowBatchQueuePutWaitTime: 2m4s - RowsRead: 12.92M (12922848) - RowsReturned: 12.92M (12922848) - RowsReturnedRate: 8.60 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 9.09K (9089) - ScannerThreadsTotalWallClockTime: 3m31s - MaterializeTupleTime(*): 1s135ms - ScannerThreadsSysTime: 8s783ms - ScannerThreadsUserTime: 1m13s - ScannerThreadsVoluntaryContextSwitches: 521.90K (521903) - TotalRawHdfsReadTime(*): 215.950ms - TotalReadThroughput: 3.87 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 12.62K (12622) - RowGroups rejected: 0 (0) - RowGroups total: 12.62K (12622) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.92M (12922848) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000156 (host=foo.232.32:22000):(Total: 54s283ms, non-child: 51s490ms, % non-child: 94.86%) Hdfs split stats (:<# splits>/): 5:1/176.66 MB 6:2/167.29 MB 2:2/281.16 MB 7:3/299.96 MB 0:2/218.13 MB 3:3/357.98 MB 1:5/858.74 MB 4:5/838.56 MB Filter 4 arrival: 966ms MemoryUsage(1s000ms): 581.02 KB, 153.50 MB, 153.48 MB, 153.69 MB, 152.94 MB, 152.89 MB, 148.07 MB, 143.69 MB, 143.29 MB, 143.31 MB, 142.88 MB, 142.66 MB, 142.98 MB, 143.14 MB, 143.32 MB, 143.06 MB, 143.22 MB, 143.16 MB, 143.17 MB, 143.15 MB, 142.75 MB, 142.95 MB, 142.95 MB, 143.09 MB, 123.33 MB, 119.36 MB, 119.00 MB, 119.29 MB, 118.93 MB, 96.32 MB, 95.62 MB, 95.69 MB, 95.57 MB, 79.96 MB, 64.00 MB, 56.19 MB, 43.83 MB, 39.45 MB, 39.56 MB, 39.51 MB, 39.43 MB, 39.45 MB, 39.50 MB, 39.49 MB, 39.47 MB, 35.54 MB, 23.51 MB, 4.30 MB, 2.51 MB, 2.51 MB, 2.51 MB, 2.51 MB, 2.51 MB, 2.51 MB ThreadUsage(1s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.93 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 154.46 MB (161960326) - PerHostPeakMemUsage: 984.00 MB (1031798095) - RowsProduced: 9.19M (9191424) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 47s642ms - TotalStorageWaitTime: 100.494ms - TotalThreadsInvoluntaryContextSwitches: 5.33K (5334) - TotalThreadsTotalWallClockTime: 3m33s - TotalThreadsSysTime: 8s328ms - TotalThreadsUserTime: 38s783ms - TotalThreadsVoluntaryContextSwitches: 992.27K (992272) Fragment Instance Lifecycle Timings: - ExecTime: 54s225ms - ExecTreeExecTime: 1s008ms - OpenTime: 26.481ms - ExecTreeOpenTime: 110.090us - PrepareTime: 31.383ms - ExecTreePrepareTime: 345.729us DataStreamSender (dst_id=20):(Total: 1s738ms, non-child: 1s738ms, % non-child: 100.00%) - BytesSent: 214.39 MB (224808413) - OverallThroughput: 123.35 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.19M (9191424) - SerializeBatchTime: 1s734ms - UncompressedRowBatchSize: 214.39 MB (224808413) CodeGen:(Total: 54.088ms, non-child: 54.088ms, % non-child: 100.00%) - CodegenTime: 1.479ms - CompileTime: 6.963ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.373ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.096ms HDFS_SCAN_NODE (id=1):(Total: 1s000ms, non-child: 1s000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/176.66 MB 6:2/167.29 MB 2:2/281.16 MB 7:3/299.96 MB 0:2/218.13 MB 3:3/357.98 MB 1:5/858.74 MB 4:5/838.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB, 129.73 MB - FooterProcessingTime: (Avg: 3.407ms ; Min: 2.545ms ; Max: 4.703ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.33 - BytesRead: 129.73 MB (136029384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 129.73 MB (136029384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 129.73 MB (136029384) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 490.952ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 150.39 MB (157694544) - PerReadThreadRawHdfsThroughput: 935.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.268ms - RowBatchQueuePutWaitTime: 1m53s - RowsRead: 9.19M (9191424) - RowsReturned: 9.19M (9191424) - RowsReturnedRate: 9.19 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 4.66K (4655) - ScannerThreadsTotalWallClockTime: 2m38s - MaterializeTupleTime(*): 800.158ms - ScannerThreadsSysTime: 8s153ms - ScannerThreadsUserTime: 34s681ms - ScannerThreadsVoluntaryContextSwitches: 989.93K (989928) - TotalRawHdfsReadTime(*): 138.715ms - TotalReadThroughput: 2.73 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 19 (19) - Files total: 23 (23) - RowGroups processed: 8.98K (8978) - RowGroups rejected: 0 (0) - RowGroups total: 8.98K (8978) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 9.19M (9191424) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000190 (host=foo.221.18:22000):(Total: 53s389ms, non-child: 49s625ms, % non-child: 92.95%) Hdfs split stats (:<# splits>/): 0:1/243.97 MB 2:1/99.69 MB 1:5/875.77 MB 4:2/508.01 MB 6:1/254.00 MB 3:1/62.86 MB 5:3/715.60 MB 7:4/651.37 MB Filter 4 arrival: 1s767ms MemoryUsage(1s000ms): 581.02 KB, 82.64 MB, 163.00 MB, 163.92 MB, 163.81 MB, 163.95 MB, 163.78 MB, 163.48 MB, 163.07 MB, 162.88 MB, 163.21 MB, 162.98 MB, 162.94 MB, 159.08 MB, 147.06 MB, 147.34 MB, 147.16 MB, 147.05 MB, 147.06 MB, 131.46 MB, 127.26 MB, 119.33 MB, 115.39 MB, 111.41 MB, 103.44 MB, 99.52 MB, 99.50 MB, 99.48 MB, 99.33 MB, 99.45 MB, 99.62 MB, 99.57 MB, 99.48 MB, 99.60 MB, 99.47 MB, 99.50 MB, 95.46 MB, 79.75 MB, 71.46 MB, 67.57 MB, 67.60 MB, 67.40 MB, 67.67 MB, 67.76 MB, 67.74 MB, 59.76 MB, 59.79 MB, 44.90 MB, 3.95 MB, 2.49 MB, 2.49 MB, 2.49 MB, 2.49 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.77 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 164.72 MB (172725259) - PerHostPeakMemUsage: 977.15 MB (1024615270) - RowsProduced: 9.90M (9903656) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s894ms - TotalStorageWaitTime: 58.185ms - TotalThreadsInvoluntaryContextSwitches: 11.78K (11781) - TotalThreadsTotalWallClockTime: 4m13s - TotalThreadsSysTime: 14s121ms - TotalThreadsUserTime: 1m32s - TotalThreadsVoluntaryContextSwitches: 1.33M (1325245) Fragment Instance Lifecycle Timings: - ExecTime: 53s335ms - ExecTreeExecTime: 1s837ms - OpenTime: 24.376ms - ExecTreeOpenTime: 83.438us - PrepareTime: 29.906ms - ExecTreePrepareTime: 381.786us DataStreamSender (dst_id=20):(Total: 1s886ms, non-child: 1s886ms, % non-child: 100.00%) - BytesSent: 230.38 MB (241574114) - OverallThroughput: 122.15 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.90M (9903656) - SerializeBatchTime: 1s882ms - UncompressedRowBatchSize: 230.38 MB (241574114) CodeGen:(Total: 50.249ms, non-child: 50.249ms, % non-child: 100.00%) - CodegenTime: 1.163ms - CompileTime: 6.821ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.611ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.319ms HDFS_SCAN_NODE (id=1):(Total: 1s828ms, non-child: 1s828ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/243.97 MB 2:1/99.69 MB 1:5/875.77 MB 4:2/508.01 MB 6:1/254.00 MB 3:1/62.86 MB 5:3/715.60 MB 7:4/651.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s727ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 68.54 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB, 137.08 MB - FooterProcessingTime: (Avg: 3.367ms ; Min: 3.341ms ; Max: 3.393ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.12 - BytesRead: 137.08 MB (143742838) - BytesReadDataNodeCache: 0 - BytesReadLocal: 137.08 MB (143742838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 137.08 MB (143742838) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 525.796ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 160.64 MB (168448196) - PerReadThreadRawHdfsThroughput: 1013.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.719ms - RowBatchQueuePutWaitTime: 1m30s - RowsRead: 9.90M (9903656) - RowsReturned: 9.90M (9903656) - RowsReturnedRate: 5.42 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 11.08K (11080) - ScannerThreadsTotalWallClockTime: 3m20s - MaterializeTupleTime(*): 862.450ms - ScannerThreadsSysTime: 13s925ms - ScannerThreadsUserTime: 1m28s - ScannerThreadsVoluntaryContextSwitches: 1.32M (1322813) - TotalRawHdfsReadTime(*): 135.294ms - TotalReadThroughput: 2.83 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 16 (16) - Files total: 18 (18) - RowGroups processed: 9.67K (9673) - RowGroups rejected: 0 (0) - RowGroups total: 9.67K (9673) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.90M (9903656) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000013d (host=foo.221.15:22000):(Total: 53s247ms, non-child: 49s288ms, % non-child: 92.57%) Hdfs split stats (:<# splits>/): 4:3/464.47 MB 0:2/219.79 MB 2:4/991.88 MB 7:3/387.21 MB 1:3/470.51 MB 5:5/729.71 MB 6:2/172.77 MB Filter 4 arrival: 1s817ms MemoryUsage(1s000ms): 581.02 KB, 88.04 MB, 193.62 MB, 193.54 MB, 193.44 MB, 194.00 MB, 193.88 MB, 193.65 MB, 186.82 MB, 178.99 MB, 179.44 MB, 179.22 MB, 179.24 MB, 179.36 MB, 179.06 MB, 179.11 MB, 175.03 MB, 159.19 MB, 155.48 MB, 155.17 MB, 155.25 MB, 155.19 MB, 155.36 MB, 155.14 MB, 151.31 MB, 135.40 MB, 131.47 MB, 127.56 MB, 107.49 MB, 107.47 MB, 99.77 MB, 83.01 MB, 75.19 MB, 75.14 MB, 75.19 MB, 75.05 MB, 75.24 MB, 75.03 MB, 50.58 MB, 49.47 MB, 49.49 MB, 37.51 MB, 33.55 MB, 33.58 MB, 33.51 MB, 25.76 MB, 25.76 MB, 4.87 MB, 2.56 MB, 2.56 MB, 2.56 MB, 2.56 MB, 2.56 MB ThreadUsage(1s000ms): 1, 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.43 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 194.97 MB (204435938) - PerHostPeakMemUsage: 989.32 MB (1037379121) - RowsProduced: 11.53M (11534594) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45s451ms - TotalStorageWaitTime: 99.008ms - TotalThreadsInvoluntaryContextSwitches: 7.91K (7907) - TotalThreadsTotalWallClockTime: 3m55s - TotalThreadsSysTime: 8s826ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 1.05M (1050552) Fragment Instance Lifecycle Timings: - ExecTime: 53s192ms - ExecTreeExecTime: 1s864ms - OpenTime: 30.396ms - ExecTreeOpenTime: 83.225us - PrepareTime: 24.273ms - ExecTreePrepareTime: 325.928us DataStreamSender (dst_id=20):(Total: 2s050ms, non-child: 2s050ms, % non-child: 100.00%) - BytesSent: 271.23 MB (284409220) - OverallThroughput: 132.28 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.53M (11534594) - SerializeBatchTime: 2s046ms - UncompressedRowBatchSize: 271.23 MB (284409220) CodeGen:(Total: 51.380ms, non-child: 51.380ms, % non-child: 100.00%) - CodegenTime: 1.814ms - CompileTime: 6.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.625ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.559ms HDFS_SCAN_NODE (id=1):(Total: 1s856ms, non-child: 1s856ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:3/464.47 MB 0:2/219.79 MB 2:4/991.88 MB 7:3/387.21 MB 1:3/470.51 MB 5:5/729.71 MB 6:2/172.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s767ms Hdfs Read Thread Concurrency Bucket: 0:98.96% 1:1.042% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 69.77 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB, 163.35 MB - FooterProcessingTime: (Avg: 2.675ms ; Min: 2.495ms ; Max: 2.808ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 3.79 - BytesRead: 163.35 MB (171286503) - BytesReadDataNodeCache: 0 - BytesReadLocal: 163.35 MB (171286503) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 163.35 MB (171286503) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 600.207ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 191.02 MB (200295922) - PerReadThreadRawHdfsThroughput: 972.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.334ms - RowBatchQueuePutWaitTime: 1m55s - RowsRead: 11.53M (11534594) - RowsReturned: 11.53M (11534594) - RowsReturnedRate: 6.21 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 7.07K (7074) - ScannerThreadsTotalWallClockTime: 3m2s - MaterializeTupleTime(*): 1s065ms - ScannerThreadsSysTime: 8s630ms - ScannerThreadsUserTime: 56s553ms - ScannerThreadsVoluntaryContextSwitches: 1.05M (1048236) - TotalRawHdfsReadTime(*): 168.055ms - TotalReadThroughput: 3.40 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 18 (18) - Files total: 22 (22) - RowGroups processed: 11.27K (11265) - RowGroups rejected: 0 (0) - RowGroups total: 11.27K (11265) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 11.53M (11534594) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000017d (host=foo.232.17:22000):(Total: 50s062ms, non-child: 46s919ms, % non-child: 93.72%) Hdfs split stats (:<# splits>/): 2:1/234.05 MB 0:2/354.48 MB 7:3/610.12 MB 4:3/568.26 MB 5:6/1.05 GB 3:2/260.19 MB 6:1/14.03 MB 1:2/368.32 MB Filter 4 arrival: 870ms MemoryUsage(1s000ms): 581.02 KB, 187.63 MB, 186.87 MB, 187.15 MB, 187.22 MB, 186.94 MB, 186.85 MB, 186.90 MB, 186.72 MB, 187.02 MB, 187.07 MB, 187.21 MB, 187.23 MB, 186.97 MB, 187.00 MB, 186.97 MB, 174.99 MB, 171.15 MB, 163.13 MB, 163.19 MB, 163.16 MB, 163.13 MB, 151.99 MB, 131.80 MB, 123.86 MB, 115.86 MB, 107.91 MB, 107.94 MB, 100.07 MB, 91.93 MB, 92.05 MB, 92.01 MB, 91.99 MB, 91.94 MB, 92.00 MB, 92.16 MB, 84.16 MB, 76.11 MB, 68.09 MB, 68.17 MB, 59.98 MB, 60.04 MB, 60.07 MB, 56.20 MB, 52.11 MB, 48.13 MB, 44.25 MB, 16.86 MB, 3.38 MB, 2.49 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1, 1 - AverageThreadTokens: 3.79 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 188.57 MB (197727137) - PerHostPeakMemUsage: 993.73 MB (1042004247) - RowsProduced: 11.32M (11323584) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43s512ms - TotalStorageWaitTime: 101.611ms - TotalThreadsInvoluntaryContextSwitches: 3.82K (3818) - TotalThreadsTotalWallClockTime: 3m10s - TotalThreadsSysTime: 810.876ms - TotalThreadsUserTime: 31s693ms - TotalThreadsVoluntaryContextSwitches: 81.83K (81826) Fragment Instance Lifecycle Timings: - ExecTime: 50s011ms - ExecTreeExecTime: 937.318ms - OpenTime: 23.752ms - ExecTreeOpenTime: 82.259us - PrepareTime: 27.476ms - ExecTreePrepareTime: 310.706us DataStreamSender (dst_id=20):(Total: 2s168ms, non-child: 2s168ms, % non-child: 100.00%) - BytesSent: 268.48 MB (281523237) - OverallThroughput: 123.80 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.32M (11323584) - SerializeBatchTime: 2s164ms - UncompressedRowBatchSize: 268.48 MB (281523237) CodeGen:(Total: 47.664ms, non-child: 47.664ms, % non-child: 100.00%) - CodegenTime: 948.000us - CompileTime: 6.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.146ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.396ms HDFS_SCAN_NODE (id=1):(Total: 926.883ms, non-child: 926.883ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/234.05 MB 0:2/354.48 MB 7:3/610.12 MB 4:3/568.26 MB 5:6/1.05 GB 3:2/260.19 MB 6:1/14.03 MB 1:2/368.32 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 824ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB, 162.52 MB - FooterProcessingTime: (Avg: 3.216ms ; Min: 2.699ms ; Max: 4.188ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.88 - BytesRead: 162.52 MB (170410858) - BytesReadDataNodeCache: 0 - BytesReadLocal: 162.52 MB (170410858) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 162.52 MB (170410858) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 591.731ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 184.52 MB (193486468) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.259ms - RowBatchQueuePutWaitTime: 1m52s - RowsRead: 11.32M (11323584) - RowsReturned: 11.32M (11323584) - RowsReturnedRate: 12.22 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 2.97K (2967) - ScannerThreadsTotalWallClockTime: 2m20s - MaterializeTupleTime(*): 1s029ms - ScannerThreadsSysTime: 618.905ms - ScannerThreadsUserTime: 26s572ms - ScannerThreadsVoluntaryContextSwitches: 79.57K (79574) - TotalRawHdfsReadTime(*): 147.975ms - TotalReadThroughput: 3.35 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 17 (17) - Files total: 20 (20) - RowGroups processed: 11.06K (11060) - RowGroups rejected: 0 (0) - RowGroups total: 11.06K (11060) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 11.32M (11323584) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000176 (host=foo.232.15:22000):(Total: 49s974ms, non-child: 46s147ms, % non-child: 92.34%) Hdfs split stats (:<# splits>/): 6:2/227.86 MB 0:6/955.91 MB 2:4/388.02 MB 4:2/306.17 MB 1:1/253.98 MB 3:5/493.02 MB 5:3/440.17 MB 7:2/417.97 MB Filter 4 arrival: 1s293ms MemoryUsage(1s000ms): 581.02 KB, 209.00 MB, 208.51 MB, 208.73 MB, 208.84 MB, 208.47 MB, 208.20 MB, 208.12 MB, 208.83 MB, 208.75 MB, 208.27 MB, 208.42 MB, 208.47 MB, 208.60 MB, 208.70 MB, 208.57 MB, 196.62 MB, 184.61 MB, 184.52 MB, 184.76 MB, 184.58 MB, 184.69 MB, 184.77 MB, 168.85 MB, 156.76 MB, 136.93 MB, 128.92 MB, 117.08 MB, 113.18 MB, 113.15 MB, 113.07 MB, 113.20 MB, 113.08 MB, 113.09 MB, 100.84 MB, 87.45 MB, 87.42 MB, 87.51 MB, 87.49 MB, 87.49 MB, 87.55 MB, 75.33 MB, 63.61 MB, 55.60 MB, 55.56 MB, 55.57 MB, 20.13 MB, 2.36 MB, 2.36 MB, 2.36 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1, 1, 1 - AverageThreadTokens: 3.73 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 210.07 MB (220277149) - PerHostPeakMemUsage: 981.65 MB (1029335887) - RowsProduced: 12.77M (12766917) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 42s527ms - TotalStorageWaitTime: 107.414ms - TotalThreadsInvoluntaryContextSwitches: 2.37K (2369) - TotalThreadsTotalWallClockTime: 3m5s - TotalThreadsSysTime: 447.931ms - TotalThreadsUserTime: 19s594ms - TotalThreadsVoluntaryContextSwitches: 22.66K (22662) Fragment Instance Lifecycle Timings: - ExecTime: 49s922ms - ExecTreeExecTime: 1s380ms - OpenTime: 23.431ms - ExecTreeOpenTime: 68.976us - PrepareTime: 27.838ms - ExecTreePrepareTime: 292.587us DataStreamSender (dst_id=20):(Total: 2s410ms, non-child: 2s410ms, % non-child: 100.00%) - BytesSent: 299.05 MB (313576771) - OverallThroughput: 124.06 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.77M (12766917) - SerializeBatchTime: 2s405ms - UncompressedRowBatchSize: 299.05 MB (313576771) CodeGen:(Total: 46.399ms, non-child: 46.399ms, % non-child: 100.00%) - CodegenTime: 1.063ms - CompileTime: 6.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.046ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.309ms HDFS_SCAN_NODE (id=1):(Total: 1s369ms, non-child: 1s369ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/227.86 MB 0:6/955.91 MB 2:4/388.02 MB 4:2/306.17 MB 1:1/253.98 MB 3:5/493.02 MB 5:3/440.17 MB 7:2/417.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s245ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB, 178.43 MB - FooterProcessingTime: (Avg: 3.403ms ; Min: 3.307ms ; Max: 3.561ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.94 - BytesRead: 178.43 MB (187099300) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.43 MB (187099300) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.43 MB (187099300) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 680.917ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 206.03 MB (216033047) - PerReadThreadRawHdfsThroughput: 919.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.307ms - RowBatchQueuePutWaitTime: 2m1s - RowsRead: 12.77M (12766917) - RowsReturned: 12.77M (12766917) - RowsReturnedRate: 9.32 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1548) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 1s129ms - ScannerThreadsSysTime: 220.965ms - ScannerThreadsUserTime: 14s030ms - ScannerThreadsVoluntaryContextSwitches: 20.22K (20216) - TotalRawHdfsReadTime(*): 193.960ms - TotalReadThroughput: 3.84 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 22 (22) - Files total: 25 (25) - RowGroups processed: 12.47K (12469) - RowGroups rejected: 0 (0) - RowGroups total: 12.47K (12469) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.77M (12766917) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000119 (host=foo.232.30:22000):(Total: 48s000ms, non-child: 44s799ms, % non-child: 93.33%) Hdfs split stats (:<# splits>/): 2:2/177.08 MB 7:2/507.82 MB 1:7/1009.79 MB 6:2/212.39 MB 3:5/285.29 MB 4:5/1003.88 MB Filter 4 arrival: 1s009ms MemoryUsage(1s000ms): 581.02 KB, 186.77 MB, 186.93 MB, 186.05 MB, 186.04 MB, 186.19 MB, 186.04 MB, 186.42 MB, 185.75 MB, 186.21 MB, 186.18 MB, 185.85 MB, 185.73 MB, 186.21 MB, 186.10 MB, 186.35 MB, 174.10 MB, 162.16 MB, 161.96 MB, 161.94 MB, 162.41 MB, 158.38 MB, 146.44 MB, 146.40 MB, 142.21 MB, 130.40 MB, 122.26 MB, 118.29 MB, 114.41 MB, 114.41 MB, 102.52 MB, 90.47 MB, 90.61 MB, 90.78 MB, 90.58 MB, 53.96 MB, 53.42 MB, 53.39 MB, 45.29 MB, 37.46 MB, 29.40 MB, 18.41 MB, 2.94 MB, 2.33 MB, 2.33 MB, 2.33 MB, 2.33 MB, 2.33 MB ThreadUsage(1s000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.95 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 187.60 MB (196716581) - PerHostPeakMemUsage: 998.85 MB (1047372625) - RowsProduced: 10.94M (10936711) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s858ms - TotalStorageWaitTime: 110.166ms - TotalThreadsInvoluntaryContextSwitches: 9.13K (9132) - TotalThreadsTotalWallClockTime: 3m57s - TotalThreadsSysTime: 13s684ms - TotalThreadsUserTime: 1m7s - TotalThreadsVoluntaryContextSwitches: 1.07M (1065128) Fragment Instance Lifecycle Timings: - ExecTime: 47s938ms - ExecTreeExecTime: 1s081ms - OpenTime: 31.072ms - ExecTreeOpenTime: 83.761us - PrepareTime: 31.178ms - ExecTreePrepareTime: 418.369us DataStreamSender (dst_id=20):(Total: 2s069ms, non-child: 2s069ms, % non-child: 100.00%) - BytesSent: 258.18 MB (270717914) - OverallThroughput: 124.77 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.94M (10936711) - SerializeBatchTime: 2s065ms - UncompressedRowBatchSize: 258.18 MB (270717914) CodeGen:(Total: 58.265ms, non-child: 58.265ms, % non-child: 100.00%) - CodegenTime: 1.237ms - CompileTime: 6.753ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.629ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.272ms HDFS_SCAN_NODE (id=1):(Total: 1s073ms, non-child: 1s073ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/177.08 MB 7:2/507.82 MB 1:7/1009.79 MB 6:2/212.39 MB 3:5/285.29 MB 4:5/1003.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 963ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB, 155.49 MB - FooterProcessingTime: (Avg: 2.635ms ; Min: 2.566ms ; Max: 2.694ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.46 - BytesRead: 155.49 MB (163046404) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.49 MB (163046404) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.49 MB (163046404) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 568.579ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 183.52 MB (192438651) - PerReadThreadRawHdfsThroughput: 840.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.706ms - RowBatchQueuePutWaitTime: 1m46s - RowsRead: 10.94M (10936711) - RowsReturned: 10.94M (10936711) - RowsReturnedRate: 10.19 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 8.34K (8341) - ScannerThreadsTotalWallClockTime: 3m9s - MaterializeTupleTime(*): 954.708ms - ScannerThreadsSysTime: 13s455ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 1.06M (1062792) - TotalRawHdfsReadTime(*): 184.935ms - TotalReadThroughput: 3.66 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 20 (20) - Files total: 23 (23) - RowGroups processed: 10.68K (10682) - RowGroups rejected: 0 (0) - RowGroups total: 10.68K (10682) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 10.94M (10936711) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000130 (host=foo.232.50:22000):(Total: 47s400ms, non-child: 44s687ms, % non-child: 94.28%) Hdfs split stats (:<# splits>/): 2:4/763.79 MB 6:2/446.28 MB 0:2/293.31 MB 1:5/482.30 MB 7:2/321.59 MB 3:3/321.86 MB 4:4/574.98 MB 5:2/176.92 MB Filter 4 arrival: 382ms MemoryUsage(1s000ms): 95.29 MB, 190.48 MB, 191.38 MB, 191.40 MB, 191.12 MB, 191.21 MB, 191.10 MB, 191.06 MB, 191.17 MB, 190.94 MB, 190.93 MB, 191.09 MB, 191.12 MB, 190.87 MB, 191.20 MB, 190.85 MB, 170.91 MB, 167.13 MB, 167.14 MB, 156.21 MB, 143.55 MB, 131.85 MB, 127.79 MB, 123.90 MB, 111.87 MB, 111.80 MB, 111.93 MB, 95.98 MB, 96.11 MB, 95.89 MB, 96.04 MB, 95.97 MB, 96.05 MB, 96.01 MB, 96.11 MB, 96.04 MB, 87.97 MB, 79.99 MB, 68.26 MB, 64.33 MB, 64.26 MB, 56.34 MB, 52.49 MB, 39.48 MB, 19.35 MB, 2.50 MB, 2.50 MB ThreadUsage(1s000ms): 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1, 1 - AverageThreadTokens: 3.78 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 192.56 MB (201910001) - PerHostPeakMemUsage: 896.55 MB (940102648) - RowsProduced: 11.33M (11331164) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s793ms - TotalStorageWaitTime: 124.253ms - TotalThreadsInvoluntaryContextSwitches: 3.81K (3807) - TotalThreadsTotalWallClockTime: 3m - TotalThreadsSysTime: 939.856ms - TotalThreadsUserTime: 32s157ms - TotalThreadsVoluntaryContextSwitches: 74.15K (74148) Fragment Instance Lifecycle Timings: - ExecTime: 47s338ms - ExecTreeExecTime: 470.709ms - OpenTime: 28.032ms - ExecTreeOpenTime: 82.116us - PrepareTime: 33.547ms - ExecTreePrepareTime: 375.845us DataStreamSender (dst_id=20):(Total: 2s195ms, non-child: 2s195ms, % non-child: 100.00%) - BytesSent: 268.47 MB (281509728) - OverallThroughput: 122.27 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.33M (11331164) - SerializeBatchTime: 2s190ms - UncompressedRowBatchSize: 268.47 MB (281509728) CodeGen:(Total: 56.712ms, non-child: 56.712ms, % non-child: 100.00%) - CodegenTime: 1.228ms - CompileTime: 7.397ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.693ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.113ms HDFS_SCAN_NODE (id=1):(Total: 460.403ms, non-child: 460.403ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:4/763.79 MB 6:2/446.28 MB 0:2/293.31 MB 1:5/482.30 MB 7:2/321.59 MB 3:3/321.86 MB 4:4/574.98 MB 5:2/176.92 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 341ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:12 BytesRead(1s000ms): 80.92 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB, 161.83 MB - FooterProcessingTime: (Avg: 2.572ms ; Min: 2.415ms ; Max: 2.665ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.93 - BytesRead: 161.83 MB (169692448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 161.83 MB (169692448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 161.83 MB (169692448) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 606.907ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 188.52 MB (197680114) - PerReadThreadRawHdfsThroughput: 803.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.989ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 11.33M (11331164) - RowsReturned: 11.33M (11331164) - RowsReturnedRate: 24.61 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.00K (3004) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 1s009ms - ScannerThreadsSysTime: 673.896ms - ScannerThreadsUserTime: 27s069ms - ScannerThreadsVoluntaryContextSwitches: 72.08K (72081) - TotalRawHdfsReadTime(*): 201.364ms - TotalReadThroughput: 3.60 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 21 (21) - Files total: 24 (24) - RowGroups processed: 11.07K (11067) - RowGroups rejected: 0 (0) - RowGroups total: 11.07K (11067) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 11.33M (11331164) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000142 (host=foo.232.27:22000):(Total: 46s924ms, non-child: 43s892ms, % non-child: 93.54%) Hdfs split stats (:<# splits>/): 0:1/95.07 MB 7:4/767.47 MB 1:4/850.76 MB 6:3/350.80 MB 3:2/159.02 MB 2:4/896.11 MB Filter 4 arrival: 1s164ms MemoryUsage(1s000ms): 581.02 KB, 160.49 MB, 158.62 MB, 159.28 MB, 159.48 MB, 158.78 MB, 159.44 MB, 159.38 MB, 158.95 MB, 159.15 MB, 159.46 MB, 143.22 MB, 143.20 MB, 143.48 MB, 143.39 MB, 142.97 MB, 143.23 MB, 135.31 MB, 127.46 MB, 119.39 MB, 111.37 MB, 111.38 MB, 111.43 MB, 111.38 MB, 95.52 MB, 95.57 MB, 95.56 MB, 95.38 MB, 95.58 MB, 95.42 MB, 95.59 MB, 91.52 MB, 87.56 MB, 79.58 MB, 63.78 MB, 59.77 MB, 55.80 MB, 55.82 MB, 46.99 MB, 29.02 MB, 3.84 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB ThreadUsage(1s000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.66 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 160.72 MB (168531571) - PerHostPeakMemUsage: 899.80 MB (943505262) - RowsProduced: 9.62M (9621036) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 40s134ms - TotalStorageWaitTime: 58.826ms - TotalThreadsInvoluntaryContextSwitches: 1.16K (1158) - TotalThreadsTotalWallClockTime: 2m4s - TotalThreadsSysTime: 227.963ms - TotalThreadsUserTime: 6s957ms - TotalThreadsVoluntaryContextSwitches: 11.34K (11340) Fragment Instance Lifecycle Timings: - ExecTime: 46s869ms - ExecTreeExecTime: 1s226ms - OpenTime: 27.474ms - ExecTreeOpenTime: 89.886us - PrepareTime: 28.121ms - ExecTreePrepareTime: 469.402us DataStreamSender (dst_id=20):(Total: 1s760ms, non-child: 1s760ms, % non-child: 100.00%) - BytesSent: 225.98 MB (236960748) - OverallThroughput: 128.38 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.62M (9621036) - SerializeBatchTime: 1s756ms - UncompressedRowBatchSize: 225.98 MB (236960748) CodeGen:(Total: 51.775ms, non-child: 51.775ms, % non-child: 100.00%) - CodegenTime: 1.147ms - CompileTime: 6.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.060ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.558ms HDFS_SCAN_NODE (id=1):(Total: 1s219ms, non-child: 1s219ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/95.07 MB 7:4/767.47 MB 1:4/850.76 MB 6:3/350.80 MB 3:2/159.02 MB 2:4/896.11 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s125ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB, 136.10 MB - FooterProcessingTime: (Avg: 3.038ms ; Min: 2.770ms ; Max: 3.306ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.93 - BytesRead: 136.10 MB (142712939) - BytesReadDataNodeCache: 0 - BytesReadLocal: 136.10 MB (142712939) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 136.10 MB (142712939) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 496.230ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 156.64 MB (164253972) - PerReadThreadRawHdfsThroughput: 995.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.757ms - RowBatchQueuePutWaitTime: 1m14s - RowsRead: 9.62M (9621036) - RowsReturned: 9.62M (9621036) - RowsReturnedRate: 7.89 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 445 (445) - ScannerThreadsTotalWallClockTime: 1m17s - MaterializeTupleTime(*): 813.764ms - ScannerThreadsSysTime: 62.989ms - ScannerThreadsUserTime: 2s897ms - ScannerThreadsVoluntaryContextSwitches: 9.28K (9284) - TotalRawHdfsReadTime(*): 136.732ms - TotalReadThroughput: 3.36 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 16 (16) - Files total: 18 (18) - RowGroups processed: 9.40K (9397) - RowGroups rejected: 0 (0) - RowGroups total: 9.40K (9397) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.62M (9621036) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000188 (host=foo.221.44:22000):(Total: 46s004ms, non-child: 42s580ms, % non-child: 92.56%) Hdfs split stats (:<# splits>/): 5:2/409.42 MB 1:4/496.09 MB 4:2/507.98 MB 6:2/258.31 MB 0:2/307.86 MB 2:2/54.18 MB 7:4/912.51 MB 3:2/390.35 MB Filter 4 arrival: 1s505ms MemoryUsage(1s000ms): 581.02 KB, 90.19 MB, 179.57 MB, 178.49 MB, 178.36 MB, 178.04 MB, 178.81 MB, 178.57 MB, 178.27 MB, 178.77 MB, 178.38 MB, 178.36 MB, 178.55 MB, 178.42 MB, 178.35 MB, 178.30 MB, 167.63 MB, 156.17 MB, 129.61 MB, 112.79 MB, 112.81 MB, 112.81 MB, 113.02 MB, 112.68 MB, 108.75 MB, 96.70 MB, 88.85 MB, 80.96 MB, 81.00 MB, 80.91 MB, 68.91 MB, 65.06 MB, 64.99 MB, 57.26 MB, 49.44 MB, 49.48 MB, 49.39 MB, 41.57 MB, 33.43 MB, 33.50 MB, 25.41 MB, 15.73 MB, 2.67 MB, 2.67 MB, 2.67 MB, 2.67 MB ThreadUsage(1s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1, 1 - AverageThreadTokens: 5.02 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 179.89 MB (188629410) - PerHostPeakMemUsage: 975.41 MB (1022795956) - RowsProduced: 10.02M (10022431) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39s157ms - TotalStorageWaitTime: 107.730ms - TotalThreadsInvoluntaryContextSwitches: 9.50K (9504) - TotalThreadsTotalWallClockTime: 3m50s - TotalThreadsSysTime: 15s932ms - TotalThreadsUserTime: 1m6s - TotalThreadsVoluntaryContextSwitches: 1.66M (1661520) Fragment Instance Lifecycle Timings: - ExecTime: 45s948ms - ExecTreeExecTime: 1s561ms - OpenTime: 26.557ms - ExecTreeOpenTime: 80.929us - PrepareTime: 29.229ms - ExecTreePrepareTime: 397.141us DataStreamSender (dst_id=20):(Total: 1s819ms, non-child: 1s819ms, % non-child: 100.00%) - BytesSent: 237.23 MB (248755151) - OverallThroughput: 130.38 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.02M (10022431) - SerializeBatchTime: 1s816ms - UncompressedRowBatchSize: 237.23 MB (248755151) CodeGen:(Total: 51.562ms, non-child: 51.562ms, % non-child: 100.00%) - CodegenTime: 1.155ms - CompileTime: 6.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.598ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.625ms HDFS_SCAN_NODE (id=1):(Total: 1s553ms, non-child: 1s553ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/409.42 MB 1:4/496.09 MB 4:2/507.98 MB 6:2/258.31 MB 0:2/307.86 MB 2:2/54.18 MB 7:4/912.51 MB 3:2/390.35 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s465ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 72.18 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB, 144.35 MB - FooterProcessingTime: (Avg: 2.896ms ; Min: 2.624ms ; Max: 3.225ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.40 - BytesRead: 144.35 MB (151366610) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.35 MB (151366610) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.35 MB (151366610) - CachedFileHandlesHitCount: 31 (31) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 515.795ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 175.89 MB (184437956) - PerReadThreadRawHdfsThroughput: 829.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.635ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 10.02M (10022431) - RowsReturned: 10.02M (10022431) - RowsReturnedRate: 6.45 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 8.67K (8673) - ScannerThreadsTotalWallClockTime: 3m4s - MaterializeTupleTime(*): 863.273ms - ScannerThreadsSysTime: 15s778ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 1.66M (1659195) - TotalRawHdfsReadTime(*): 174.069ms - TotalReadThroughput: 3.44 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 16 (16) - Files total: 20 (20) - RowGroups processed: 9.79K (9790) - RowGroups rejected: 0 (0) - RowGroups total: 9.79K (9790) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 10.02M (10022431) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000011c (host=foo.232.26:22000):(Total: 45s990ms, non-child: 42s789ms, % non-child: 93.04%) Hdfs split stats (:<# splits>/): 3:1/253.97 MB 7:4/581.42 MB 2:2/366.95 MB 4:2/261.99 MB 0:4/785.77 MB 5:3/394.46 MB 6:2/327.72 MB 1:3/506.59 MB Filter 4 arrival: 1s257ms MemoryUsage(1s000ms): 581.02 KB, 166.59 MB, 165.55 MB, 165.92 MB, 160.70 MB, 155.71 MB, 155.53 MB, 155.79 MB, 155.77 MB, 155.59 MB, 155.41 MB, 155.74 MB, 155.84 MB, 147.82 MB, 139.69 MB, 139.63 MB, 139.62 MB, 131.91 MB, 115.81 MB, 107.93 MB, 107.89 MB, 107.86 MB, 100.05 MB, 92.16 MB, 92.11 MB, 92.00 MB, 92.08 MB, 91.97 MB, 92.04 MB, 92.22 MB, 80.19 MB, 76.23 MB, 68.33 MB, 60.30 MB, 60.35 MB, 48.18 MB, 35.32 MB, 4.77 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.35 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 167.08 MB (175193161) - PerHostPeakMemUsage: 886.11 MB (929158111) - RowsProduced: 9.86M (9858853) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38s508ms - TotalStorageWaitTime: 113.461ms - TotalThreadsInvoluntaryContextSwitches: 4.61K (4605) - TotalThreadsTotalWallClockTime: 2m34s - TotalThreadsSysTime: 571.911ms - TotalThreadsUserTime: 38s464ms - TotalThreadsVoluntaryContextSwitches: 23.37K (23373) Fragment Instance Lifecycle Timings: - ExecTime: 45s934ms - ExecTreeExecTime: 1s318ms - OpenTime: 25.757ms - ExecTreeOpenTime: 85.403us - PrepareTime: 30.490ms - ExecTreePrepareTime: 342.340us DataStreamSender (dst_id=20):(Total: 1s838ms, non-child: 1s838ms, % non-child: 100.00%) - BytesSent: 234.56 MB (245949000) - OverallThroughput: 127.57 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.86M (9858853) - SerializeBatchTime: 1s835ms - UncompressedRowBatchSize: 234.56 MB (245949000) CodeGen:(Total: 53.118ms, non-child: 53.118ms, % non-child: 100.00%) - CodegenTime: 1.019ms - CompileTime: 8.548ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.328ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.718ms HDFS_SCAN_NODE (id=1):(Total: 1s309ms, non-child: 1s309ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.97 MB 7:4/581.42 MB 2:2/366.95 MB 4:2/261.99 MB 0:4/785.77 MB 5:3/394.46 MB 6:2/327.72 MB 1:3/506.59 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s204ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB, 142.12 MB - FooterProcessingTime: (Avg: 3.533ms ; Min: 2.848ms ; Max: 4.787ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.88 - BytesRead: 142.12 MB (149023549) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.12 MB (149023549) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.12 MB (149023549) - CachedFileHandlesHitCount: 29 (29) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 506.173ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 163.01 MB (170930754) - PerReadThreadRawHdfsThroughput: 923.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.575ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 9.86M (9858853) - RowsReturned: 9.86M (9858853) - RowsReturnedRate: 7.53 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 3.88K (3884) - ScannerThreadsTotalWallClockTime: 1m48s - MaterializeTupleTime(*): 847.306ms - ScannerThreadsSysTime: 381.940ms - ScannerThreadsUserTime: 34s244ms - ScannerThreadsVoluntaryContextSwitches: 20.98K (20980) - TotalRawHdfsReadTime(*): 153.849ms - TotalReadThroughput: 3.79 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 9.63K (9630) - RowGroups rejected: 0 (0) - RowGroups total: 9.63K (9630) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 9.86M (9858853) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000162 (host=foo.232.34:22000):(Total: 44s578ms, non-child: 41s460ms, % non-child: 93.00%) Hdfs split stats (:<# splits>/): 0:1/223.09 MB 6:1/103.01 MB 5:2/271.99 MB 7:3/460.15 MB 2:3/542.72 MB 4:5/408.18 MB 1:5/909.60 MB 3:5/758.93 MB Filter 4 arrival: 948ms MemoryUsage(1s000ms): 581.02 KB, 193.26 MB, 192.75 MB, 192.10 MB, 191.62 MB, 191.70 MB, 191.60 MB, 191.71 MB, 177.36 MB, 177.71 MB, 177.70 MB, 177.56 MB, 177.43 MB, 177.65 MB, 177.50 MB, 177.56 MB, 177.22 MB, 177.50 MB, 177.28 MB, 157.67 MB, 153.73 MB, 153.63 MB, 153.70 MB, 153.82 MB, 153.79 MB, 153.77 MB, 149.83 MB, 145.71 MB, 133.80 MB, 121.66 MB, 109.81 MB, 105.99 MB, 106.00 MB, 77.23 MB, 54.01 MB, 53.43 MB, 53.47 MB, 49.41 MB, 37.56 MB, 37.43 MB, 37.43 MB, 3.90 MB, 2.39 MB, 2.39 MB ThreadUsage(1s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.60 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 193.46 MB (202854827) - PerHostPeakMemUsage: 1008.70 MB (1057700869) - RowsProduced: 11.12M (11116965) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38s188ms - TotalStorageWaitTime: 145.990ms - TotalThreadsInvoluntaryContextSwitches: 6.16K (6164) - TotalThreadsTotalWallClockTime: 3m25s - TotalThreadsSysTime: 9s156ms - TotalThreadsUserTime: 43s466ms - TotalThreadsVoluntaryContextSwitches: 963.15K (963154) Fragment Instance Lifecycle Timings: - ExecTime: 44s513ms - ExecTreeExecTime: 1s008ms - OpenTime: 25.702ms - ExecTreeOpenTime: 85.252us - PrepareTime: 38.852ms - ExecTreePrepareTime: 836.509us DataStreamSender (dst_id=20):(Total: 2s061ms, non-child: 2s061ms, % non-child: 100.00%) - BytesSent: 260.88 MB (273552711) - OverallThroughput: 126.52 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.12M (11116965) - SerializeBatchTime: 2s058ms - UncompressedRowBatchSize: 260.88 MB (273552711) CodeGen:(Total: 56.349ms, non-child: 56.349ms, % non-child: 100.00%) - CodegenTime: 1.334ms - CompileTime: 6.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.674ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.366ms HDFS_SCAN_NODE (id=1):(Total: 1s000ms, non-child: 1s000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/223.09 MB 6:1/103.01 MB 5:2/271.99 MB 7:3/460.15 MB 2:3/542.72 MB 4:5/408.18 MB 1:5/909.60 MB 3:5/758.93 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 902ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB, 157.12 MB - FooterProcessingTime: (Avg: 4.153ms ; Min: 3.345ms ; Max: 5.593ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.86 - BytesRead: 157.12 MB (164754888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 157.12 MB (164754888) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 157.12 MB (164754888) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 587.064ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 189.39 MB (198594033) - PerReadThreadRawHdfsThroughput: 876.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.478ms - RowBatchQueuePutWaitTime: 1m50s - RowsRead: 11.12M (11116965) - RowsReturned: 11.12M (11116965) - RowsReturnedRate: 11.12 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 5.37K (5374) - ScannerThreadsTotalWallClockTime: 2m40s - MaterializeTupleTime(*): 1s045ms - ScannerThreadsSysTime: 8s964ms - ScannerThreadsUserTime: 38s640ms - ScannerThreadsVoluntaryContextSwitches: 960.75K (960750) - TotalRawHdfsReadTime(*): 179.353ms - TotalReadThroughput: 3.79 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 21 (21) - Files total: 25 (25) - RowGroups processed: 10.86K (10859) - RowGroups rejected: 0 (0) - RowGroups total: 10.86K (10859) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 11.12M (11116965) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000120 (host=foo.232.44:22000):(Total: 44s554ms, non-child: 41s760ms, % non-child: 93.73%) Hdfs split stats (:<# splits>/): 0:2/507.97 MB 2:4/679.78 MB 5:2/402.85 MB 6:1/254.06 MB 7:2/442.53 MB 4:2/437.04 MB 3:6/671.51 MB Filter 4 arrival: 733ms MemoryUsage(1s000ms): 47.09 MB, 173.08 MB, 173.63 MB, 173.27 MB, 173.43 MB, 172.67 MB, 172.92 MB, 172.88 MB, 173.26 MB, 172.92 MB, 172.32 MB, 173.00 MB, 173.02 MB, 172.79 MB, 172.95 MB, 172.56 MB, 164.96 MB, 149.07 MB, 148.87 MB, 148.81 MB, 148.95 MB, 148.94 MB, 140.87 MB, 136.97 MB, 124.93 MB, 125.02 MB, 116.97 MB, 105.09 MB, 101.14 MB, 79.40 MB, 53.90 MB, 53.33 MB, 53.42 MB, 53.41 MB, 49.44 MB, 37.35 MB, 37.33 MB, 29.54 MB, 17.74 MB, 3.64 MB, 2.43 MB, 2.43 MB, 2.43 MB, 2.43 MB ThreadUsage(1s000ms): 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.56 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 174.27 MB (182737762) - PerHostPeakMemUsage: 928.72 MB (973829167) - RowsProduced: 10.19M (10193300) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38s494ms - TotalStorageWaitTime: 123.131ms - TotalThreadsInvoluntaryContextSwitches: 2.75K (2755) - TotalThreadsTotalWallClockTime: 2m38s - TotalThreadsSysTime: 2s134ms - TotalThreadsUserTime: 22s222ms - TotalThreadsVoluntaryContextSwitches: 103.78K (103779) Fragment Instance Lifecycle Timings: - ExecTime: 44s496ms - ExecTreeExecTime: 796.985ms - OpenTime: 27.577ms - ExecTreeOpenTime: 102.371us - PrepareTime: 30.732ms - ExecTreePrepareTime: 263.798us DataStreamSender (dst_id=20):(Total: 1s951ms, non-child: 1s951ms, % non-child: 100.00%) - BytesSent: 239.91 MB (251562324) - OverallThroughput: 122.96 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.19M (10193300) - SerializeBatchTime: 1s947ms - UncompressedRowBatchSize: 239.91 MB (251562324) CodeGen:(Total: 55.165ms, non-child: 55.165ms, % non-child: 100.00%) - CodegenTime: 1.256ms - CompileTime: 7.712ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.897ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.033ms HDFS_SCAN_NODE (id=1):(Total: 787.670ms, non-child: 787.670ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/507.97 MB 2:4/679.78 MB 5:2/402.85 MB 6:1/254.06 MB 7:2/442.53 MB 4:2/437.04 MB 3:6/671.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 682ms Hdfs Read Thread Concurrency Bucket: 0:98.73% 1:0% 2:1.266% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:12 BytesRead(1s000ms): 32.53 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB, 144.47 MB - FooterProcessingTime: (Avg: 3.124ms ; Min: 2.439ms ; Max: 4.026ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.89 - BytesRead: 144.47 MB (151484963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.47 MB (151484963) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.47 MB (151484963) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 545.125ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 170.27 MB (178544617) - PerReadThreadRawHdfsThroughput: 945.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.133ms - RowBatchQueuePutWaitTime: 1m34s - RowsRead: 10.19M (10193300) - RowsReturned: 10.19M (10193300) - RowsReturnedRate: 12.94 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2.04K (2038) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 885.376ms - ScannerThreadsSysTime: 1s956ms - ScannerThreadsUserTime: 17s709ms - ScannerThreadsVoluntaryContextSwitches: 101.56K (101564) - TotalRawHdfsReadTime(*): 152.752ms - TotalReadThroughput: 3.66 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 16 (16) - Files total: 19 (19) - RowGroups processed: 9.96K (9956) - RowGroups rejected: 0 (0) - RowGroups total: 9.96K (9956) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 10.19M (10193300) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000121 (host=foo.221.34:22000):(Total: 42s857ms, non-child: 39s319ms, % non-child: 91.74%) Hdfs split stats (:<# splits>/): 1:2/507.89 MB 6:2/391.50 MB 0:2/384.32 MB 4:1/253.90 MB 7:4/946.75 MB 3:2/405.96 MB 5:4/559.86 MB Filter 4 arrival: 1s592ms MemoryUsage(1s000ms): 581.02 KB, 80.05 MB, 159.84 MB, 160.36 MB, 159.43 MB, 160.43 MB, 160.09 MB, 159.72 MB, 159.25 MB, 159.58 MB, 159.39 MB, 155.77 MB, 147.50 MB, 143.88 MB, 143.92 MB, 143.70 MB, 135.94 MB, 127.69 MB, 120.02 MB, 111.94 MB, 111.98 MB, 112.06 MB, 99.97 MB, 96.12 MB, 96.00 MB, 96.00 MB, 96.02 MB, 96.06 MB, 96.06 MB, 96.05 MB, 96.14 MB, 92.02 MB, 87.92 MB, 71.98 MB, 63.99 MB, 64.05 MB, 60.00 MB, 56.02 MB, 4.83 MB, 2.35 MB, 2.35 MB, 2.35 MB, 2.35 MB ThreadUsage(1s000ms): 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.70 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 161.16 MB (168992399) - PerHostPeakMemUsage: 939.39 MB (985021937) - RowsProduced: 9.50M (9502672) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 36s117ms - TotalStorageWaitTime: 57.808ms - TotalThreadsInvoluntaryContextSwitches: 1.05K (1055) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 272.958ms - TotalThreadsUserTime: 5s889ms - TotalThreadsVoluntaryContextSwitches: 11.59K (11588) Fragment Instance Lifecycle Timings: - ExecTime: 42s806ms - ExecTreeExecTime: 1s645ms - OpenTime: 23.662ms - ExecTreeOpenTime: 74.836us - PrepareTime: 27.096ms - ExecTreePrepareTime: 556.643us DataStreamSender (dst_id=20):(Total: 1s854ms, non-child: 1s854ms, % non-child: 100.00%) - BytesSent: 224.93 MB (235854519) - OverallThroughput: 121.30 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.50M (9502672) - SerializeBatchTime: 1s850ms - UncompressedRowBatchSize: 224.93 MB (235854519) CodeGen:(Total: 46.576ms, non-child: 46.576ms, % non-child: 100.00%) - CodegenTime: 1.079ms - CompileTime: 6.365ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.398ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.339ms HDFS_SCAN_NODE (id=1):(Total: 1s637ms, non-child: 1s637ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/507.89 MB 6:2/391.50 MB 0:2/384.32 MB 4:1/253.90 MB 7:4/946.75 MB 3:2/405.96 MB 5:4/559.86 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s545ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 67.95 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB, 135.90 MB - FooterProcessingTime: (Avg: 3.565ms ; Min: 3.558ms ; Max: 3.572ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.87 - BytesRead: 135.90 MB (142497268) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.90 MB (142497268) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.90 MB (142497268) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 502.745ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.15 MB (164781010) - PerReadThreadRawHdfsThroughput: 876.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.297ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 9.50M (9502672) - RowsReturned: 9.50M (9502672) - RowsReturnedRate: 5.80 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 359 (359) - ScannerThreadsTotalWallClockTime: 1m12s - MaterializeTupleTime(*): 858.240ms - ScannerThreadsSysTime: 78.987ms - ScannerThreadsUserTime: 1s560ms - ScannerThreadsVoluntaryContextSwitches: 9.21K (9206) - TotalRawHdfsReadTime(*): 154.970ms - TotalReadThroughput: 3.48 MB/sec Filter 4 (8.00 KB): - Files processed: 17 (17) - Files rejected: 15 (15) - Files total: 17 (17) - RowGroups processed: 9.28K (9281) - RowGroups rejected: 0 (0) - RowGroups total: 9.28K (9281) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.50M (9502672) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000016e (host=foo.221.52:22000):(Total: 41s961ms, non-child: 38s512ms, % non-child: 91.78%) Hdfs split stats (:<# splits>/): 5:1/14.55 MB 2:1/214.28 MB 4:4/564.13 MB 6:4/698.14 MB 1:6/738.70 MB 3:3/640.10 MB 7:3/450.74 MB Filter 4 arrival: 1s415ms MemoryUsage(1s000ms): 581.02 KB, 87.06 MB, 173.09 MB, 172.83 MB, 172.40 MB, 173.01 MB, 172.76 MB, 173.04 MB, 172.69 MB, 172.15 MB, 172.11 MB, 172.87 MB, 172.12 MB, 172.57 MB, 172.14 MB, 172.61 MB, 172.42 MB, 172.70 MB, 172.27 MB, 172.28 MB, 164.62 MB, 152.50 MB, 140.61 MB, 130.84 MB, 120.36 MB, 120.18 MB, 120.14 MB, 85.57 MB, 65.32 MB, 61.47 MB, 57.44 MB, 49.36 MB, 49.32 MB, 49.53 MB, 49.35 MB, 49.30 MB, 49.38 MB, 37.33 MB, 19.38 MB, 3.40 MB, 2.56 MB, 2.56 MB ThreadUsage(1s000ms): 1, 3, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1 - AverageThreadTokens: 4.52 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 173.92 MB (182364350) - PerHostPeakMemUsage: 990.37 MB (1038473323) - RowsProduced: 9.85M (9846739) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 35s641ms - TotalStorageWaitTime: 123.405ms - TotalThreadsInvoluntaryContextSwitches: 4.87K (4871) - TotalThreadsTotalWallClockTime: 3m11s - TotalThreadsSysTime: 13s293ms - TotalThreadsUserTime: 27s739ms - TotalThreadsVoluntaryContextSwitches: 1.28M (1282687) Fragment Instance Lifecycle Timings: - ExecTime: 41s904ms - ExecTreeExecTime: 1s549ms - OpenTime: 25.354ms - ExecTreeOpenTime: 131.527us - PrepareTime: 31.731ms - ExecTreePrepareTime: 260.384us DataStreamSender (dst_id=20):(Total: 1s858ms, non-child: 1s858ms, % non-child: 100.00%) - BytesSent: 232.89 MB (244204017) - OverallThroughput: 125.30 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.85M (9846739) - SerializeBatchTime: 1s855ms - UncompressedRowBatchSize: 232.89 MB (244204017) CodeGen:(Total: 48.795ms, non-child: 48.795ms, % non-child: 100.00%) - CodegenTime: 1.081ms - CompileTime: 8.117ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.321ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.824ms HDFS_SCAN_NODE (id=1):(Total: 1s540ms, non-child: 1s540ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/14.55 MB 2:1/214.28 MB 4:4/564.13 MB 6:4/698.14 MB 1:6/738.70 MB 3:3/640.10 MB 7:3/450.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s365ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 69.90 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB, 139.81 MB - FooterProcessingTime: (Avg: 3.531ms ; Min: 2.509ms ; Max: 5.222ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.75 - BytesRead: 139.81 MB (146601302) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.81 MB (146601302) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.81 MB (146601302) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 507.332ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 169.90 MB (178157141) - PerReadThreadRawHdfsThroughput: 986.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.602ms - RowBatchQueuePutWaitTime: 1m49s - RowsRead: 9.85M (9846739) - RowsReturned: 9.85M (9846739) - RowsReturnedRate: 6.39 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 4.18K (4181) - ScannerThreadsTotalWallClockTime: 2m29s - MaterializeTupleTime(*): 1s002ms - ScannerThreadsSysTime: 13s107ms - ScannerThreadsUserTime: 23s415ms - ScannerThreadsVoluntaryContextSwitches: 1.28M (1280458) - TotalRawHdfsReadTime(*): 141.701ms - TotalReadThroughput: 3.54 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 18 (18) - Files total: 22 (22) - RowGroups processed: 9.62K (9618) - RowGroups rejected: 0 (0) - RowGroups total: 9.62K (9618) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 9.85M (9846739) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000179 (host=foo.221.11:22000):(Total: 41s634ms, non-child: 37s838ms, % non-child: 90.88%) Hdfs split stats (:<# splits>/): 4:1/253.98 MB 2:2/392.13 MB 1:2/278.12 MB 6:3/257.85 MB 7:7/1.29 GB 5:1/60.09 MB 3:4/191.38 MB 0:5/785.18 MB Filter 4 arrival: 1s810ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 185.08 MB, 185.55 MB, 185.20 MB, 185.26 MB, 185.45 MB, 180.77 MB, 175.93 MB, 175.38 MB, 175.54 MB, 175.21 MB, 175.34 MB, 175.58 MB, 175.05 MB, 175.47 MB, 175.25 MB, 175.22 MB, 175.42 MB, 164.68 MB, 131.11 MB, 130.66 MB, 118.62 MB, 114.71 MB, 114.54 MB, 114.82 MB, 102.77 MB, 98.93 MB, 86.89 MB, 82.90 MB, 83.00 MB, 74.88 MB, 66.88 MB, 60.19 MB, 53.34 MB, 53.36 MB, 49.41 MB, 37.37 MB, 29.52 MB, 17.37 MB, 3.33 MB ThreadUsage(1s000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1 - AverageThreadTokens: 4.75 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 186.84 MB (195912684) - PerHostPeakMemUsage: 955.74 MB (1002169777) - RowsProduced: 10.36M (10355216) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34s831ms - TotalStorageWaitTime: 168.478ms - TotalThreadsInvoluntaryContextSwitches: 5.85K (5852) - TotalThreadsTotalWallClockTime: 3m18s - TotalThreadsSysTime: 4s760ms - TotalThreadsUserTime: 47s324ms - TotalThreadsVoluntaryContextSwitches: 538.29K (538287) Fragment Instance Lifecycle Timings: - ExecTime: 41s571ms - ExecTreeExecTime: 1s857ms - OpenTime: 24.542ms - ExecTreeOpenTime: 87.085us - PrepareTime: 38.063ms - ExecTreePrepareTime: 476.460us DataStreamSender (dst_id=20):(Total: 1s892ms, non-child: 1s892ms, % non-child: 100.00%) - BytesSent: 244.84 MB (256730591) - OverallThroughput: 129.34 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.36M (10355216) - SerializeBatchTime: 1s889ms - UncompressedRowBatchSize: 244.84 MB (256730591) CodeGen:(Total: 54.293ms, non-child: 54.293ms, % non-child: 100.00%) - CodegenTime: 1.120ms - CompileTime: 6.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.888ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.285ms HDFS_SCAN_NODE (id=1):(Total: 1s849ms, non-child: 1s849ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.98 MB 2:2/392.13 MB 1:2/278.12 MB 6:3/257.85 MB 7:7/1.29 GB 5:1/60.09 MB 3:4/191.38 MB 0:5/785.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 1s767ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:24 BytesRead(1s000ms): 0, 0, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB, 149.14 MB - FooterProcessingTime: (Avg: 3.286ms ; Min: 2.006ms ; Max: 5.338ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.84 - BytesRead: 149.14 MB (156389024) - BytesReadDataNodeCache: 0 - BytesReadLocal: 149.14 MB (156389024) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149.14 MB (156389024) - CachedFileHandlesHitCount: 41 (41) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 527.396ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 183.76 MB (192683649) - PerReadThreadRawHdfsThroughput: 724.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.744ms - RowBatchQueuePutWaitTime: 1m48s - RowsRead: 10.36M (10355216) - RowsReturned: 10.36M (10355216) - RowsReturnedRate: 5.60 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 5.13K (5132) - ScannerThreadsTotalWallClockTime: 2m36s - MaterializeTupleTime(*): 904.956ms - ScannerThreadsSysTime: 4s615ms - ScannerThreadsUserTime: 42s852ms - ScannerThreadsVoluntaryContextSwitches: 535.95K (535948) - TotalRawHdfsReadTime(*): 205.882ms - TotalReadThroughput: 3.68 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 19 (19) - Files total: 25 (25) - RowGroups processed: 10.12K (10115) - RowGroups rejected: 0 (0) - RowGroups total: 10.12K (10115) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 10.36M (10355216) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce180000014e (host=foo.232.19:22000):(Total: 41s272ms, non-child: 38s351ms, % non-child: 92.92%) Hdfs split stats (:<# splits>/): 2:1/210.04 MB 3:3/282.17 MB 6:3/503.12 MB 5:3/645.31 MB 4:2/507.86 MB 1:2/489.01 MB 7:3/377.50 MB 0:3/418.80 MB Filter 4 arrival: 994ms MemoryUsage(1s000ms): 581.02 KB, 132.74 MB, 160.14 MB, 159.50 MB, 159.27 MB, 159.61 MB, 159.94 MB, 159.58 MB, 159.28 MB, 159.62 MB, 159.71 MB, 159.42 MB, 143.83 MB, 143.83 MB, 143.87 MB, 143.79 MB, 127.88 MB, 127.91 MB, 111.83 MB, 111.91 MB, 111.86 MB, 95.96 MB, 96.05 MB, 95.78 MB, 95.87 MB, 95.79 MB, 96.01 MB, 96.01 MB, 95.99 MB, 92.01 MB, 72.10 MB, 64.14 MB, 63.96 MB, 63.99 MB, 63.99 MB, 56.22 MB, 39.28 MB, 6.75 MB, 2.60 MB, 2.60 MB, 2.60 MB ThreadUsage(1s000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1 - AverageThreadTokens: 2.73 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 161.23 MB (169056707) - PerHostPeakMemUsage: 902.46 MB (946300335) - RowsProduced: 9.62M (9620136) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 35s312ms - TotalStorageWaitTime: 70.151ms - TotalThreadsInvoluntaryContextSwitches: 1.04K (1040) - TotalThreadsTotalWallClockTime: 1m52s - TotalThreadsSysTime: 230.964ms - TotalThreadsUserTime: 6s114ms - TotalThreadsVoluntaryContextSwitches: 11.20K (11204) Fragment Instance Lifecycle Timings: - ExecTime: 41s222ms - ExecTreeExecTime: 1s139ms - OpenTime: 23.436ms - ExecTreeOpenTime: 113.511us - PrepareTime: 25.663ms - ExecTreePrepareTime: 303.441us DataStreamSender (dst_id=20):(Total: 1s742ms, non-child: 1s742ms, % non-child: 100.00%) - BytesSent: 226.56 MB (237568895) - OverallThroughput: 130.03 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.62M (9620136) - SerializeBatchTime: 1s738ms - UncompressedRowBatchSize: 226.56 MB (237568895) CodeGen:(Total: 45.993ms, non-child: 45.993ms, % non-child: 100.00%) - CodegenTime: 1.080ms - CompileTime: 6.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.917ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.777ms HDFS_SCAN_NODE (id=1):(Total: 1s132ms, non-child: 1s132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/210.04 MB 3:3/282.17 MB 6:3/503.12 MB 5:3/645.31 MB 4:2/507.86 MB 1:2/489.01 MB 7:3/377.50 MB 0:3/418.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 964ms Hdfs Read Thread Concurrency Bucket: 0:98.68% 1:0% 2:1.316% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 104.20 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB, 135.93 MB - FooterProcessingTime: (Avg: 3.302ms ; Min: 3.137ms ; Max: 3.467ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.89 - BytesRead: 135.93 MB (142527811) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.93 MB (142527811) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.93 MB (142527811) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 515.331ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.15 MB (164779374) - PerReadThreadRawHdfsThroughput: 952.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.108ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 9.62M (9620136) - RowsReturned: 9.62M (9620136) - RowsReturnedRate: 8.50 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 391 (391) - ScannerThreadsTotalWallClockTime: 1m11s - MaterializeTupleTime(*): 834.675ms - ScannerThreadsSysTime: 75.987ms - ScannerThreadsUserTime: 1s988ms - ScannerThreadsVoluntaryContextSwitches: 9.26K (9263) - TotalRawHdfsReadTime(*): 142.682ms - TotalReadThroughput: 3.58 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 9.40K (9396) - RowGroups rejected: 0 (0) - RowGroups total: 9.40K (9396) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.62M (9620136) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000012c (host=foo.221.14:22000):(Total: 39s918ms, non-child: 36s151ms, % non-child: 90.56%) Hdfs split stats (:<# splits>/): 7:1/95.98 MB 3:1/131.77 MB 2:4/551.70 MB 1:3/645.98 MB 4:2/342.64 MB 5:4/769.74 MB 6:1/253.87 MB 0:3/614.24 MB Filter 4 arrival: 1s944ms MemoryUsage(1s000ms): 581.02 KB, 70.53 MB, 159.44 MB, 159.95 MB, 160.42 MB, 160.35 MB, 160.31 MB, 160.28 MB, 160.16 MB, 160.04 MB, 159.98 MB, 160.01 MB, 159.84 MB, 159.86 MB, 160.09 MB, 156.06 MB, 144.00 MB, 136.12 MB, 136.06 MB, 135.99 MB, 124.36 MB, 112.71 MB, 96.79 MB, 96.79 MB, 80.89 MB, 80.87 MB, 62.36 MB, 53.44 MB, 53.29 MB, 53.46 MB, 53.36 MB, 53.42 MB, 53.41 MB, 45.48 MB, 37.44 MB, 37.41 MB, 29.42 MB, 5.12 MB, 2.46 MB ThreadUsage(1s000ms): 1, 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 3.70 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 161.60 MB (169452262) - PerHostPeakMemUsage: 848.44 MB (889657225) - RowsProduced: 9.13M (9127292) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33s583ms - TotalStorageWaitTime: 76.849ms - TotalThreadsInvoluntaryContextSwitches: 3.86K (3856) - TotalThreadsTotalWallClockTime: 2m26s - TotalThreadsSysTime: 3s069ms - TotalThreadsUserTime: 30s052ms - TotalThreadsVoluntaryContextSwitches: 262.91K (262913) Fragment Instance Lifecycle Timings: - ExecTime: 39s859ms - ExecTreeExecTime: 1s987ms - OpenTime: 27.677ms - ExecTreeOpenTime: 81.370us - PrepareTime: 31.480ms - ExecTreePrepareTime: 224.314us DataStreamSender (dst_id=20):(Total: 1s731ms, non-child: 1s731ms, % non-child: 100.00%) - BytesSent: 214.86 MB (225293118) - OverallThroughput: 124.07 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.13M (9127292) - SerializeBatchTime: 1s728ms - UncompressedRowBatchSize: 214.86 MB (225293118) CodeGen:(Total: 55.893ms, non-child: 55.893ms, % non-child: 100.00%) - CodegenTime: 1.355ms - CompileTime: 7.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.512ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.513ms HDFS_SCAN_NODE (id=1):(Total: 1s979ms, non-child: 1s979ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/95.98 MB 3:1/131.77 MB 2:4/551.70 MB 1:3/645.98 MB 4:2/342.64 MB 5:4/769.74 MB 6:1/253.87 MB 0:3/614.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s887ms Hdfs Read Thread Concurrency Bucket: 0:98.67% 1:1.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 53.05 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB, 130.23 MB - FooterProcessingTime: (Avg: 2.415ms ; Min: 2.287ms ; Max: 2.628ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 2.84 - BytesRead: 130.23 MB (136553141) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.23 MB (136553141) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.23 MB (136553141) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 485.042ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.53 MB (165177956) - PerReadThreadRawHdfsThroughput: 980.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.388ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 9.13M (9127292) - RowsReturned: 9.13M (9127292) - RowsReturnedRate: 4.61 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 3.21K (3212) - ScannerThreadsTotalWallClockTime: 1m46s - MaterializeTupleTime(*): 810.425ms - ScannerThreadsSysTime: 2s916ms - ScannerThreadsUserTime: 25s958ms - ScannerThreadsVoluntaryContextSwitches: 260.95K (260950) - TotalRawHdfsReadTime(*): 132.884ms - TotalReadThroughput: 3.47 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 16 (16) - Files total: 19 (19) - RowGroups processed: 8.91K (8915) - RowGroups rejected: 0 (0) - RowGroups total: 8.91K (8915) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 9.13M (9127292) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000166 (host=foo.221.36:22000):(Total: 39s619ms, non-child: 36s249ms, % non-child: 91.50%) Hdfs split stats (:<# splits>/): 5:3/646.54 MB 1:3/504.43 MB 3:6/681.26 MB 4:3/488.82 MB 7:3/558.32 MB 2:3/367.57 MB 0:4/426.53 MB Filter 4 arrival: 1s587ms MemoryUsage(1s000ms): 581.02 KB, 78.18 MB, 153.82 MB, 153.68 MB, 155.14 MB, 153.87 MB, 154.42 MB, 149.02 MB, 142.63 MB, 142.33 MB, 142.67 MB, 142.87 MB, 142.71 MB, 142.61 MB, 131.03 MB, 127.00 MB, 126.76 MB, 126.51 MB, 118.73 MB, 110.89 MB, 95.03 MB, 94.88 MB, 86.92 MB, 78.92 MB, 78.97 MB, 79.06 MB, 79.16 MB, 79.14 MB, 79.14 MB, 79.04 MB, 79.07 MB, 79.03 MB, 79.11 MB, 45.99 MB, 33.59 MB, 33.46 MB, 25.52 MB, 6.35 MB, 2.44 MB ThreadUsage(1s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 4.59 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 156.09 MB (163667073) - PerHostPeakMemUsage: 876.17 MB (918732360) - RowsProduced: 9.11M (9109608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33s776ms - TotalStorageWaitTime: 103.507ms - TotalThreadsInvoluntaryContextSwitches: 7.94K (7937) - TotalThreadsTotalWallClockTime: 3m1s - TotalThreadsSysTime: 8s029ms - TotalThreadsUserTime: 1m2s - TotalThreadsVoluntaryContextSwitches: 1.01M (1014516) Fragment Instance Lifecycle Timings: - ExecTime: 39s550ms - ExecTreeExecTime: 1s624ms - OpenTime: 27.722ms - ExecTreeOpenTime: 112.318us - PrepareTime: 40.898ms - ExecTreePrepareTime: 354.549us DataStreamSender (dst_id=20):(Total: 1s694ms, non-child: 1s694ms, % non-child: 100.00%) - BytesSent: 214.95 MB (225390877) - OverallThroughput: 126.89 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.11M (9109608) - SerializeBatchTime: 1s690ms - UncompressedRowBatchSize: 214.95 MB (225390877) CodeGen:(Total: 58.302ms, non-child: 58.302ms, % non-child: 100.00%) - CodegenTime: 2.658ms - CompileTime: 7.574ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.655ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.398ms HDFS_SCAN_NODE (id=1):(Total: 1s617ms, non-child: 1s617ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:3/646.54 MB 1:3/504.43 MB 3:6/681.26 MB 4:3/488.82 MB 7:3/558.32 MB 2:3/367.57 MB 0:4/426.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s525ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 65.03 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB - FooterProcessingTime: (Avg: 2.649ms ; Min: 1.935ms ; Max: 3.258ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.74 - BytesRead: 130.06 MB (136379199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.06 MB (136379199) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.06 MB (136379199) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 471.918ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 151.99 MB (159367846) - PerReadThreadRawHdfsThroughput: 1014.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.047ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 9.11M (9109608) - RowsReturned: 9.11M (9109608) - RowsReturnedRate: 5.63 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 7.28K (7275) - ScannerThreadsTotalWallClockTime: 2m21s - MaterializeTupleTime(*): 776.803ms - ScannerThreadsSysTime: 7s847ms - ScannerThreadsUserTime: 58s270ms - ScannerThreadsVoluntaryContextSwitches: 1.01M (1012436) - TotalRawHdfsReadTime(*): 128.232ms - TotalReadThroughput: 3.42 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 22 (22) - Files total: 25 (25) - RowGroups processed: 8.90K (8898) - RowGroups rejected: 0 (0) - RowGroups total: 8.90K (8898) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 9.11M (9109608) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000191 (host=foo.221.12:22000):(Total: 39s536ms, non-child: 35s968ms, % non-child: 90.98%) Hdfs split stats (:<# splits>/): 4:1/77.64 MB 5:2/310.25 MB 3:2/401.13 MB 2:4/771.36 MB 0:3/578.95 MB 1:3/643.60 MB 6:2/419.95 MB 7:3/373.01 MB Filter 4 arrival: 2s005ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 130.35 MB, 130.34 MB, 130.03 MB, 129.98 MB, 129.87 MB, 129.57 MB, 129.92 MB, 129.43 MB, 129.74 MB, 129.70 MB, 125.93 MB, 113.51 MB, 113.45 MB, 113.75 MB, 113.69 MB, 114.00 MB, 113.87 MB, 101.75 MB, 97.97 MB, 89.98 MB, 81.94 MB, 82.12 MB, 77.87 MB, 59.64 MB, 52.18 MB, 52.34 MB, 52.43 MB, 52.57 MB, 48.47 MB, 44.39 MB, 36.49 MB, 36.66 MB, 4.36 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB ThreadUsage(1s000ms): 1, 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.58 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 131.23 MB (137600589) - PerHostPeakMemUsage: 939.60 MB (985247066) - RowsProduced: 7.68M (7681796) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s192ms - TotalStorageWaitTime: 62.058ms - TotalThreadsInvoluntaryContextSwitches: 9.77K (9774) - TotalThreadsTotalWallClockTime: 3m2s - TotalThreadsSysTime: 19s908ms - TotalThreadsUserTime: 1m6s - TotalThreadsVoluntaryContextSwitches: 2.09M (2087892) Fragment Instance Lifecycle Timings: - ExecTime: 39s479ms - ExecTreeExecTime: 2s062ms - OpenTime: 25.229ms - ExecTreeOpenTime: 74.384us - PrepareTime: 31.637ms - ExecTreePrepareTime: 392.455us DataStreamSender (dst_id=20):(Total: 1s458ms, non-child: 1s458ms, % non-child: 100.00%) - BytesSent: 176.23 MB (184788318) - OverallThroughput: 120.79 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.68M (7681796) - SerializeBatchTime: 1s456ms - UncompressedRowBatchSize: 176.23 MB (184788318) CodeGen:(Total: 53.332ms, non-child: 53.332ms, % non-child: 100.00%) - CodegenTime: 1.366ms - CompileTime: 6.554ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.366ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.792ms HDFS_SCAN_NODE (id=1):(Total: 2s055ms, non-child: 2s055ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/77.64 MB 5:2/310.25 MB 3:2/401.13 MB 2:4/771.36 MB 0:3/578.95 MB 1:3/643.60 MB 6:2/419.95 MB 7:3/373.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s966ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 0, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB, 106.88 MB - FooterProcessingTime: (Avg: 3.021ms ; Min: 2.995ms ; Max: 3.047ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.10 - BytesRead: 106.88 MB (112072501) - BytesReadDataNodeCache: 0 - BytesReadLocal: 106.88 MB (112072501) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 106.88 MB (112072501) - CachedFileHandlesHitCount: 20 (20) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 406.552ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 127.18 MB (133361128) - PerReadThreadRawHdfsThroughput: 942.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.734ms - RowBatchQueuePutWaitTime: 54s708ms - RowsRead: 7.68M (7681796) - RowsReturned: 7.68M (7681796) - RowsReturnedRate: 3.74 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 9.22K (9219) - ScannerThreadsTotalWallClockTime: 2m23s - MaterializeTupleTime(*): 685.357ms - ScannerThreadsSysTime: 19s742ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 2.09M (2085977) - TotalRawHdfsReadTime(*): 113.401ms - TotalReadThroughput: 3.10 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 7.50K (7503) - RowGroups rejected: 0 (0) - RowGroups total: 7.50K (7503) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.68M (7681796) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000018f (host=foo.221.24:22000):(Total: 39s319ms, non-child: 35s921ms, % non-child: 91.36%) Hdfs split stats (:<# splits>/): 5:1/35.64 MB 7:2/195.84 MB 4:4/984.87 MB 3:2/490.81 MB 2:3/491.72 MB 0:3/452.99 MB 1:3/535.77 MB 6:2/337.09 MB Filter 4 arrival: 1s742ms MemoryUsage(1s000ms): 581.02 KB, 75.35 MB, 149.38 MB, 149.51 MB, 148.82 MB, 148.75 MB, 149.32 MB, 148.96 MB, 149.10 MB, 148.70 MB, 149.31 MB, 149.23 MB, 149.19 MB, 148.98 MB, 148.87 MB, 149.09 MB, 118.54 MB, 106.58 MB, 106.57 MB, 106.80 MB, 106.73 MB, 102.87 MB, 90.86 MB, 90.81 MB, 78.98 MB, 74.98 MB, 66.89 MB, 53.20 MB, 46.36 MB, 46.44 MB, 46.45 MB, 46.44 MB, 46.46 MB, 34.62 MB, 30.46 MB, 18.97 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(1s000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1, 1, 1 - AverageThreadTokens: 5.12 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 150.59 MB (157906516) - PerHostPeakMemUsage: 881.07 MB (923867661) - RowsProduced: 8.49M (8494739) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s880ms - TotalStorageWaitTime: 90.473ms - TotalThreadsInvoluntaryContextSwitches: 9.93K (9928) - TotalThreadsTotalWallClockTime: 3m20s - TotalThreadsSysTime: 21s266ms - TotalThreadsUserTime: 1m4s - TotalThreadsVoluntaryContextSwitches: 2.29M (2290325) Fragment Instance Lifecycle Timings: - ExecTime: 39s260ms - ExecTreeExecTime: 1s769ms - OpenTime: 27.488ms - ExecTreeOpenTime: 84.419us - PrepareTime: 31.142ms - ExecTreePrepareTime: 294.261us DataStreamSender (dst_id=20):(Total: 1s580ms, non-child: 1s580ms, % non-child: 100.00%) - BytesSent: 196.67 MB (206226907) - OverallThroughput: 124.40 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.49M (8494739) - SerializeBatchTime: 1s578ms - UncompressedRowBatchSize: 196.67 MB (206226907) CodeGen:(Total: 55.279ms, non-child: 55.279ms, % non-child: 100.00%) - CodegenTime: 1.550ms - CompileTime: 6.828ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.362ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.451ms HDFS_SCAN_NODE (id=1):(Total: 1s761ms, non-child: 1s761ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/35.64 MB 7:2/195.84 MB 4:4/984.87 MB 3:2/490.81 MB 2:3/491.72 MB 0:3/452.99 MB 1:3/535.77 MB 6:2/337.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s685ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 59.64 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB, 119.28 MB - FooterProcessingTime: (Avg: 3.499ms ; Min: 2.914ms ; Max: 4.660ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.46 - BytesRead: 119.28 MB (125069520) - BytesReadDataNodeCache: 0 - BytesReadLocal: 119.28 MB (125069520) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 119.28 MB (125069520) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 441.754ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 146.51 MB (153630894) - PerReadThreadRawHdfsThroughput: 1006.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.158ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 8.49M (8494739) - RowsReturned: 8.49M (8494739) - RowsReturnedRate: 4.82 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 9.32K (9320) - ScannerThreadsTotalWallClockTime: 2m41s - MaterializeTupleTime(*): 729.992ms - ScannerThreadsSysTime: 21s112ms - ScannerThreadsUserTime: 1m - ScannerThreadsVoluntaryContextSwitches: 2.29M (2288266) - TotalRawHdfsReadTime(*): 118.527ms - TotalReadThroughput: 3.31 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 17 (17) - Files total: 20 (20) - RowGroups processed: 8.30K (8297) - RowGroups rejected: 0 (0) - RowGroups total: 8.30K (8297) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.49M (8494739) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000015a (host=foo.232.21:22000):(Total: 38s806ms, non-child: 35s805ms, % non-child: 92.27%) Hdfs split stats (:<# splits>/): 7:2/465.10 MB 4:4/695.07 MB 5:2/277.57 MB 6:4/464.25 MB 1:2/159.14 MB 3:4/482.43 MB 2:4/720.99 MB 0:3/524.09 MB Filter 4 arrival: 991ms MemoryUsage(1s000ms): 581.02 KB, 165.83 MB, 165.77 MB, 164.49 MB, 164.61 MB, 164.70 MB, 165.08 MB, 165.36 MB, 164.97 MB, 164.81 MB, 164.85 MB, 165.34 MB, 165.03 MB, 165.04 MB, 165.19 MB, 164.98 MB, 149.19 MB, 141.28 MB, 141.15 MB, 141.24 MB, 130.89 MB, 119.77 MB, 111.61 MB, 95.85 MB, 87.87 MB, 87.74 MB, 75.97 MB, 71.86 MB, 72.03 MB, 71.99 MB, 71.77 MB, 71.88 MB, 47.57 MB, 38.44 MB, 26.48 MB, 4.82 MB, 2.31 MB, 2.31 MB ThreadUsage(1s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.53 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 170.07 MB (178327159) - PerHostPeakMemUsage: 955.18 MB (1001576330) - RowsProduced: 9.88M (9884482) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s406ms - TotalStorageWaitTime: 117.629ms - TotalThreadsInvoluntaryContextSwitches: 6.44K (6439) - TotalThreadsTotalWallClockTime: 2m55s - TotalThreadsSysTime: 5s438ms - TotalThreadsUserTime: 51s356ms - TotalThreadsVoluntaryContextSwitches: 600.76K (600763) Fragment Instance Lifecycle Timings: - ExecTime: 38s747ms - ExecTreeExecTime: 1s054ms - OpenTime: 23.296ms - ExecTreeOpenTime: 92.242us - PrepareTime: 35.124ms - ExecTreePrepareTime: 586.013us DataStreamSender (dst_id=20):(Total: 1s899ms, non-child: 1s899ms, % non-child: 100.00%) - BytesSent: 234.35 MB (245732143) - OverallThroughput: 123.39 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.88M (9884482) - SerializeBatchTime: 1s894ms - UncompressedRowBatchSize: 234.35 MB (245732143) CodeGen:(Total: 54.828ms, non-child: 54.828ms, % non-child: 100.00%) - CodegenTime: 1.032ms - CompileTime: 6.854ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.657ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.887ms HDFS_SCAN_NODE (id=1):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:2/465.10 MB 4:4/695.07 MB 5:2/277.57 MB 6:4/464.25 MB 1:2/159.14 MB 3:4/482.43 MB 2:4/720.99 MB 0:3/524.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 943ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB, 143.09 MB - FooterProcessingTime: (Avg: 3.854ms ; Min: 3.178ms ; Max: 4.943ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.83 - BytesRead: 143.09 MB (150039216) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.09 MB (150039216) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.09 MB (150039216) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 490.643ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 165.99 MB (174049724) - PerReadThreadRawHdfsThroughput: 874.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.857ms - RowBatchQueuePutWaitTime: 1m24s - RowsRead: 9.88M (9884482) - RowsReturned: 9.88M (9884482) - RowsReturnedRate: 9.44 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 5.74K (5744) - ScannerThreadsTotalWallClockTime: 2m17s - MaterializeTupleTime(*): 876.545ms - ScannerThreadsSysTime: 5s255ms - ScannerThreadsUserTime: 46s911ms - ScannerThreadsVoluntaryContextSwitches: 598.61K (598612) - TotalRawHdfsReadTime(*): 163.550ms - TotalReadThroughput: 4.03 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 21 (21) - Files total: 25 (25) - RowGroups processed: 9.65K (9655) - RowGroups rejected: 0 (0) - RowGroups total: 9.65K (9655) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 9.88M (9884482) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000013f (host=foo.232.22:22000):(Total: 37s920ms, non-child: 34s662ms, % non-child: 91.41%) Hdfs split stats (:<# splits>/): 3:3/347.67 MB 1:2/298.10 MB 6:1/79.00 MB 0:4/476.50 MB 2:1/40.55 MB 7:1/253.93 MB 4:3/729.30 MB 5:5/1.07 GB Filter 4 arrival: 1s299ms MemoryUsage(1s000ms): 581.02 KB, 80.72 MB, 159.47 MB, 159.52 MB, 159.53 MB, 160.19 MB, 159.28 MB, 159.51 MB, 159.20 MB, 159.46 MB, 159.63 MB, 160.05 MB, 159.55 MB, 159.70 MB, 151.77 MB, 143.59 MB, 143.98 MB, 143.88 MB, 135.81 MB, 127.93 MB, 111.72 MB, 111.91 MB, 103.98 MB, 95.82 MB, 96.11 MB, 96.11 MB, 95.79 MB, 95.91 MB, 95.80 MB, 95.89 MB, 76.03 MB, 63.92 MB, 64.02 MB, 63.97 MB, 63.91 MB, 48.02 MB, 4.74 MB, 2.38 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 5.04 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 161.20 MB (169031825) - PerHostPeakMemUsage: 962.51 MB (1009261762) - RowsProduced: 9.54M (9535335) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s695ms - TotalStorageWaitTime: 65.657ms - TotalThreadsInvoluntaryContextSwitches: 9.42K (9419) - TotalThreadsTotalWallClockTime: 3m12s - TotalThreadsSysTime: 21s013ms - TotalThreadsUserTime: 1m1s - TotalThreadsVoluntaryContextSwitches: 2.19M (2192121) Fragment Instance Lifecycle Timings: - ExecTime: 37s867ms - ExecTreeExecTime: 1s374ms - OpenTime: 25.004ms - ExecTreeOpenTime: 67.308us - PrepareTime: 27.328ms - ExecTreePrepareTime: 283.841us DataStreamSender (dst_id=20):(Total: 1s841ms, non-child: 1s841ms, % non-child: 100.00%) - BytesSent: 225.28 MB (236219061) - OverallThroughput: 122.33 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.54M (9535335) - SerializeBatchTime: 1s838ms - UncompressedRowBatchSize: 225.28 MB (236219061) CodeGen:(Total: 49.142ms, non-child: 49.142ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 7.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.007ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.497ms HDFS_SCAN_NODE (id=1):(Total: 1s366ms, non-child: 1s366ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:3/347.67 MB 1:2/298.10 MB 6:1/79.00 MB 0:4/476.50 MB 2:1/40.55 MB 7:1/253.93 MB 4:3/729.30 MB 5:5/1.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s264ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 68.08 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB, 136.15 MB - FooterProcessingTime: (Avg: 3.152ms ; Min: 2.636ms ; Max: 3.669ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.21 - BytesRead: 136.15 MB (142766169) - BytesReadDataNodeCache: 0 - BytesReadLocal: 136.15 MB (142766169) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 136.15 MB (142766169) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 486.584ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.15 MB (164786879) - PerReadThreadRawHdfsThroughput: 855.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.918ms - RowBatchQueuePutWaitTime: 1m7s - RowsRead: 9.54M (9535335) - RowsReturned: 9.54M (9535335) - RowsReturnedRate: 6.98 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 8.71K (8708) - ScannerThreadsTotalWallClockTime: 2m34s - MaterializeTupleTime(*): 873.577ms - ScannerThreadsSysTime: 20s815ms - ScannerThreadsUserTime: 57s227ms - ScannerThreadsVoluntaryContextSwitches: 2.19M (2189922) - TotalRawHdfsReadTime(*): 159.238ms - TotalReadThroughput: 3.73 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 9.31K (9313) - RowGroups rejected: 0 (0) - RowGroups total: 9.31K (9313) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.54M (9535335) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000180 (host=foo.187.51:22000):(Total: 37s301ms, non-child: 32s568ms, % non-child: 87.31%) Hdfs split stats (:<# splits>/): 0:3/761.70 MB 7:1/183.81 MB 3:4/651.22 MB 6:2/268.27 MB 2:3/433.48 MB 4:5/644.65 MB 5:4/519.97 MB 1:2/323.55 MB Filter 4 arrival: 1s974ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 264.08 MB, 263.34 MB, 263.41 MB, 263.35 MB, 262.85 MB, 263.62 MB, 263.60 MB, 263.60 MB, 263.45 MB, 263.44 MB, 259.31 MB, 243.55 MB, 231.70 MB, 231.64 MB, 231.52 MB, 231.72 MB, 231.59 MB, 231.66 MB, 207.72 MB, 199.68 MB, 187.91 MB, 167.99 MB, 141.95 MB, 125.46 MB, 125.50 MB, 125.46 MB, 125.54 MB, 125.41 MB, 95.82 MB, 95.88 MB, 91.99 MB, 68.04 MB, 60.17 MB, 25.30 MB, 2.59 MB ThreadUsage(1s000ms): 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1 - AverageThreadTokens: 4.57 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 264.95 MB (277815009) - PerHostPeakMemUsage: 993.06 MB (1041299765) - RowsProduced: 15.65M (15645969) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28s643ms - TotalStorageWaitTime: 168.161ms - TotalThreadsInvoluntaryContextSwitches: 3.24K (3243) - TotalThreadsTotalWallClockTime: 2m50s - TotalThreadsSysTime: 1s576ms - TotalThreadsUserTime: 23s762ms - TotalThreadsVoluntaryContextSwitches: 142.49K (142494) Fragment Instance Lifecycle Timings: - ExecTime: 37s244ms - ExecTreeExecTime: 2s074ms - OpenTime: 24.212ms - ExecTreeOpenTime: 72.013us - PrepareTime: 33.489ms - ExecTreePrepareTime: 325.173us DataStreamSender (dst_id=20):(Total: 2s622ms, non-child: 2s622ms, % non-child: 100.00%) - BytesSent: 372.71 MB (390814863) - OverallThroughput: 142.10 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 15.65M (15645969) - SerializeBatchTime: 2s617ms - UncompressedRowBatchSize: 372.71 MB (390814863) CodeGen:(Total: 48.927ms, non-child: 48.927ms, % non-child: 100.00%) - CodegenTime: 1.460ms - CompileTime: 6.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.791ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.632ms HDFS_SCAN_NODE (id=1):(Total: 2s061ms, non-child: 2s061ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:3/761.70 MB 7:1/183.81 MB 3:4/651.22 MB 6:2/268.27 MB 2:3/433.48 MB 4:5/644.65 MB 5:4/519.97 MB 1:2/323.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s926ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 0, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB, 223.07 MB - FooterProcessingTime: (Avg: 3.327ms ; Min: 3.004ms ; Max: 4.238ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.77 - BytesRead: 223.07 MB (233907717) - BytesReadDataNodeCache: 0 - BytesReadLocal: 223.07 MB (233907717) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 223.07 MB (233907717) - CachedFileHandlesHitCount: 41 (41) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 792.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 260.90 MB (273577761) - PerReadThreadRawHdfsThroughput: 939.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 40.965ms - RowBatchQueuePutWaitTime: 1m54s - RowsRead: 15.65M (15645969) - RowsReturned: 15.65M (15645969) - RowsReturnedRate: 7.59 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.28K (2283) - ScannerThreadsTotalWallClockTime: 2m13s - MaterializeTupleTime(*): 1s296ms - ScannerThreadsSysTime: 1s350ms - ScannerThreadsUserTime: 17s595ms - ScannerThreadsVoluntaryContextSwitches: 140.12K (140121) - TotalRawHdfsReadTime(*): 237.530ms - TotalReadThroughput: 6.28 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 20 (20) - Files total: 24 (24) - RowGroups processed: 15.28K (15282) - RowGroups rejected: 0 (0) - RowGroups total: 15.28K (15282) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 15.65M (15645969) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000016f (host=foo.232.41:22000):(Total: 36s810ms, non-child: 33s958ms, % non-child: 92.25%) Hdfs split stats (:<# splits>/): 3:1/254.10 MB 1:1/212.88 MB 0:2/391.90 MB 2:3/614.48 MB 4:3/336.34 MB 5:4/652.70 MB 6:4/667.08 MB 7:5/402.46 MB Filter 4 arrival: 684ms MemoryUsage(1s000ms): 574.71 KB, 188.29 MB, 187.62 MB, 187.40 MB, 187.04 MB, 187.47 MB, 187.85 MB, 187.78 MB, 187.62 MB, 187.48 MB, 187.50 MB, 187.86 MB, 187.61 MB, 187.82 MB, 187.52 MB, 187.64 MB, 187.51 MB, 174.08 MB, 160.06 MB, 152.04 MB, 136.13 MB, 136.07 MB, 136.26 MB, 136.20 MB, 125.01 MB, 104.78 MB, 96.75 MB, 80.91 MB, 80.88 MB, 53.43 MB, 53.46 MB, 53.44 MB, 53.36 MB, 45.35 MB, 37.40 MB, 18.70 MB, 2.46 MB ThreadUsage(1s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3, 1 - AverageThreadTokens: 4.73 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 188.94 MB (198117305) - PerHostPeakMemUsage: 876.24 MB (918805749) - RowsProduced: 10.54M (10540146) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s800ms - TotalStorageWaitTime: 137.520ms - TotalThreadsInvoluntaryContextSwitches: 4.99K (4988) - TotalThreadsTotalWallClockTime: 2m55s - TotalThreadsSysTime: 7s868ms - TotalThreadsUserTime: 33s522ms - TotalThreadsVoluntaryContextSwitches: 782.33K (782326) Fragment Instance Lifecycle Timings: - ExecTime: 36s750ms - ExecTreeExecTime: 752.873ms - OpenTime: 29.582ms - ExecTreeOpenTime: 95.372us - PrepareTime: 30.565ms - ExecTreePrepareTime: 338.591us DataStreamSender (dst_id=20):(Total: 2s051ms, non-child: 2s051ms, % non-child: 100.00%) - BytesSent: 248.97 MB (261061169) - OverallThroughput: 121.34 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.54M (10540146) - SerializeBatchTime: 2s047ms - UncompressedRowBatchSize: 248.97 MB (261061169) CodeGen:(Total: 56.452ms, non-child: 56.452ms, % non-child: 100.00%) - CodegenTime: 1.368ms - CompileTime: 7.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.708ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.551ms HDFS_SCAN_NODE (id=1):(Total: 743.289ms, non-child: 743.289ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/254.10 MB 1:1/212.88 MB 0:2/391.90 MB 2:3/614.48 MB 4:3/336.34 MB 5:4/652.70 MB 6:4/667.08 MB 7:5/402.46 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 642ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB, 149.10 MB - FooterProcessingTime: (Avg: 2.838ms ; Min: 2.502ms ; Max: 3.716ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 149.10 MB (156341922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 149.10 MB (156341922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 149.10 MB (156341922) - CachedFileHandlesHitCount: 31 (31) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 563.357ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 184.90 MB (193878056) - PerReadThreadRawHdfsThroughput: 897.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.699ms - RowBatchQueuePutWaitTime: 1m41s - RowsRead: 10.54M (10540146) - RowsReturned: 10.54M (10540146) - RowsReturnedRate: 14.18 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 4.22K (4221) - ScannerThreadsTotalWallClockTime: 2m18s - MaterializeTupleTime(*): 945.690ms - ScannerThreadsSysTime: 7s667ms - ScannerThreadsUserTime: 28s724ms - ScannerThreadsVoluntaryContextSwitches: 780.34K (780341) - TotalRawHdfsReadTime(*): 166.214ms - TotalReadThroughput: 4.14 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 19 (19) - Files total: 23 (23) - RowGroups processed: 10.29K (10295) - RowGroups rejected: 0 (0) - RowGroups total: 10.29K (10295) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 10.54M (10540146) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000133 (host=foo.232.20:22000):(Total: 36s730ms, non-child: 33s801ms, % non-child: 92.03%) Hdfs split stats (:<# splits>/): 7:1/158.55 MB 0:2/212.36 MB 6:2/355.86 MB 4:2/484.82 MB 3:4/541.38 MB 2:5/649.05 MB 5:3/272.03 MB 1:4/609.18 MB Filter 4 arrival: 1s324ms MemoryUsage(1s000ms): 581.02 KB, 154.86 MB, 153.45 MB, 154.27 MB, 153.26 MB, 149.68 MB, 144.36 MB, 143.74 MB, 143.85 MB, 136.41 MB, 128.83 MB, 129.22 MB, 129.17 MB, 129.18 MB, 128.97 MB, 129.21 MB, 121.09 MB, 113.32 MB, 113.08 MB, 113.06 MB, 113.34 MB, 105.43 MB, 97.27 MB, 97.35 MB, 81.45 MB, 81.45 MB, 67.83 MB, 53.34 MB, 53.44 MB, 53.43 MB, 45.47 MB, 37.51 MB, 29.50 MB, 4.94 MB, 2.56 MB, 2.56 MB ThreadUsage(1s000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.51 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 154.94 MB (162461307) - PerHostPeakMemUsage: 892.11 MB (935440900) - RowsProduced: 8.58M (8581175) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s963ms - TotalStorageWaitTime: 76.086ms - TotalThreadsInvoluntaryContextSwitches: 7.13K (7127) - TotalThreadsTotalWallClockTime: 2m45s - TotalThreadsSysTime: 8s816ms - TotalThreadsUserTime: 52s539ms - TotalThreadsVoluntaryContextSwitches: 1.06M (1064807) Fragment Instance Lifecycle Timings: - ExecTime: 36s683ms - ExecTreeExecTime: 1s354ms - OpenTime: 23.278ms - ExecTreeOpenTime: 70.960us - PrepareTime: 23.639ms - ExecTreePrepareTime: 359.903us DataStreamSender (dst_id=20):(Total: 1s537ms, non-child: 1s537ms, % non-child: 100.00%) - BytesSent: 201.78 MB (211586573) - OverallThroughput: 131.23 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.58M (8581175) - SerializeBatchTime: 1s534ms - UncompressedRowBatchSize: 201.78 MB (211586573) CodeGen:(Total: 43.750ms, non-child: 43.750ms, % non-child: 100.00%) - CodegenTime: 1.080ms - CompileTime: 6.765ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.692ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.788ms HDFS_SCAN_NODE (id=1):(Total: 1s347ms, non-child: 1s347ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/158.55 MB 0:2/212.36 MB 6:2/355.86 MB 4:2/484.82 MB 3:4/541.38 MB 2:5/649.05 MB 5:3/272.03 MB 1:4/609.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s285ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB, 122.87 MB - FooterProcessingTime: (Avg: 2.798ms ; Min: 2.539ms ; Max: 3.334ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.82 - BytesRead: 122.87 MB (128834113) - BytesReadDataNodeCache: 0 - BytesReadLocal: 122.87 MB (128834113) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 122.87 MB (128834113) - CachedFileHandlesHitCount: 31 (31) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 423.226ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 150.89 MB (158222643) - PerReadThreadRawHdfsThroughput: 810.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.134ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 8.58M (8581175) - RowsReturned: 8.58M (8581175) - RowsReturnedRate: 6.37 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 6.55K (6553) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 702.932ms - ScannerThreadsSysTime: 8s700ms - ScannerThreadsUserTime: 48s883ms - ScannerThreadsVoluntaryContextSwitches: 1.06M (1062941) - TotalRawHdfsReadTime(*): 151.511ms - TotalReadThroughput: 3.67 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 19 (19) - Files total: 23 (23) - RowGroups processed: 8.38K (8382) - RowGroups rejected: 0 (0) - RowGroups total: 8.38K (8382) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 8.58M (8581175) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000165 (host=foo.187.52:22000):(Total: 35s466ms, non-child: 30s742ms, % non-child: 86.68%) Hdfs split stats (:<# splits>/): 6:1/253.88 MB 7:1/253.86 MB 5:3/475.87 MB 4:1/220.22 MB 2:2/395.27 MB 0:4/627.05 MB 1:7/1.00 GB 3:3/505.74 MB Filter 4 arrival: 1s890ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 258.53 MB, 259.52 MB, 258.42 MB, 258.93 MB, 259.07 MB, 258.64 MB, 259.01 MB, 258.73 MB, 254.97 MB, 250.99 MB, 243.01 MB, 227.08 MB, 227.11 MB, 215.14 MB, 207.11 MB, 191.32 MB, 175.33 MB, 163.48 MB, 163.42 MB, 159.50 MB, 155.45 MB, 129.71 MB, 119.76 MB, 119.57 MB, 119.82 MB, 119.58 MB, 111.60 MB, 107.72 MB, 95.72 MB, 60.67 MB, 48.05 MB, 48.15 MB, 29.95 MB ThreadUsage(1s000ms): 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5 - AverageThreadTokens: 4.72 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 260.43 MB (273081623) - PerHostPeakMemUsage: 958.64 MB (1005205950) - RowsProduced: 16.36M (16355521) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26s922ms - TotalStorageWaitTime: 190.711ms - TotalThreadsInvoluntaryContextSwitches: 3.32K (3318) - TotalThreadsTotalWallClockTime: 2m47s - TotalThreadsSysTime: 1s593ms - TotalThreadsUserTime: 23s388ms - TotalThreadsVoluntaryContextSwitches: 194.67K (194668) Fragment Instance Lifecycle Timings: - ExecTime: 35s411ms - ExecTreeExecTime: 1s994ms - OpenTime: 25.470ms - ExecTreeOpenTime: 81.084us - PrepareTime: 30.286ms - ExecTreePrepareTime: 370.127us DataStreamSender (dst_id=20):(Total: 2s689ms, non-child: 2s689ms, % non-child: 100.00%) - BytesSent: 389.96 MB (408903698) - OverallThroughput: 144.98 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 16.36M (16355521) - SerializeBatchTime: 2s683ms - UncompressedRowBatchSize: 389.96 MB (408903698) CodeGen:(Total: 52.056ms, non-child: 52.056ms, % non-child: 100.00%) - CodegenTime: 1.245ms - CompileTime: 6.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.725ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.238ms HDFS_SCAN_NODE (id=1):(Total: 1s982ms, non-child: 1s982ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.88 MB 7:1/253.86 MB 5:3/475.87 MB 4:1/220.22 MB 2:2/395.27 MB 0:4/627.05 MB 1:7/1.00 GB 3:3/505.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s847ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 0, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB, 234.12 MB - FooterProcessingTime: (Avg: 3.522ms ; Min: 2.819ms ; Max: 5.342ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.77 - BytesRead: 234.12 MB (245495578) - BytesReadDataNodeCache: 0 - BytesReadLocal: 234.12 MB (245495578) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 234.12 MB (245495578) - CachedFileHandlesHitCount: 44 (44) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 823.918ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 256.40 MB (268859965) - PerReadThreadRawHdfsThroughput: 873.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 42.332ms - RowBatchQueuePutWaitTime: 1m53s - RowsRead: 16.36M (16355521) - RowsReturned: 16.36M (16355521) - RowsReturnedRate: 8.25 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 2.35K (2353) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 1s405ms - ScannerThreadsSysTime: 1s396ms - ScannerThreadsUserTime: 17s075ms - ScannerThreadsVoluntaryContextSwitches: 192.22K (192223) - TotalRawHdfsReadTime(*): 268.084ms - TotalReadThroughput: 6.69 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 18 (18) - Files total: 22 (22) - RowGroups processed: 15.97K (15974) - RowGroups rejected: 0 (0) - RowGroups total: 15.97K (15974) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 16.36M (16355521) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000148 (host=foo.221.41:22000):(Total: 35s366ms, non-child: 32s240ms, % non-child: 91.16%) Hdfs split stats (:<# splits>/): 3:1/254.09 MB 0:3/425.71 MB 1:3/499.91 MB 5:6/1.22 GB 4:2/297.77 MB 2:1/254.05 MB 7:4/456.56 MB Filter 4 arrival: 1s555ms MemoryUsage(1s000ms): 581.02 KB, 68.85 MB, 135.23 MB, 134.05 MB, 134.23 MB, 134.74 MB, 134.74 MB, 134.07 MB, 134.79 MB, 134.78 MB, 134.36 MB, 127.02 MB, 118.72 MB, 118.45 MB, 118.89 MB, 118.75 MB, 118.80 MB, 102.85 MB, 102.86 MB, 87.02 MB, 87.10 MB, 71.03 MB, 71.06 MB, 70.68 MB, 70.95 MB, 70.83 MB, 70.94 MB, 60.21 MB, 49.44 MB, 49.35 MB, 37.54 MB, 33.40 MB, 33.47 MB, 25.65 MB, 4.01 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 5.15 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 137.17 MB (143838113) - PerHostPeakMemUsage: 912.22 MB (956530290) - RowsProduced: 8.29M (8288420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 29s947ms - TotalStorageWaitTime: 76.805ms - TotalThreadsInvoluntaryContextSwitches: 9.65K (9651) - TotalThreadsTotalWallClockTime: 3m2s - TotalThreadsSysTime: 27s659ms - TotalThreadsUserTime: 54s969ms - TotalThreadsVoluntaryContextSwitches: 2.79M (2786952) Fragment Instance Lifecycle Timings: - ExecTime: 35s314ms - ExecTreeExecTime: 1s574ms - OpenTime: 25.188ms - ExecTreeOpenTime: 76.986us - PrepareTime: 26.732ms - ExecTreePrepareTime: 444.324us DataStreamSender (dst_id=20):(Total: 1s509ms, non-child: 1s509ms, % non-child: 100.00%) - BytesSent: 195.53 MB (205027372) - OverallThroughput: 129.51 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.29M (8288420) - SerializeBatchTime: 1s506ms - UncompressedRowBatchSize: 195.53 MB (205027372) CodeGen:(Total: 48.176ms, non-child: 48.176ms, % non-child: 100.00%) - CodegenTime: 1.128ms - CompileTime: 6.943ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.427ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.220ms HDFS_SCAN_NODE (id=1):(Total: 1s568ms, non-child: 1s568ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/254.09 MB 0:3/425.71 MB 1:3/499.91 MB 5:6/1.22 GB 4:2/297.77 MB 2:1/254.05 MB 7:4/456.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s506ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 59.57 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB, 119.13 MB - FooterProcessingTime: (Avg: 3.024ms ; Min: 2.766ms ; Max: 3.536ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.28 - BytesRead: 119.13 MB (124921284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 119.13 MB (124921284) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 119.13 MB (124921284) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 418.937ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.15 MB (139614088) - PerReadThreadRawHdfsThroughput: 888.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.930ms - RowBatchQueuePutWaitTime: 56s804ms - RowsRead: 8.29M (8288420) - RowsReturned: 8.29M (8288420) - RowsReturnedRate: 5.28 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 9.08K (9076) - ScannerThreadsTotalWallClockTime: 2m27s - MaterializeTupleTime(*): 694.958ms - ScannerThreadsSysTime: 27s504ms - ScannerThreadsUserTime: 51s444ms - ScannerThreadsVoluntaryContextSwitches: 2.79M (2785163) - TotalRawHdfsReadTime(*): 134.028ms - TotalReadThroughput: 3.45 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 17 (17) - Files total: 20 (20) - RowGroups processed: 8.10K (8096) - RowGroups rejected: 0 (0) - RowGroups total: 8.10K (8096) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.29M (8288420) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000173 (host=foo.232.35:22000):(Total: 34s971ms, non-child: 32s261ms, % non-child: 92.25%) Hdfs split stats (:<# splits>/): 3:2/343.83 MB 2:2/291.57 MB 6:6/285.19 MB 1:1/48.21 MB 4:2/457.48 MB 5:6/717.45 MB 7:4/590.86 MB 0:3/644.48 MB Filter 4 arrival: 998ms MemoryUsage(1s000ms): 581.02 KB, 149.04 MB, 148.92 MB, 148.05 MB, 147.91 MB, 148.20 MB, 148.57 MB, 148.06 MB, 148.32 MB, 139.35 MB, 129.92 MB, 129.68 MB, 129.95 MB, 129.83 MB, 129.35 MB, 121.72 MB, 113.68 MB, 113.80 MB, 113.57 MB, 113.65 MB, 101.84 MB, 93.81 MB, 85.85 MB, 82.02 MB, 77.89 MB, 66.08 MB, 66.21 MB, 66.08 MB, 66.14 MB, 66.13 MB, 53.30 MB, 40.55 MB, 32.48 MB, 3.59 MB, 2.49 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 3.74 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 149.59 MB (156860532) - PerHostPeakMemUsage: 877.39 MB (920009780) - RowsProduced: 8.61M (8613340) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 29s702ms - TotalStorageWaitTime: 76.213ms - TotalThreadsInvoluntaryContextSwitches: 3.58K (3575) - TotalThreadsTotalWallClockTime: 2m11s - TotalThreadsSysTime: 819.874ms - TotalThreadsUserTime: 30s972ms - TotalThreadsVoluntaryContextSwitches: 77.08K (77082) Fragment Instance Lifecycle Timings: - ExecTime: 34s915ms - ExecTreeExecTime: 1s053ms - OpenTime: 25.614ms - ExecTreeOpenTime: 88.962us - PrepareTime: 30.355ms - ExecTreePrepareTime: 632.548us DataStreamSender (dst_id=20):(Total: 1s612ms, non-child: 1s612ms, % non-child: 100.00%) - BytesSent: 203.92 MB (213826973) - OverallThroughput: 126.43 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.61M (8613340) - SerializeBatchTime: 1s609ms - UncompressedRowBatchSize: 203.92 MB (213826973) CodeGen:(Total: 50.143ms, non-child: 50.143ms, % non-child: 100.00%) - CodegenTime: 1.802ms - CompileTime: 6.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.864ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.918ms HDFS_SCAN_NODE (id=1):(Total: 1s046ms, non-child: 1s046ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/343.83 MB 2:2/291.57 MB 6:6/285.19 MB 1:1/48.21 MB 4:2/457.48 MB 5:6/717.45 MB 7:4/590.86 MB 0:3/644.48 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 963ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB, 124.64 MB - FooterProcessingTime: (Avg: 2.967ms ; Min: 2.777ms ; Max: 3.081ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.87 - BytesRead: 124.64 MB (130697692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.64 MB (130697692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.64 MB (130697692) - CachedFileHandlesHitCount: 25 (25) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 451.297ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 145.51 MB (152580398) - PerReadThreadRawHdfsThroughput: 935.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 25.023ms - RowBatchQueuePutWaitTime: 1m8s - RowsRead: 8.61M (8613340) - RowsReturned: 8.61M (8613340) - RowsReturnedRate: 8.23 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 2.99K (2991) - ScannerThreadsTotalWallClockTime: 1m36s - MaterializeTupleTime(*): 754.457ms - ScannerThreadsSysTime: 667.897ms - ScannerThreadsUserTime: 27s121ms - ScannerThreadsVoluntaryContextSwitches: 75.22K (75223) - TotalRawHdfsReadTime(*): 133.204ms - TotalReadThroughput: 3.72 MB/sec Filter 4 (8.00 KB): - Files processed: 26 (26) - Files rejected: 23 (23) - Files total: 26 (26) - RowGroups processed: 8.41K (8413) - RowGroups rejected: 0 (0) - RowGroups total: 8.41K (8413) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.61M (8613340) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000011b (host=foo.221.49:22000):(Total: 34s825ms, non-child: 31s624ms, % non-child: 90.81%) Hdfs split stats (:<# splits>/): 5:1/41.10 MB 6:2/425.23 MB 1:3/248.83 MB 4:3/511.02 MB 3:4/1015.83 MB 7:3/334.54 MB 2:2/331.98 MB 0:2/399.57 MB Filter 4 arrival: 1s446ms MemoryUsage(1s000ms): 693.71 KB, 74.15 MB, 146.24 MB, 146.35 MB, 146.93 MB, 146.92 MB, 145.70 MB, 146.10 MB, 146.52 MB, 145.96 MB, 146.23 MB, 130.28 MB, 130.42 MB, 130.53 MB, 130.02 MB, 130.28 MB, 130.11 MB, 126.09 MB, 114.16 MB, 106.39 MB, 98.50 MB, 98.41 MB, 94.46 MB, 86.42 MB, 82.49 MB, 82.55 MB, 52.90 MB, 52.97 MB, 40.84 MB, 36.97 MB, 36.93 MB, 32.83 MB, 18.16 MB, 2.39 MB, 2.39 MB ThreadUsage(1s000ms): 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1 - AverageThreadTokens: 2.77 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 147.73 MB (154902034) - PerHostPeakMemUsage: 947.14 MB (993152335) - RowsProduced: 8.51M (8510051) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28s581ms - TotalStorageWaitTime: 53.391ms - TotalThreadsInvoluntaryContextSwitches: 1.72K (1718) - TotalThreadsTotalWallClockTime: 1m36s - TotalThreadsSysTime: 278.957ms - TotalThreadsUserTime: 11s833ms - TotalThreadsVoluntaryContextSwitches: 10.28K (10276) Fragment Instance Lifecycle Timings: - ExecTime: 34s778ms - ExecTreeExecTime: 1s503ms - OpenTime: 24.029ms - ExecTreeOpenTime: 85.668us - PrepareTime: 22.753ms - ExecTreePrepareTime: 187.174us DataStreamSender (dst_id=20):(Total: 1s660ms, non-child: 1s660ms, % non-child: 100.00%) - BytesSent: 197.92 MB (207529525) - OverallThroughput: 119.17 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.51M (8510051) - SerializeBatchTime: 1s657ms - UncompressedRowBatchSize: 197.92 MB (207529525) CodeGen:(Total: 44.257ms, non-child: 44.257ms, % non-child: 100.00%) - CodegenTime: 1.042ms - CompileTime: 6.570ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.637ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.591ms HDFS_SCAN_NODE (id=1):(Total: 1s495ms, non-child: 1s495ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/41.10 MB 6:2/425.23 MB 1:3/248.83 MB 4:3/511.02 MB 3:4/1015.83 MB 7:3/334.54 MB 2:2/331.98 MB 0:2/399.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s404ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 59.58 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB, 119.16 MB - FooterProcessingTime: (Avg: 2.886ms ; Min: 2.845ms ; Max: 2.928ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 119.16 MB (124947118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 119.16 MB (124947118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 119.16 MB (124947118) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 444.185ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 143.65 MB (150626783) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.191ms - RowBatchQueuePutWaitTime: 53s783ms - RowsRead: 8.51M (8510051) - RowsReturned: 8.51M (8510051) - RowsReturnedRate: 5.69 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 1.08K (1076) - ScannerThreadsTotalWallClockTime: 1m1s - MaterializeTupleTime(*): 883.865ms - ScannerThreadsSysTime: 111.982ms - ScannerThreadsUserTime: 7s894ms - ScannerThreadsVoluntaryContextSwitches: 8.11K (8106) - TotalRawHdfsReadTime(*): 114.866ms - TotalReadThroughput: 3.61 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 8.31K (8312) - RowGroups rejected: 0 (0) - RowGroups total: 8.31K (8312) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 8.51M (8510051) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000137 (host=foo.187.48:22000):(Total: 34s238ms, non-child: 29s765ms, % non-child: 86.94%) Hdfs split stats (:<# splits>/): 7:1/41.43 MB 5:1/139.03 MB 6:2/176.69 MB 0:4/451.59 MB 1:3/445.63 MB 4:7/861.56 MB 2:3/397.12 MB 3:7/1.23 GB Filter 4 arrival: 2s159ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 221.40 MB, 223.11 MB, 222.01 MB, 214.35 MB, 214.15 MB, 214.13 MB, 214.55 MB, 214.51 MB, 214.34 MB, 214.34 MB, 214.46 MB, 197.30 MB, 163.21 MB, 163.25 MB, 163.13 MB, 163.18 MB, 159.19 MB, 143.26 MB, 131.35 MB, 119.44 MB, 115.41 MB, 91.34 MB, 83.02 MB, 83.06 MB, 83.05 MB, 53.89 MB, 37.41 MB, 37.34 MB, 15.96 MB, 2.56 MB, 2.56 MB, 2.56 MB ThreadUsage(1s000ms): 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 4, 2, 1, 1, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 223.76 MB (234625299) - PerHostPeakMemUsage: 974.92 MB (1022275188) - RowsProduced: 12.89M (12893401) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25s904ms - TotalStorageWaitTime: 126.036ms - TotalThreadsInvoluntaryContextSwitches: 5.65K (5650) - TotalThreadsTotalWallClockTime: 2m50s - TotalThreadsSysTime: 4s386ms - TotalThreadsUserTime: 42s152ms - TotalThreadsVoluntaryContextSwitches: 370.05K (370048) Fragment Instance Lifecycle Timings: - ExecTime: 34s184ms - ExecTreeExecTime: 2s218ms - OpenTime: 23.599ms - ExecTreeOpenTime: 92.468us - PrepareTime: 29.649ms - ExecTreePrepareTime: 319.149us DataStreamSender (dst_id=20):(Total: 2s215ms, non-child: 2s215ms, % non-child: 100.00%) - BytesSent: 302.76 MB (317466531) - OverallThroughput: 136.64 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.89M (12893401) - SerializeBatchTime: 2s211ms - UncompressedRowBatchSize: 302.76 MB (317466531) CodeGen:(Total: 49.317ms, non-child: 49.317ms, % non-child: 100.00%) - CodegenTime: 993.735us - CompileTime: 6.519ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.220ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.155ms HDFS_SCAN_NODE (id=1):(Total: 2s207ms, non-child: 2s207ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/41.43 MB 5:1/139.03 MB 6:2/176.69 MB 0:4/451.59 MB 1:3/445.63 MB 4:7/861.56 MB 2:3/397.12 MB 3:7/1.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 2s108ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 0, 0, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB, 182.17 MB - FooterProcessingTime: (Avg: 2.760ms ; Min: 2.104ms ; Max: 3.703ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.46 - BytesRead: 182.17 MB (191014267) - BytesReadDataNodeCache: 0 - BytesReadLocal: 182.17 MB (191014267) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 182.17 MB (191014267) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 686.225ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.77 MB (230443362) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.049ms - RowBatchQueuePutWaitTime: 1m26s - RowsRead: 12.89M (12893401) - RowsReturned: 12.89M (12893401) - RowsReturnedRate: 5.84 M/sec - ScanRangesComplete: 28 (28) - ScannerThreadsInvoluntaryContextSwitches: 4.84K (4841) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 1s127ms - ScannerThreadsSysTime: 4s170ms - ScannerThreadsUserTime: 36s908ms - ScannerThreadsVoluntaryContextSwitches: 367.92K (367916) - TotalRawHdfsReadTime(*): 174.327ms - TotalReadThroughput: 5.97 MB/sec Filter 4 (8.00 KB): - Files processed: 28 (28) - Files rejected: 23 (23) - Files total: 28 (28) - RowGroups processed: 12.59K (12593) - RowGroups rejected: 0 (0) - RowGroups total: 12.59K (12593) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 12.89M (12893401) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce180000017f (host=foo.221.17:22000):(Total: 34s195ms, non-child: 30s774ms, % non-child: 90.00%) Hdfs split stats (:<# splits>/): 7:1/254.06 MB 0:3/536.00 MB 2:2/228.30 MB 4:1/10.70 MB 3:3/527.45 MB 1:3/496.19 MB 6:4/657.32 MB 5:5/969.52 MB Filter 4 arrival: 1s749ms MemoryUsage(1s000ms): 581.02 KB, 73.38 MB, 144.71 MB, 144.21 MB, 144.93 MB, 145.29 MB, 143.82 MB, 145.03 MB, 144.11 MB, 145.06 MB, 140.80 MB, 132.48 MB, 128.63 MB, 128.48 MB, 128.55 MB, 120.50 MB, 100.78 MB, 92.92 MB, 88.94 MB, 81.15 MB, 80.97 MB, 81.15 MB, 81.08 MB, 81.09 MB, 81.02 MB, 80.80 MB, 81.13 MB, 69.23 MB, 38.13 MB, 33.66 MB, 29.60 MB, 25.58 MB, 5.72 MB, 2.46 MB ThreadUsage(1s000ms): 1, 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 4.99 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 146.22 MB (153327004) - PerHostPeakMemUsage: 939.05 MB (984662996) - RowsProduced: 8.92M (8921606) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28s363ms - TotalStorageWaitTime: 59.850ms - TotalThreadsInvoluntaryContextSwitches: 9.77K (9769) - TotalThreadsTotalWallClockTime: 2m51s - TotalThreadsSysTime: 23s626ms - TotalThreadsUserTime: 56s280ms - TotalThreadsVoluntaryContextSwitches: 2.51M (2514365) Fragment Instance Lifecycle Timings: - ExecTime: 34s136ms - ExecTreeExecTime: 1s803ms - OpenTime: 25.180ms - ExecTreeOpenTime: 84.539us - PrepareTime: 34.078ms - ExecTreePrepareTime: 504.337us DataStreamSender (dst_id=20):(Total: 1s571ms, non-child: 1s571ms, % non-child: 100.00%) - BytesSent: 210.50 MB (220725873) - OverallThroughput: 133.99 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.92M (8921606) - SerializeBatchTime: 1s568ms - UncompressedRowBatchSize: 210.50 MB (220725873) CodeGen:(Total: 53.992ms, non-child: 53.992ms, % non-child: 100.00%) - CodegenTime: 1.102ms - CompileTime: 6.463ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.658ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.422ms HDFS_SCAN_NODE (id=1):(Total: 1s796ms, non-child: 1s796ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/254.06 MB 0:3/536.00 MB 2:2/228.30 MB 4:1/10.70 MB 3:3/527.45 MB 1:3/496.19 MB 6:4/657.32 MB 5:5/969.52 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s706ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 63.59 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB, 127.19 MB - FooterProcessingTime: (Avg: 2.639ms ; Min: 2.614ms ; Max: 2.663ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.11 - BytesRead: 127.19 MB (133367380) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.19 MB (133367380) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.19 MB (133367380) - CachedFileHandlesHitCount: 23 (23) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 456.579ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 142.15 MB (149050433) - PerReadThreadRawHdfsThroughput: 1.00 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.572ms - RowBatchQueuePutWaitTime: 55s793ms - RowsRead: 8.92M (8921606) - RowsReturned: 8.92M (8921606) - RowsReturnedRate: 4.97 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 9.17K (9166) - ScannerThreadsTotalWallClockTime: 2m16s - MaterializeTupleTime(*): 737.120ms - ScannerThreadsSysTime: 23s473ms - ScannerThreadsUserTime: 52s579ms - ScannerThreadsVoluntaryContextSwitches: 2.51M (2512374) - TotalRawHdfsReadTime(*): 123.869ms - TotalReadThroughput: 3.85 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 8.71K (8714) - RowGroups rejected: 0 (0) - RowGroups total: 8.71K (8714) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 8.92M (8921606) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000146 (host=foo.221.21:22000):(Total: 34s183ms, non-child: 30s838ms, % non-child: 90.21%) Hdfs split stats (:<# splits>/): 5:1/141.13 MB 6:2/447.95 MB 0:3/434.32 MB 3:2/490.09 MB 2:4/764.74 MB 4:3/576.81 MB 1:3/594.77 MB Filter 4 arrival: 1s761ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 136.79 MB, 136.65 MB, 134.98 MB, 135.51 MB, 135.61 MB, 135.80 MB, 135.59 MB, 136.06 MB, 135.59 MB, 135.67 MB, 127.64 MB, 119.96 MB, 119.89 MB, 119.62 MB, 103.75 MB, 103.75 MB, 87.86 MB, 87.91 MB, 87.87 MB, 72.06 MB, 72.07 MB, 72.03 MB, 71.99 MB, 72.14 MB, 72.00 MB, 71.99 MB, 57.25 MB, 34.48 MB, 26.42 MB, 6.07 MB, 3.40 MB, 2.49 MB ThreadUsage(1s000ms): 1, 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 4.96 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 137.23 MB (143891492) - PerHostPeakMemUsage: 923.08 MB (967919672) - RowsProduced: 8.20M (8201132) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28s450ms - TotalStorageWaitTime: 61.614ms - TotalThreadsInvoluntaryContextSwitches: 9.21K (9211) - TotalThreadsTotalWallClockTime: 2m52s - TotalThreadsSysTime: 23s078ms - TotalThreadsUserTime: 58s277ms - TotalThreadsVoluntaryContextSwitches: 1.98M (1984807) Fragment Instance Lifecycle Timings: - ExecTime: 34s127ms - ExecTreeExecTime: 1s820ms - OpenTime: 24.917ms - ExecTreeOpenTime: 87.058us - PrepareTime: 31.820ms - ExecTreePrepareTime: 362.736us DataStreamSender (dst_id=20):(Total: 1s479ms, non-child: 1s479ms, % non-child: 100.00%) - BytesSent: 192.65 MB (202012115) - OverallThroughput: 130.23 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.20M (8201132) - SerializeBatchTime: 1s476ms - UncompressedRowBatchSize: 192.65 MB (202012115) CodeGen:(Total: 53.003ms, non-child: 53.003ms, % non-child: 100.00%) - CodegenTime: 1.312ms - CompileTime: 7.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.930ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.386ms HDFS_SCAN_NODE (id=1):(Total: 1s813ms, non-child: 1s813ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/141.13 MB 6:2/447.95 MB 0:3/434.32 MB 3:2/490.09 MB 2:4/764.74 MB 4:3/576.81 MB 1:3/594.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s726ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:8 BytesRead(1s000ms): 0, 0, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB, 116.97 MB - FooterProcessingTime: (Avg: 2.752ms ; Min: 2.623ms ; Max: 2.882ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.20 - BytesRead: 116.97 MB (122646728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 116.97 MB (122646728) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 116.97 MB (122646728) - CachedFileHandlesHitCount: 20 (20) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 415.619ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 133.15 MB (139614702) - PerReadThreadRawHdfsThroughput: 956.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.357ms - RowBatchQueuePutWaitTime: 54s467ms - RowsRead: 8.20M (8201132) - RowsReturned: 8.20M (8201132) - RowsReturnedRate: 4.52 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 8.66K (8662) - ScannerThreadsTotalWallClockTime: 2m17s - MaterializeTupleTime(*): 672.925ms - ScannerThreadsSysTime: 22s934ms - ScannerThreadsUserTime: 54s820ms - ScannerThreadsVoluntaryContextSwitches: 1.98M (1982994) - TotalRawHdfsReadTime(*): 122.305ms - TotalReadThroughput: 3.60 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 16 (16) - Files total: 18 (18) - RowGroups processed: 8.01K (8010) - RowGroups rejected: 0 (0) - RowGroups total: 8.01K (8010) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 8.20M (8201132) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000126 (host=foo.187.46:22000):(Total: 33s584ms, non-child: 28s631ms, % non-child: 85.25%) Hdfs split stats (:<# splits>/): 1:2/457.73 MB 3:3/530.83 MB 0:2/350.35 MB 2:1/253.96 MB 4:2/451.03 MB 5:3/327.10 MB 6:7/1.07 GB Filter 4 arrival: 2s206ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 237.07 MB, 252.08 MB, 252.93 MB, 252.89 MB, 252.51 MB, 252.24 MB, 252.75 MB, 252.09 MB, 252.50 MB, 252.39 MB, 252.33 MB, 228.43 MB, 220.59 MB, 220.61 MB, 193.15 MB, 177.27 MB, 173.30 MB, 169.37 MB, 157.43 MB, 149.39 MB, 141.45 MB, 125.55 MB, 125.66 MB, 125.64 MB, 125.69 MB, 110.75 MB, 83.98 MB, 68.04 MB, 60.25 MB, 52.26 MB, 28.46 MB ThreadUsage(1s000ms): 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 3 - AverageThreadTokens: 4.64 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 253.95 MB (266286659) - PerHostPeakMemUsage: 1003.60 MB (1052354860) - RowsProduced: 15.10M (15104013) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s883ms - TotalStorageWaitTime: 124.328ms - TotalThreadsInvoluntaryContextSwitches: 3.79K (3789) - TotalThreadsTotalWallClockTime: 2m35s - TotalThreadsSysTime: 2s108ms - TotalThreadsUserTime: 28s442ms - TotalThreadsVoluntaryContextSwitches: 205.32K (205321) Fragment Instance Lifecycle Timings: - ExecTime: 33s522ms - ExecTreeExecTime: 2s278ms - OpenTime: 26.147ms - ExecTreeOpenTime: 68.913us - PrepareTime: 35.800ms - ExecTreePrepareTime: 406.316us DataStreamSender (dst_id=20):(Total: 2s628ms, non-child: 2s628ms, % non-child: 100.00%) - BytesSent: 358.58 MB (376003543) - OverallThroughput: 136.43 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 15.10M (15104013) - SerializeBatchTime: 2s623ms - UncompressedRowBatchSize: 358.58 MB (376003543) CodeGen:(Total: 57.998ms, non-child: 57.998ms, % non-child: 100.00%) - CodegenTime: 1.223ms - CompileTime: 6.818ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.349ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.305ms HDFS_SCAN_NODE (id=1):(Total: 2s266ms, non-child: 2s266ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/457.73 MB 3:3/530.83 MB 0:2/350.35 MB 2:1/253.96 MB 4:2/451.03 MB 5:3/327.10 MB 6:7/1.07 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 2s147ms Hdfs Read Thread Concurrency Bucket: 0:98.48% 1:1.515% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:16 BytesRead(1s000ms): 0, 0, 196.55 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB, 214.92 MB - FooterProcessingTime: (Avg: 2.466ms ; Min: 2.154ms ; Max: 3.380ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 3.70 - BytesRead: 214.92 MB (225363343) - BytesReadDataNodeCache: 0 - BytesReadLocal: 214.92 MB (225363343) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 214.92 MB (225363343) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 775.398ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 249.90 MB (262044375) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.839ms - RowBatchQueuePutWaitTime: 1m37s - RowsRead: 15.10M (15104013) - RowsReturned: 15.10M (15104013) - RowsReturnedRate: 6.66 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 2.88K (2882) - ScannerThreadsTotalWallClockTime: 2m2s - MaterializeTupleTime(*): 1s312ms - ScannerThreadsSysTime: 1s871ms - ScannerThreadsUserTime: 22s262ms - ScannerThreadsVoluntaryContextSwitches: 203.10K (203104) - TotalRawHdfsReadTime(*): 193.008ms - TotalReadThroughput: 6.51 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 16 (16) - Files total: 20 (20) - RowGroups processed: 14.75K (14752) - RowGroups rejected: 0 (0) - RowGroups total: 14.75K (14752) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 15.10M (15104013) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000174 (host=foo.221.48:22000):(Total: 33s252ms, non-child: 30s305ms, % non-child: 91.14%) Hdfs split stats (:<# splits>/): 0:1/218.78 MB 5:1/182.02 MB 1:5/842.20 MB 3:3/521.88 MB 2:2/345.95 MB 7:3/367.86 MB 4:4/474.12 MB 6:3/667.06 MB Filter 4 arrival: 1s458ms MemoryUsage(1s000ms): 581.02 KB, 64.87 MB, 128.40 MB, 128.47 MB, 128.84 MB, 128.15 MB, 128.41 MB, 128.34 MB, 112.99 MB, 112.52 MB, 112.70 MB, 112.95 MB, 112.70 MB, 108.93 MB, 100.90 MB, 96.78 MB, 84.87 MB, 80.92 MB, 62.82 MB, 52.92 MB, 52.75 MB, 52.92 MB, 52.85 MB, 52.78 MB, 52.79 MB, 41.01 MB, 36.96 MB, 36.99 MB, 32.86 MB, 2.56 MB, 2.56 MB, 2.56 MB, 2.56 MB ThreadUsage(1s000ms): 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1 - AverageThreadTokens: 2.67 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 130.22 MB (136548918) - PerHostPeakMemUsage: 840.07 MB (880872675) - RowsProduced: 7.70M (7704438) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s544ms - TotalStorageWaitTime: 81.981ms - TotalThreadsInvoluntaryContextSwitches: 1.99K (1989) - TotalThreadsTotalWallClockTime: 1m28s - TotalThreadsSysTime: 252.960ms - TotalThreadsUserTime: 14s845ms - TotalThreadsVoluntaryContextSwitches: 9.12K (9121) Fragment Instance Lifecycle Timings: - ExecTime: 33s200ms - ExecTreeExecTime: 1s526ms - OpenTime: 24.812ms - ExecTreeOpenTime: 99.720us - PrepareTime: 26.610ms - ExecTreePrepareTime: 307.317us DataStreamSender (dst_id=20):(Total: 1s378ms, non-child: 1s378ms, % non-child: 100.00%) - BytesSent: 178.47 MB (187140578) - OverallThroughput: 129.46 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.70M (7704438) - SerializeBatchTime: 1s375ms - UncompressedRowBatchSize: 178.47 MB (187140578) CodeGen:(Total: 48.043ms, non-child: 48.043ms, % non-child: 100.00%) - CodegenTime: 1.199ms - CompileTime: 6.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.280ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.640ms HDFS_SCAN_NODE (id=1):(Total: 1s520ms, non-child: 1s520ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/218.78 MB 5:1/182.02 MB 1:5/842.20 MB 3:3/521.88 MB 2:2/345.95 MB 7:3/367.86 MB 4:4/474.12 MB 6:3/667.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s425ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB, 107.76 MB - FooterProcessingTime: (Avg: 3.285ms ; Min: 3.285ms ; Max: 3.285ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 107.76 MB (112997316) - BytesReadDataNodeCache: 0 - BytesReadLocal: 107.76 MB (112997316) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 107.76 MB (112997316) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 412.509ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.15 MB (132272769) - PerReadThreadRawHdfsThroughput: 792.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 49.094ms - RowBatchQueuePutWaitTime: 43s477ms - RowsRead: 7.70M (7704438) - RowsReturned: 7.70M (7704438) - RowsReturnedRate: 5.07 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.45K (1450) - ScannerThreadsTotalWallClockTime: 55s205ms - MaterializeTupleTime(*): 668.795ms - ScannerThreadsSysTime: 116.981ms - ScannerThreadsUserTime: 11s613ms - ScannerThreadsVoluntaryContextSwitches: 7.13K (7127) - TotalRawHdfsReadTime(*): 135.958ms - TotalReadThroughput: 3.72 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 7.53K (7525) - RowGroups rejected: 0 (0) - RowGroups total: 7.53K (7525) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.70M (7704438) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000018d (host=foo.221.28:22000):(Total: 33s108ms, non-child: 29s961ms, % non-child: 90.49%) Hdfs split stats (:<# splits>/): 5:6/922.07 MB 2:3/605.27 MB 6:1/103.07 MB 1:2/307.79 MB 7:3/33.61 MB 3:6/1.12 GB 0:2/340.89 MB Filter 4 arrival: 1s692ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 117.09 MB, 116.54 MB, 117.29 MB, 116.65 MB, 117.24 MB, 117.05 MB, 116.46 MB, 117.11 MB, 116.79 MB, 116.71 MB, 105.15 MB, 100.53 MB, 100.84 MB, 100.67 MB, 100.68 MB, 100.98 MB, 81.65 MB, 65.85 MB, 61.53 MB, 57.50 MB, 53.55 MB, 53.52 MB, 53.55 MB, 53.59 MB, 41.74 MB, 37.56 MB, 33.45 MB, 29.66 MB, 17.85 MB, 2.53 MB, 2.53 MB ThreadUsage(1s000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1 - AverageThreadTokens: 2.70 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 118.15 MB (123884719) - PerHostPeakMemUsage: 888.62 MB (931789124) - RowsProduced: 6.73M (6734876) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s236ms - TotalStorageWaitTime: 69.159ms - TotalThreadsInvoluntaryContextSwitches: 2.08K (2082) - TotalThreadsTotalWallClockTime: 1m30s - TotalThreadsSysTime: 224.965ms - TotalThreadsUserTime: 16s234ms - TotalThreadsVoluntaryContextSwitches: 7.94K (7944) Fragment Instance Lifecycle Timings: - ExecTime: 33s052ms - ExecTreeExecTime: 1s738ms - OpenTime: 30.663ms - ExecTreeOpenTime: 104.799us - PrepareTime: 25.385ms - ExecTreePrepareTime: 333.905us DataStreamSender (dst_id=20):(Total: 1s362ms, non-child: 1s362ms, % non-child: 100.00%) - BytesSent: 158.21 MB (165892114) - OverallThroughput: 116.11 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 6.73M (6734876) - SerializeBatchTime: 1s359ms - UncompressedRowBatchSize: 158.21 MB (165892114) CodeGen:(Total: 52.483ms, non-child: 52.483ms, % non-child: 100.00%) - CodegenTime: 1.139ms - CompileTime: 9.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.717ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.358ms HDFS_SCAN_NODE (id=1):(Total: 1s732ms, non-child: 1s732ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:6/922.07 MB 2:3/605.27 MB 6:1/103.07 MB 1:2/307.79 MB 7:3/33.61 MB 3:6/1.12 GB 0:2/340.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s646ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB, 95.94 MB - FooterProcessingTime: (Avg: 3.471ms ; Min: 3.449ms ; Max: 3.492ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.84 - BytesRead: 95.94 MB (100600489) - BytesReadDataNodeCache: 0 - BytesReadLocal: 95.94 MB (100600489) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 95.94 MB (100600489) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 356.529ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 114.15 MB (119689820) - PerReadThreadRawHdfsThroughput: 777.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.604ms - RowBatchQueuePutWaitTime: 44s161ms - RowsRead: 6.73M (6734876) - RowsReturned: 6.73M (6734876) - RowsReturnedRate: 3.89 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 1.53K (1530) - ScannerThreadsTotalWallClockTime: 57s337ms - MaterializeTupleTime(*): 620.176ms - ScannerThreadsSysTime: 58.990ms - ScannerThreadsUserTime: 13s096ms - ScannerThreadsVoluntaryContextSwitches: 6.15K (6150) - TotalRawHdfsReadTime(*): 123.365ms - TotalReadThroughput: 3.09 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 21 (21) - Files total: 23 (23) - RowGroups processed: 6.58K (6578) - RowGroups rejected: 0 (0) - RowGroups total: 6.58K (6578) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 6.73M (6734876) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000168 (host=foo.232.40:22000):(Total: 33s107ms, non-child: 30s497ms, % non-child: 92.12%) Hdfs split stats (:<# splits>/): 5:3/192.45 MB 4:2/431.39 MB 7:3/477.52 MB 1:2/507.85 MB 0:5/392.48 MB 6:3/690.47 MB 2:3/531.70 MB 3:3/214.86 MB Filter 4 arrival: 709ms MemoryUsage(1s000ms): 581.02 KB, 167.82 MB, 168.40 MB, 169.06 MB, 168.55 MB, 168.85 MB, 168.76 MB, 168.63 MB, 146.10 MB, 146.09 MB, 138.38 MB, 130.23 MB, 130.28 MB, 130.26 MB, 130.13 MB, 130.32 MB, 130.29 MB, 118.21 MB, 114.26 MB, 106.34 MB, 98.25 MB, 98.27 MB, 82.63 MB, 82.52 MB, 82.49 MB, 82.58 MB, 82.51 MB, 82.57 MB, 82.61 MB, 41.37 MB, 36.96 MB, 17.99 MB, 2.52 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1 - AverageThreadTokens: 3.77 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 170.10 MB (178363903) - PerHostPeakMemUsage: 891.02 MB (934297678) - RowsProduced: 10.07M (10071292) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s401ms - TotalStorageWaitTime: 89.702ms - TotalThreadsInvoluntaryContextSwitches: 3.82K (3816) - TotalThreadsTotalWallClockTime: 2m5s - TotalThreadsSysTime: 822.872ms - TotalThreadsUserTime: 31s444ms - TotalThreadsVoluntaryContextSwitches: 65.93K (65928) Fragment Instance Lifecycle Timings: - ExecTime: 33s047ms - ExecTreeExecTime: 757.180ms - OpenTime: 27.170ms - ExecTreeOpenTime: 130.732us - PrepareTime: 32.819ms - ExecTreePrepareTime: 291.805us DataStreamSender (dst_id=20):(Total: 1s804ms, non-child: 1s804ms, % non-child: 100.00%) - BytesSent: 235.75 MB (247202113) - OverallThroughput: 130.63 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.07M (10071292) - SerializeBatchTime: 1s800ms - UncompressedRowBatchSize: 235.75 MB (247202113) CodeGen:(Total: 56.137ms, non-child: 56.137ms, % non-child: 100.00%) - CodegenTime: 2.164ms - CompileTime: 7.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.535ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.547ms HDFS_SCAN_NODE (id=1):(Total: 748.626ms, non-child: 748.626ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:3/192.45 MB 4:2/431.39 MB 7:3/477.52 MB 1:2/507.85 MB 0:5/392.48 MB 6:3/690.47 MB 2:3/531.70 MB 3:3/214.86 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 663ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:12 BytesRead(1s000ms): 0, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB, 141.73 MB - FooterProcessingTime: (Avg: 2.944ms ; Min: 2.880ms ; Max: 3.033ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.86 - BytesRead: 141.73 MB (148618412) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.73 MB (148618412) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.73 MB (148618412) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 509.581ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 166.01 MB (174077352) - PerReadThreadRawHdfsThroughput: 870.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.562ms - RowBatchQueuePutWaitTime: 1m4s - RowsRead: 10.07M (10071292) - RowsReturned: 10.07M (10071292) - RowsReturnedRate: 13.45 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.12K (3115) - ScannerThreadsTotalWallClockTime: 1m32s - MaterializeTupleTime(*): 909.779ms - ScannerThreadsSysTime: 663.897ms - ScannerThreadsUserTime: 27s173ms - ScannerThreadsVoluntaryContextSwitches: 63.89K (63889) - TotalRawHdfsReadTime(*): 162.846ms - TotalReadThroughput: 4.43 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 21 (21) - Files total: 24 (24) - RowGroups processed: 9.84K (9837) - RowGroups rejected: 0 (0) - RowGroups total: 9.84K (9837) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 10.07M (10071292) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000183 (host=foo.232.39:22000):(Total: 33s037ms, non-child: 30s503ms, % non-child: 92.33%) Hdfs split stats (:<# splits>/): 6:2/215.85 MB 7:2/343.80 MB 5:2/245.40 MB 3:2/266.72 MB 1:2/306.71 MB 2:3/366.25 MB 0:4/926.22 MB 4:4/676.51 MB Filter 4 arrival: 788ms MemoryUsage(1s000ms): 44.84 MB, 152.51 MB, 153.26 MB, 153.04 MB, 152.99 MB, 152.61 MB, 152.76 MB, 152.37 MB, 152.76 MB, 152.45 MB, 152.38 MB, 152.29 MB, 152.56 MB, 152.49 MB, 152.50 MB, 148.36 MB, 119.15 MB, 108.61 MB, 108.54 MB, 108.77 MB, 108.78 MB, 92.83 MB, 80.96 MB, 76.87 MB, 67.71 MB, 49.41 MB, 49.40 MB, 49.39 MB, 41.65 MB, 33.48 MB, 29.57 MB, 16.61 MB, 3.37 MB ThreadUsage(1s000ms): 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 1 - AverageThreadTokens: 3.82 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 154.10 MB (161589569) - PerHostPeakMemUsage: 879.48 MB (922198025) - RowsProduced: 8.78M (8783750) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s936ms - TotalStorageWaitTime: 81.648ms - TotalThreadsInvoluntaryContextSwitches: 3.27K (3268) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 2s947ms - TotalThreadsUserTime: 24s214ms - TotalThreadsVoluntaryContextSwitches: 244.85K (244854) Fragment Instance Lifecycle Timings: - ExecTime: 32s980ms - ExecTreeExecTime: 836.616ms - OpenTime: 24.598ms - ExecTreeOpenTime: 80.290us - PrepareTime: 31.548ms - ExecTreePrepareTime: 303.166us DataStreamSender (dst_id=20):(Total: 1s650ms, non-child: 1s650ms, % non-child: 100.00%) - BytesSent: 207.47 MB (217545392) - OverallThroughput: 125.67 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.78M (8783750) - SerializeBatchTime: 1s647ms - UncompressedRowBatchSize: 207.47 MB (217545392) CodeGen:(Total: 53.408ms, non-child: 53.408ms, % non-child: 100.00%) - CodegenTime: 1.073ms - CompileTime: 6.704ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.044ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.181ms HDFS_SCAN_NODE (id=1):(Total: 828.999ms, non-child: 828.999ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/215.85 MB 7:2/343.80 MB 5:2/245.40 MB 3:2/266.72 MB 1:2/306.71 MB 2:3/366.25 MB 0:4/926.22 MB 4:4/676.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 743ms Hdfs Read Thread Concurrency Bucket: 0:98.46% 1:0% 2:1.538% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:12 BytesRead(1s000ms): 29.55 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB, 126.31 MB - FooterProcessingTime: (Avg: 2.676ms ; Min: 2.615ms ; Max: 2.753ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.86 - BytesRead: 126.31 MB (132443385) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.31 MB (132443385) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.31 MB (132443385) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 459.195ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 150.03 MB (157314819) - PerReadThreadRawHdfsThroughput: 889.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.048ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 8.78M (8783750) - RowsReturned: 8.78M (8783750) - RowsReturnedRate: 10.60 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 2.63K (2630) - ScannerThreadsTotalWallClockTime: 1m33s - MaterializeTupleTime(*): 763.372ms - ScannerThreadsSysTime: 2s780ms - ScannerThreadsUserTime: 20s391ms - ScannerThreadsVoluntaryContextSwitches: 242.91K (242906) - TotalRawHdfsReadTime(*): 142.009ms - TotalReadThroughput: 3.89 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 8.58K (8579) - RowGroups rejected: 0 (0) - RowGroups total: 8.58K (8579) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.78M (8783750) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000124 (host=foo.187.43:22000):(Total: 32s169ms, non-child: 27s657ms, % non-child: 85.98%) Hdfs split stats (:<# splits>/): 2:2/391.42 MB 5:4/715.21 MB 7:1/56.38 MB 4:3/424.93 MB 1:2/342.35 MB 6:3/497.70 MB 0:5/652.36 MB 3:3/428.37 MB Filter 4 arrival: 2s212ms MemoryUsage(1s000ms): 581.02 KB, 581.02 KB, 110.48 MB, 220.77 MB, 219.89 MB, 219.46 MB, 219.90 MB, 219.78 MB, 219.92 MB, 219.97 MB, 219.84 MB, 220.01 MB, 219.66 MB, 201.80 MB, 201.45 MB, 201.31 MB, 193.49 MB, 177.55 MB, 169.60 MB, 169.65 MB, 158.77 MB, 126.68 MB, 110.97 MB, 102.92 MB, 94.88 MB, 78.93 MB, 78.91 MB, 53.87 MB, 45.45 MB, 37.36 MB, 16.01 MB, 2.50 MB ThreadUsage(1s000ms): 1, 1, 3, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 3, 1 - AverageThreadTokens: 5.23 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 221.23 MB (231980138) - PerHostPeakMemUsage: 1007.38 MB (1056316029) - RowsProduced: 12.33M (12332433) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s216ms - TotalStorageWaitTime: 147.640ms - TotalThreadsInvoluntaryContextSwitches: 5.12K (5124) - TotalThreadsTotalWallClockTime: 2m48s - TotalThreadsSysTime: 8s933ms - TotalThreadsUserTime: 32s657ms - TotalThreadsVoluntaryContextSwitches: 848.74K (848740) Fragment Instance Lifecycle Timings: - ExecTime: 32s102ms - ExecTreeExecTime: 2s297ms - OpenTime: 25.874ms - ExecTreeOpenTime: 87.765us - PrepareTime: 40.912ms - ExecTreePrepareTime: 316.304us DataStreamSender (dst_id=20):(Total: 2s168ms, non-child: 2s168ms, % non-child: 100.00%) - BytesSent: 292.17 MB (306360478) - OverallThroughput: 134.74 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.33M (12332433) - SerializeBatchTime: 2s163ms - UncompressedRowBatchSize: 292.17 MB (306360478) CodeGen:(Total: 55.360ms, non-child: 55.360ms, % non-child: 100.00%) - CodegenTime: 1.198ms - CompileTime: 6.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.796ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.930ms HDFS_SCAN_NODE (id=1):(Total: 2s287ms, non-child: 2s287ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/391.42 MB 5:4/715.21 MB 7:1/56.38 MB 4:3/424.93 MB 1:2/342.35 MB 6:3/497.70 MB 0:5/652.36 MB 3:3/428.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 2s170ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 0, 0, 0, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB, 177.08 MB - FooterProcessingTime: (Avg: 5.656ms ; Min: 2.641ms ; Max: 10.066ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 177.08 MB (185677560) - BytesReadDataNodeCache: 0 - BytesReadLocal: 177.08 MB (185677560) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 177.08 MB (185677560) - CachedFileHandlesHitCount: 38 (38) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 618.372ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 217.27 MB (227824822) - PerReadThreadRawHdfsThroughput: 805.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.423ms - RowBatchQueuePutWaitTime: 1m38s - RowsRead: 12.33M (12332433) - RowsReturned: 12.33M (12332433) - RowsReturnedRate: 5.39 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 4.27K (4273) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 1s066ms - ScannerThreadsSysTime: 8s729ms - ScannerThreadsUserTime: 27s532ms - ScannerThreadsVoluntaryContextSwitches: 846.54K (846541) - TotalRawHdfsReadTime(*): 219.792ms - TotalReadThroughput: 5.81 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 18 (18) - Files total: 23 (23) - RowGroups processed: 12.04K (12045) - RowGroups rejected: 0 (0) - RowGroups total: 12.04K (12045) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 12.33M (12332433) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000114 (host=foo.232.28:22000):(Total: 32s161ms, non-child: 29s330ms, % non-child: 91.20%) Hdfs split stats (:<# splits>/): 5:2/323.75 MB 0:5/591.51 MB 6:3/606.05 MB 1:1/253.93 MB 3:4/614.67 MB 4:2/293.22 MB 7:5/544.16 MB 2:2/333.73 MB Filter 4 arrival: 1s031ms MemoryUsage(1s000ms): 581.02 KB, 114.94 MB, 158.09 MB, 157.53 MB, 158.21 MB, 158.61 MB, 157.95 MB, 158.20 MB, 158.15 MB, 157.83 MB, 158.45 MB, 158.02 MB, 158.25 MB, 146.34 MB, 134.43 MB, 134.22 MB, 124.17 MB, 112.61 MB, 112.65 MB, 100.67 MB, 96.71 MB, 81.18 MB, 80.79 MB, 67.84 MB, 53.41 MB, 53.41 MB, 53.40 MB, 49.36 MB, 37.21 MB, 33.51 MB, 4.80 MB, 2.59 MB ThreadUsage(1s000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 3.68 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 159.70 MB (167462489) - PerHostPeakMemUsage: 946.65 MB (992638956) - RowsProduced: 9.00M (8996028) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26s461ms - TotalStorageWaitTime: 113.217ms - TotalThreadsInvoluntaryContextSwitches: 3.15K (3155) - TotalThreadsTotalWallClockTime: 1m58s - TotalThreadsSysTime: 978.850ms - TotalThreadsUserTime: 24s450ms - TotalThreadsVoluntaryContextSwitches: 101.62K (101622) Fragment Instance Lifecycle Timings: - ExecTime: 32s103ms - ExecTreeExecTime: 1s085ms - OpenTime: 26.578ms - ExecTreeOpenTime: 70.570us - PrepareTime: 31.327ms - ExecTreePrepareTime: 388.307us DataStreamSender (dst_id=20):(Total: 1s698ms, non-child: 1s698ms, % non-child: 100.00%) - BytesSent: 212.90 MB (223243745) - OverallThroughput: 125.35 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.00M (8996028) - SerializeBatchTime: 1s694ms - UncompressedRowBatchSize: 212.90 MB (223243745) CodeGen:(Total: 54.537ms, non-child: 54.537ms, % non-child: 100.00%) - CodegenTime: 1.228ms - CompileTime: 8.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.696ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.261ms HDFS_SCAN_NODE (id=1):(Total: 1s078ms, non-child: 1s078ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/323.75 MB 0:5/591.51 MB 6:3/606.05 MB 1:1/253.93 MB 3:4/614.67 MB 4:2/293.22 MB 7:5/544.16 MB 2:2/333.73 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 983ms Hdfs Read Thread Concurrency Bucket: 0:98.36% 1:0% 2:0% 3:1.639% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 0, 36.26 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB, 129.80 MB - FooterProcessingTime: (Avg: 2.562ms ; Min: 2.091ms ; Max: 2.891ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 2.85 - BytesRead: 129.80 MB (136101540) - BytesReadDataNodeCache: 0 - BytesReadLocal: 129.80 MB (136101540) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 129.80 MB (136101540) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 482.046ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 155.65 MB (163210681) - PerReadThreadRawHdfsThroughput: 782.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.261ms - RowBatchQueuePutWaitTime: 1m5s - RowsRead: 9.00M (8996028) - RowsReturned: 9.00M (8996028) - RowsReturnedRate: 8.34 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.51K (2507) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 804.634ms - ScannerThreadsSysTime: 826.873ms - ScannerThreadsUserTime: 20s396ms - ScannerThreadsVoluntaryContextSwitches: 99.71K (99710) - TotalRawHdfsReadTime(*): 165.955ms - TotalReadThroughput: 4.26 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 21 (21) - Files total: 24 (24) - RowGroups processed: 8.79K (8787) - RowGroups rejected: 0 (0) - RowGroups total: 8.79K (8787) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 9.00M (8996028) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000151 (host=foo.221.38:22000):(Total: 31s190ms, non-child: 28s075ms, % non-child: 90.01%) Hdfs split stats (:<# splits>/): 1:1/232.10 MB 2:2/282.76 MB 7:3/365.90 MB 3:4/426.52 MB 6:5/954.38 MB 5:4/201.50 MB 4:4/614.59 MB 0:3/526.91 MB Filter 4 arrival: 1s561ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 128.86 MB, 127.82 MB, 129.89 MB, 128.85 MB, 128.87 MB, 129.47 MB, 129.21 MB, 129.32 MB, 129.02 MB, 128.11 MB, 128.51 MB, 128.73 MB, 129.01 MB, 128.26 MB, 129.17 MB, 128.47 MB, 120.69 MB, 112.81 MB, 112.88 MB, 112.42 MB, 112.52 MB, 112.91 MB, 112.93 MB, 112.64 MB, 112.42 MB, 104.64 MB, 104.64 MB, 104.80 MB, 104.67 MB, 96.55 MB, 96.75 MB, 88.70 MB, 88.76 MB, 80.83 MB, 80.93 MB, 81.11 MB, 80.93 MB, 73.05 MB, 72.72 MB, 64.95 MB, 64.92 MB, 64.81 MB, 49.34 MB, 49.62 MB, 49.33 MB, 49.43 MB, 49.43 MB, 49.54 MB, 41.57 MB, 41.56 MB, 41.56 MB, 33.58 MB, 33.51 MB, 25.42 MB, 6.89 MB, 2.53 MB, 2.53 MB, 2.53 MB, 2.53 MB ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.74 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 130.21 MB (136532398) - PerHostPeakMemUsage: 855.92 MB (897501936) - RowsProduced: 7.77M (7766724) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s932ms - TotalStorageWaitTime: 63.375ms - TotalThreadsInvoluntaryContextSwitches: 1.54K (1538) - TotalThreadsTotalWallClockTime: 1m25s - TotalThreadsSysTime: 198.968ms - TotalThreadsUserTime: 11s102ms - TotalThreadsVoluntaryContextSwitches: 9.08K (9081) Fragment Instance Lifecycle Timings: - ExecTime: 31s134ms - ExecTreeExecTime: 1s616ms - OpenTime: 27.149ms - ExecTreeOpenTime: 109.283us - PrepareTime: 28.622ms - ExecTreePrepareTime: 403.526us DataStreamSender (dst_id=20):(Total: 1s452ms, non-child: 1s452ms, % non-child: 100.00%) - BytesSent: 181.27 MB (190073382) - OverallThroughput: 124.77 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.77M (7766724) - SerializeBatchTime: 1s449ms - UncompressedRowBatchSize: 181.27 MB (190073382) CodeGen:(Total: 52.109ms, non-child: 52.109ms, % non-child: 100.00%) - CodegenTime: 1.441ms - CompileTime: 8.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.655ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.866ms HDFS_SCAN_NODE (id=1):(Total: 1s609ms, non-child: 1s609ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/232.10 MB 2:2/282.76 MB 7:3/365.90 MB 3:4/426.52 MB 6:5/954.38 MB 5:4/201.50 MB 4:4/614.59 MB 0:3/526.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s526ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:24 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB, 110.10 MB - FooterProcessingTime: (Avg: 3.154ms ; Min: 3.072ms ; Max: 3.236ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 110.10 MB (115453227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 110.10 MB (115453227) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 110.10 MB (115453227) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 408.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 126.15 MB (132274419) - PerReadThreadRawHdfsThroughput: 911.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.183ms - RowBatchQueuePutWaitTime: 46s609ms - RowsRead: 7.77M (7766724) - RowsReturned: 7.77M (7766724) - RowsReturnedRate: 4.83 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 984 (984) - ScannerThreadsTotalWallClockTime: 54s305ms - MaterializeTupleTime(*): 676.146ms - ScannerThreadsSysTime: 48.991ms - ScannerThreadsUserTime: 7s663ms - ScannerThreadsVoluntaryContextSwitches: 7.21K (7211) - TotalRawHdfsReadTime(*): 120.841ms - TotalReadThroughput: 3.80 MB/sec Filter 4 (8.00 KB): - Files processed: 26 (26) - Files rejected: 24 (24) - Files total: 26 (26) - RowGroups processed: 7.58K (7585) - RowGroups rejected: 0 (0) - RowGroups total: 7.58K (7585) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.77M (7766724) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000014a (host=foo.232.31:22000):(Total: 31s142ms, non-child: 28s275ms, % non-child: 90.79%) Hdfs split stats (:<# splits>/): 1:1/222.93 MB 4:2/196.92 MB 2:3/604.30 MB 3:2/316.66 MB 5:5/842.94 MB 7:3/370.09 MB 6:5/739.67 MB 0:1/132.42 MB Filter 4 arrival: 977ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 160.78 MB, 159.31 MB, 159.91 MB, 160.00 MB, 159.88 MB, 159.21 MB, 159.17 MB, 159.08 MB, 159.13 MB, 160.12 MB, 160.04 MB, 159.60 MB, 159.89 MB, 159.34 MB, 159.41 MB, 159.85 MB, 143.95 MB, 143.99 MB, 143.65 MB, 143.65 MB, 143.92 MB, 143.76 MB, 143.73 MB, 143.65 MB, 135.60 MB, 127.71 MB, 127.93 MB, 127.62 MB, 119.82 MB, 119.63 MB, 111.83 MB, 111.93 MB, 111.85 MB, 111.97 MB, 111.88 MB, 111.96 MB, 96.02 MB, 96.15 MB, 96.20 MB, 96.15 MB, 96.11 MB, 96.13 MB, 95.92 MB, 95.90 MB, 95.75 MB, 95.93 MB, 96.10 MB, 96.15 MB, 95.97 MB, 88.04 MB, 88.04 MB, 72.01 MB, 64.13 MB, 64.01 MB, 64.06 MB, 56.06 MB, 56.15 MB, 48.19 MB, 48.07 MB, 5.70 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.90 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 161.23 MB (169057148) - PerHostPeakMemUsage: 950.68 MB (996856871) - RowsProduced: 9.51M (9506664) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25s776ms - TotalStorageWaitTime: 75.178ms - TotalThreadsInvoluntaryContextSwitches: 1.03K (1031) - TotalThreadsTotalWallClockTime: 1m30s - TotalThreadsSysTime: 244.962ms - TotalThreadsUserTime: 6s115ms - TotalThreadsVoluntaryContextSwitches: 10.80K (10797) Fragment Instance Lifecycle Timings: - ExecTime: 31s077ms - ExecTreeExecTime: 1s034ms - OpenTime: 27.546ms - ExecTreeOpenTime: 92.587us - PrepareTime: 37.775ms - ExecTreePrepareTime: 289.135us DataStreamSender (dst_id=20):(Total: 1s779ms, non-child: 1s779ms, % non-child: 100.00%) - BytesSent: 224.78 MB (235694785) - OverallThroughput: 126.31 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.51M (9506664) - SerializeBatchTime: 1s776ms - UncompressedRowBatchSize: 224.78 MB (235694785) CodeGen:(Total: 61.334ms, non-child: 61.334ms, % non-child: 100.00%) - CodegenTime: 2.428ms - CompileTime: 7.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.198ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.617ms HDFS_SCAN_NODE (id=1):(Total: 1s026ms, non-child: 1s026ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/222.93 MB 4:2/196.92 MB 2:3/604.30 MB 3:2/316.66 MB 5:5/842.94 MB 7:3/370.09 MB 6:5/739.67 MB 0:1/132.42 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 924ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB, 136.00 MB - FooterProcessingTime: (Avg: 3.003ms ; Min: 2.942ms ; Max: 3.064ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 136.00 MB (142601190) - BytesReadDataNodeCache: 0 - BytesReadLocal: 136.00 MB (142601190) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 136.00 MB (142601190) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 513.222ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 157.15 MB (164779767) - PerReadThreadRawHdfsThroughput: 900.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.910ms - RowBatchQueuePutWaitTime: 57s603ms - RowsRead: 9.51M (9506664) - RowsReturned: 9.51M (9506664) - RowsReturnedRate: 9.26 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 370 (370) - ScannerThreadsTotalWallClockTime: 59s622ms - MaterializeTupleTime(*): 855.720ms - ScannerThreadsSysTime: 71.988ms - ScannerThreadsUserTime: 1s989ms - ScannerThreadsVoluntaryContextSwitches: 9.15K (9147) - TotalRawHdfsReadTime(*): 151.046ms - TotalReadThroughput: 4.39 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 9.29K (9285) - RowGroups rejected: 0 (0) - RowGroups total: 9.29K (9285) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.51M (9506664) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000153 (host=foo.221.19:22000):(Total: 30s912ms, non-child: 27s613ms, % non-child: 89.33%) Hdfs split stats (:<# splits>/): 1:1/253.70 MB 0:5/1.16 GB 5:4/765.18 MB 7:3/230.02 MB 6:2/226.75 MB 3:1/130.42 MB 4:4/668.91 MB Filter 4 arrival: 1s757ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 135.31 MB, 135.78 MB, 135.48 MB, 134.29 MB, 135.16 MB, 135.00 MB, 134.12 MB, 134.19 MB, 135.05 MB, 134.30 MB, 134.37 MB, 134.84 MB, 134.63 MB, 118.54 MB, 119.07 MB, 118.91 MB, 118.60 MB, 118.56 MB, 118.69 MB, 118.78 MB, 118.72 MB, 118.92 MB, 110.70 MB, 102.84 MB, 102.63 MB, 86.89 MB, 86.89 MB, 87.09 MB, 86.70 MB, 86.78 MB, 86.90 MB, 86.94 MB, 87.08 MB, 71.10 MB, 71.07 MB, 71.11 MB, 70.93 MB, 70.87 MB, 71.12 MB, 71.05 MB, 71.11 MB, 49.50 MB, 49.42 MB, 49.38 MB, 49.49 MB, 49.38 MB, 33.43 MB, 33.46 MB, 25.59 MB, 25.69 MB, 6.14 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB, 2.48 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.10 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 136.23 MB (142843408) - PerHostPeakMemUsage: 733.80 MB (769443216) - RowsProduced: 7.99M (7989761) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s677ms - TotalStorageWaitTime: 61.535ms - TotalThreadsInvoluntaryContextSwitches: 9.09K (9087) - TotalThreadsTotalWallClockTime: 2m39s - TotalThreadsSysTime: 26s659ms - TotalThreadsUserTime: 51s438ms - TotalThreadsVoluntaryContextSwitches: 2.60M (2599658) Fragment Instance Lifecycle Timings: - ExecTime: 30s851ms - ExecTreeExecTime: 1s793ms - OpenTime: 27.399ms - ExecTreeOpenTime: 104.077us - PrepareTime: 33.063ms - ExecTreePrepareTime: 354.080us DataStreamSender (dst_id=20):(Total: 1s454ms, non-child: 1s454ms, % non-child: 100.00%) - BytesSent: 188.91 MB (198084929) - OverallThroughput: 129.90 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.99M (7989761) - SerializeBatchTime: 1s451ms - UncompressedRowBatchSize: 188.91 MB (198084929) CodeGen:(Total: 57.199ms, non-child: 57.199ms, % non-child: 100.00%) - CodegenTime: 1.353ms - CompileTime: 7.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.997ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.066ms HDFS_SCAN_NODE (id=1):(Total: 1s786ms, non-child: 1s786ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.70 MB 0:5/1.16 GB 5:4/765.18 MB 7:3/230.02 MB 6:2/226.75 MB 3:1/130.42 MB 4:4/668.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s705ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB, 115.68 MB - FooterProcessingTime: (Avg: 3.354ms ; Min: 3.332ms ; Max: 3.377ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.62 - BytesRead: 115.68 MB (121300581) - BytesReadDataNodeCache: 0 - BytesReadLocal: 115.68 MB (121300581) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 115.68 MB (121300581) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 401.619ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.15 MB (138566008) - PerReadThreadRawHdfsThroughput: 890.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.723ms - RowBatchQueuePutWaitTime: 44s675ms - RowsRead: 7.99M (7989761) - RowsReturned: 7.99M (7989761) - RowsReturnedRate: 4.47 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 8.51K (8505) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 662.078ms - ScannerThreadsSysTime: 26s508ms - ScannerThreadsUserTime: 48s028ms - ScannerThreadsVoluntaryContextSwitches: 2.60M (2597937) - TotalRawHdfsReadTime(*): 129.874ms - TotalReadThroughput: 4.21 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 7.80K (7803) - RowGroups rejected: 0 (0) - RowGroups total: 7.80K (7803) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.99M (7989761) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000116 (host=foo.221.39:22000):(Total: 30s621ms, non-child: 27s678ms, % non-child: 90.39%) Hdfs split stats (:<# splits>/): 3:2/280.53 MB 7:1/233.18 MB 2:1/253.99 MB 5:3/250.90 MB 6:4/892.84 MB 4:1/224.38 MB 1:4/975.36 MB 0:3/468.77 MB Filter 4 arrival: 1s550ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 113.23 MB, 112.95 MB, 112.29 MB, 113.72 MB, 113.32 MB, 112.04 MB, 113.60 MB, 112.26 MB, 112.65 MB, 113.37 MB, 112.17 MB, 113.54 MB, 112.76 MB, 112.69 MB, 112.22 MB, 112.62 MB, 112.35 MB, 112.83 MB, 113.06 MB, 96.96 MB, 96.66 MB, 96.80 MB, 97.04 MB, 96.84 MB, 96.79 MB, 96.55 MB, 97.08 MB, 96.62 MB, 96.49 MB, 65.52 MB, 65.09 MB, 57.24 MB, 57.26 MB, 49.61 MB, 49.80 MB, 49.57 MB, 49.58 MB, 49.60 MB, 49.55 MB, 49.69 MB, 49.68 MB, 41.63 MB, 41.54 MB, 41.44 MB, 33.44 MB, 33.64 MB, 33.37 MB, 25.69 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.57 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 114.35 MB (119905092) - PerHostPeakMemUsage: 883.11 MB (926005977) - RowsProduced: 6.71M (6711218) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s341ms - TotalStorageWaitTime: 59.948ms - TotalThreadsInvoluntaryContextSwitches: 1.72K (1719) - TotalThreadsTotalWallClockTime: 1m18s - TotalThreadsSysTime: 224.963ms - TotalThreadsUserTime: 13s422ms - TotalThreadsVoluntaryContextSwitches: 7.91K (7907) Fragment Instance Lifecycle Timings: - ExecTime: 30s571ms - ExecTreeExecTime: 1s592ms - OpenTime: 25.917ms - ExecTreeOpenTime: 113.099us - PrepareTime: 23.855ms - ExecTreePrepareTime: 204.368us DataStreamSender (dst_id=20):(Total: 1s310ms, non-child: 1s310ms, % non-child: 100.00%) - BytesSent: 157.99 MB (165660656) - OverallThroughput: 120.56 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 6.71M (6711218) - SerializeBatchTime: 1s308ms - UncompressedRowBatchSize: 157.99 MB (165660656) CodeGen:(Total: 46.752ms, non-child: 46.752ms, % non-child: 100.00%) - CodegenTime: 1.593ms - CompileTime: 6.583ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.052ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.420ms HDFS_SCAN_NODE (id=1):(Total: 1s585ms, non-child: 1s585ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/280.53 MB 7:1/233.18 MB 2:1/253.99 MB 5:3/250.90 MB 6:4/892.84 MB 4:1/224.38 MB 1:4/975.36 MB 0:3/468.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s505ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB, 96.09 MB - FooterProcessingTime: (Avg: 3.223ms ; Min: 3.219ms ; Max: 3.226ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.88 - BytesRead: 96.09 MB (100758265) - BytesReadDataNodeCache: 0 - BytesReadLocal: 96.09 MB (100758265) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 96.09 MB (100758265) - CachedFileHandlesHitCount: 19 (19) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 350.674ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 110.27 MB (115626881) - PerReadThreadRawHdfsThroughput: 892.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.175ms - RowBatchQueuePutWaitTime: 37s281ms - RowsRead: 6.71M (6711218) - RowsReturned: 6.71M (6711218) - RowsReturnedRate: 4.23 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1235) - ScannerThreadsTotalWallClockTime: 47s715ms - MaterializeTupleTime(*): 598.478ms - ScannerThreadsSysTime: 46.991ms - ScannerThreadsUserTime: 10s386ms - ScannerThreadsVoluntaryContextSwitches: 6.14K (6145) - TotalRawHdfsReadTime(*): 107.690ms - TotalReadThroughput: 3.77 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 17 (17) - Files total: 19 (19) - RowGroups processed: 6.55K (6555) - RowGroups rejected: 0 (0) - RowGroups total: 6.55K (6555) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 6.71M (6711218) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000014b (host=foo.221.27:22000):(Total: 30s603ms, non-child: 27s376ms, % non-child: 89.45%) Hdfs split stats (:<# splits>/): 6:2/258.60 MB 3:3/365.61 MB 4:3/572.29 MB 1:3/259.71 MB 2:2/276.37 MB 7:2/298.19 MB 5:2/467.31 MB 0:4/899.45 MB Filter 4 arrival: 1s743ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 140.84 MB, 140.95 MB, 140.16 MB, 141.71 MB, 140.14 MB, 141.51 MB, 140.37 MB, 141.15 MB, 131.34 MB, 131.51 MB, 130.57 MB, 131.03 MB, 131.20 MB, 131.17 MB, 131.05 MB, 131.32 MB, 130.88 MB, 130.90 MB, 113.82 MB, 112.75 MB, 112.54 MB, 112.76 MB, 112.92 MB, 112.87 MB, 112.94 MB, 112.81 MB, 112.83 MB, 112.58 MB, 112.59 MB, 96.95 MB, 96.65 MB, 96.79 MB, 96.79 MB, 96.67 MB, 74.33 MB, 74.40 MB, 65.32 MB, 57.38 MB, 49.60 MB, 49.45 MB, 49.41 MB, 49.58 MB, 49.48 MB, 49.52 MB, 49.50 MB, 49.55 MB, 49.46 MB, 33.68 MB, 33.63 MB, 33.54 MB, 33.53 MB, 25.74 MB, 25.63 MB, 2.55 MB, 2.55 MB, 2.55 MB, 2.55 MB, 2.55 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.36 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 142.41 MB (149326721) - PerHostPeakMemUsage: 741.16 MB (777163957) - RowsProduced: 7.85M (7853595) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s827ms - TotalStorageWaitTime: 92.301ms - TotalThreadsInvoluntaryContextSwitches: 8.56K (8563) - TotalThreadsTotalWallClockTime: 2m42s - TotalThreadsSysTime: 23s891ms - TotalThreadsUserTime: 47s758ms - TotalThreadsVoluntaryContextSwitches: 2.98M (2976957) Fragment Instance Lifecycle Timings: - ExecTime: 30s537ms - ExecTreeExecTime: 1s762ms - OpenTime: 26.016ms - ExecTreeOpenTime: 83.832us - PrepareTime: 39.726ms - ExecTreePrepareTime: 403.644us DataStreamSender (dst_id=20):(Total: 1s416ms, non-child: 1s416ms, % non-child: 100.00%) - BytesSent: 184.71 MB (193683442) - OverallThroughput: 130.40 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.85M (7853595) - SerializeBatchTime: 1s413ms - UncompressedRowBatchSize: 184.71 MB (193683442) CodeGen:(Total: 54.005ms, non-child: 54.005ms, % non-child: 100.00%) - CodegenTime: 1.133ms - CompileTime: 7.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.799ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.403ms HDFS_SCAN_NODE (id=1):(Total: 1s756ms, non-child: 1s756ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/258.60 MB 3:3/365.61 MB 4:3/572.29 MB 1:3/259.71 MB 2:2/276.37 MB 7:2/298.19 MB 5:2/467.31 MB 0:4/899.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s687ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 0, 0, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB, 111.86 MB - FooterProcessingTime: (Avg: 3.721ms ; Min: 3.314ms ; Max: 4.921ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.75 - BytesRead: 111.86 MB (117291501) - BytesReadDataNodeCache: 0 - BytesReadLocal: 111.86 MB (117291501) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 111.86 MB (117291501) - CachedFileHandlesHitCount: 28 (28) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 404.566ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 138.39 MB (145114222) - PerReadThreadRawHdfsThroughput: 896.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.383ms - RowBatchQueuePutWaitTime: 54s746ms - RowsRead: 7.85M (7853595) - RowsReturned: 7.85M (7853595) - RowsReturnedRate: 4.47 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 7.97K (7973) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 684.292ms - ScannerThreadsSysTime: 23s761ms - ScannerThreadsUserTime: 44s450ms - ScannerThreadsVoluntaryContextSwitches: 2.98M (2975168) - TotalRawHdfsReadTime(*): 124.799ms - TotalReadThroughput: 3.99 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 7.67K (7672) - RowGroups rejected: 0 (0) - RowGroups total: 7.67K (7672) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 7.85M (7853595) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000123 (host=foo.234.36:22000):(Total: 29s382ms, non-child: 26s021ms, % non-child: 88.56%) Hdfs split stats (:<# splits>/): 6:4/706.85 MB 0:4/497.00 MB 5:2/507.85 MB 2:3/524.51 MB 7:3/227.57 MB 4:2/299.16 MB 1:3/610.93 MB Filter 4 arrival: 564ms MemoryUsage(500.000ms): 0, 581.02 KB, 250.69 MB, 250.20 MB, 248.91 MB, 250.39 MB, 250.16 MB, 249.93 MB, 249.30 MB, 249.79 MB, 249.20 MB, 249.13 MB, 249.61 MB, 249.35 MB, 249.30 MB, 249.42 MB, 249.25 MB, 249.10 MB, 249.58 MB, 249.48 MB, 249.48 MB, 249.15 MB, 249.58 MB, 249.32 MB, 249.32 MB, 249.27 MB, 233.53 MB, 225.57 MB, 217.67 MB, 217.49 MB, 217.79 MB, 217.52 MB, 217.64 MB, 217.41 MB, 217.50 MB, 217.48 MB, 217.84 MB, 217.48 MB, 201.57 MB, 185.62 MB, 185.74 MB, 169.88 MB, 154.03 MB, 154.01 MB, 154.10 MB, 146.26 MB, 145.99 MB, 122.00 MB, 122.15 MB, 122.17 MB, 101.59 MB, 100.61 MB, 75.00 MB, 49.47 MB, 33.54 MB, 25.56 MB, 5.74 MB, 2.36 MB, 2.36 MB ThreadUsage(500.000ms): 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.66 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 250.97 MB (263161778) - PerHostPeakMemUsage: 917.27 MB (961826451) - RowsProduced: 14.57M (14572900) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s983ms - TotalStorageWaitTime: 132.606ms - TotalThreadsInvoluntaryContextSwitches: 2.25K (2251) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 2s749ms - TotalThreadsUserTime: 12s442ms - TotalThreadsVoluntaryContextSwitches: 250.31K (250305) Fragment Instance Lifecycle Timings: - ExecTime: 29s330ms - ExecTreeExecTime: 659.654ms - OpenTime: 23.280ms - ExecTreeOpenTime: 62.650us - PrepareTime: 29.029ms - ExecTreePrepareTime: 288.628us DataStreamSender (dst_id=20):(Total: 2s664ms, non-child: 2s664ms, % non-child: 100.00%) - BytesSent: 346.72 MB (363561008) - OverallThroughput: 130.14 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 14.57M (14572900) - SerializeBatchTime: 2s659ms - UncompressedRowBatchSize: 346.72 MB (363561008) CodeGen:(Total: 49.422ms, non-child: 49.422ms, % non-child: 100.00%) - CodegenTime: 984.069us - CompileTime: 6.666ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.817ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.489ms HDFS_SCAN_NODE (id=1):(Total: 647.657ms, non-child: 647.657ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:4/706.85 MB 0:4/497.00 MB 5:2/507.85 MB 2:3/524.51 MB 7:3/227.57 MB 4:2/299.16 MB 1:3/610.93 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB, 208.84 MB - FooterProcessingTime: (Avg: 3.357ms ; Min: 3.201ms ; Max: 3.611ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.86 - BytesRead: 208.84 MB (218982802) - BytesReadDataNodeCache: 0 - BytesReadLocal: 208.84 MB (218982802) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 208.84 MB (218982802) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 777.014ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 246.91 MB (258899143) - PerReadThreadRawHdfsThroughput: 903.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.113ms - RowBatchQueuePutWaitTime: 1m40s - RowsRead: 14.57M (14572900) - RowsReturned: 14.57M (14572900) - RowsReturnedRate: 22.50 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1244) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 1s302ms - ScannerThreadsSysTime: 2s496ms - ScannerThreadsUserTime: 6s322ms - ScannerThreadsVoluntaryContextSwitches: 248.30K (248299) - TotalRawHdfsReadTime(*): 231.156ms - TotalReadThroughput: 7.46 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 14.23K (14233) - RowGroups rejected: 0 (0) - RowGroups total: 14.23K (14233) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 14.57M (14572900) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000136 (host=foo.221.45:22000):(Total: 28s956ms, non-child: 26s178ms, % non-child: 90.41%) Hdfs split stats (:<# splits>/): 6:1/219.21 MB 7:3/523.90 MB 4:2/352.67 MB 5:4/754.37 MB 1:2/300.49 MB 3:1/72.36 MB 2:2/299.99 MB 0:6/907.39 MB Filter 4 arrival: 1s491ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 589.02 KB, 111.76 MB, 112.12 MB, 112.02 MB, 112.23 MB, 111.66 MB, 112.65 MB, 111.64 MB, 112.55 MB, 112.20 MB, 111.69 MB, 111.46 MB, 112.17 MB, 110.97 MB, 111.02 MB, 111.60 MB, 111.73 MB, 111.26 MB, 112.04 MB, 111.59 MB, 111.69 MB, 111.43 MB, 112.01 MB, 112.01 MB, 103.38 MB, 103.43 MB, 103.53 MB, 103.47 MB, 95.61 MB, 95.57 MB, 95.87 MB, 95.70 MB, 95.78 MB, 95.56 MB, 95.62 MB, 64.41 MB, 64.38 MB, 56.17 MB, 48.29 MB, 48.35 MB, 48.45 MB, 48.28 MB, 48.54 MB, 48.51 MB, 48.39 MB, 48.41 MB, 48.55 MB, 48.44 MB, 32.55 MB, 32.56 MB, 32.51 MB, 32.58 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 5.61 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 113.23 MB (118725784) - PerHostPeakMemUsage: 781.10 MB (819038645) - RowsProduced: 6.51M (6505377) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s703ms - TotalStorageWaitTime: 77.548ms - TotalThreadsInvoluntaryContextSwitches: 9.69K (9686) - TotalThreadsTotalWallClockTime: 2m40s - TotalThreadsSysTime: 29s475ms - TotalThreadsUserTime: 52s415ms - TotalThreadsVoluntaryContextSwitches: 2.69M (2688734) Fragment Instance Lifecycle Timings: - ExecTime: 28s894ms - ExecTreeExecTime: 1s536ms - OpenTime: 29.298ms - ExecTreeOpenTime: 114.228us - PrepareTime: 33.095ms - ExecTreePrepareTime: 423.206us DataStreamSender (dst_id=20):(Total: 1s187ms, non-child: 1s187ms, % non-child: 100.00%) - BytesSent: 151.55 MB (158915924) - OverallThroughput: 127.62 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 6.51M (6505377) - SerializeBatchTime: 1s185ms - UncompressedRowBatchSize: 151.55 MB (158915924) CodeGen:(Total: 58.813ms, non-child: 58.813ms, % non-child: 100.00%) - CodegenTime: 1.192ms - CompileTime: 7.889ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.183ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.233ms HDFS_SCAN_NODE (id=1):(Total: 1s531ms, non-child: 1s531ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/219.21 MB 7:3/523.90 MB 4:2/352.67 MB 5:4/754.37 MB 1:2/300.49 MB 3:1/72.36 MB 2:2/299.99 MB 0:6/907.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s445ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB, 92.23 MB - FooterProcessingTime: (Avg: 3.422ms ; Min: 3.242ms ; Max: 3.602ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 92.23 MB (96711990) - BytesReadDataNodeCache: 0 - BytesReadLocal: 92.23 MB (96711990) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 92.23 MB (96711990) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 340.245ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 109.15 MB (114448495) - PerReadThreadRawHdfsThroughput: 784.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 44.196ms - RowBatchQueuePutWaitTime: 41s832ms - RowsRead: 6.51M (6505377) - RowsReturned: 6.51M (6505377) - RowsReturnedRate: 4.25 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 9.18K (9176) - ScannerThreadsTotalWallClockTime: 2m11s - MaterializeTupleTime(*): 551.327ms - ScannerThreadsSysTime: 29s341ms - ScannerThreadsUserTime: 49s648ms - ScannerThreadsVoluntaryContextSwitches: 2.69M (2687336) - TotalRawHdfsReadTime(*): 117.540ms - TotalReadThroughput: 3.42 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 19 (19) - Files total: 21 (21) - RowGroups processed: 6.35K (6354) - RowGroups rejected: 0 (0) - RowGroups total: 6.35K (6354) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 6.51M (6505377) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000011f (host=foo.232.23:22000):(Total: 27s836ms, non-child: 25s419ms, % non-child: 91.32%) Hdfs split stats (:<# splits>/): 7:2/391.38 MB 1:2/396.70 MB 6:2/341.27 MB 5:2/320.37 MB 3:3/334.32 MB 0:5/988.72 MB 2:6/565.50 MB Filter 4 arrival: 1s280ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 114.13 MB, 111.53 MB, 113.99 MB, 112.90 MB, 112.14 MB, 111.76 MB, 112.17 MB, 113.39 MB, 113.33 MB, 113.25 MB, 113.39 MB, 113.26 MB, 113.20 MB, 112.56 MB, 112.26 MB, 112.26 MB, 112.21 MB, 113.19 MB, 112.32 MB, 86.63 MB, 84.79 MB, 77.36 MB, 77.27 MB, 77.51 MB, 77.36 MB, 77.16 MB, 77.02 MB, 77.06 MB, 77.04 MB, 69.64 MB, 69.64 MB, 61.14 MB, 61.43 MB, 53.23 MB, 53.50 MB, 53.50 MB, 53.40 MB, 53.25 MB, 53.40 MB, 53.33 MB, 53.53 MB, 37.25 MB, 37.41 MB, 37.52 MB, 37.46 MB, 37.44 MB, 29.57 MB, 29.44 MB, 7.00 MB, 2.52 MB, 2.52 MB, 2.52 MB, 2.52 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.49 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 114.19 MB (119734498) - PerHostPeakMemUsage: 840.02 MB (880823505) - RowsProduced: 6.09M (6094591) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s339ms - TotalStorageWaitTime: 49.056ms - TotalThreadsInvoluntaryContextSwitches: 9.85K (9849) - TotalThreadsTotalWallClockTime: 2m31s - TotalThreadsSysTime: 32s450ms - TotalThreadsUserTime: 50s839ms - TotalThreadsVoluntaryContextSwitches: 3.85M (3847792) Fragment Instance Lifecycle Timings: - ExecTime: 27s779ms - ExecTreeExecTime: 1s285ms - OpenTime: 25.399ms - ExecTreeOpenTime: 72.980us - PrepareTime: 31.731ms - ExecTreePrepareTime: 301.794us DataStreamSender (dst_id=20):(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) - BytesSent: 142.04 MB (148935627) - OverallThroughput: 131.24 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 6.09M (6094591) - SerializeBatchTime: 1s080ms - UncompressedRowBatchSize: 142.04 MB (148935627) CodeGen:(Total: 52.726ms, non-child: 52.726ms, % non-child: 100.00%) - CodegenTime: 1.567ms - CompileTime: 6.838ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.520ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.730ms HDFS_SCAN_NODE (id=1):(Total: 1s281ms, non-child: 1s281ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:2/391.38 MB 1:2/396.70 MB 6:2/341.27 MB 5:2/320.37 MB 3:3/334.32 MB 0:5/988.72 MB 2:6/565.50 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s224ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB, 86.21 MB - FooterProcessingTime: (Avg: 3.075ms ; Min: 3.059ms ; Max: 3.092ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.84 - BytesRead: 86.21 MB (90394657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 86.21 MB (90394657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 86.21 MB (90394657) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 320.278ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 110.13 MB (115483321) - PerReadThreadRawHdfsThroughput: 988.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.338ms - RowBatchQueuePutWaitTime: 32s348ms - RowsRead: 6.09M (6094591) - RowsReturned: 6.09M (6094591) - RowsReturnedRate: 4.75 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 9.39K (9394) - ScannerThreadsTotalWallClockTime: 2m3s - MaterializeTupleTime(*): 522.940ms - ScannerThreadsSysTime: 32s340ms - ScannerThreadsUserTime: 48s299ms - ScannerThreadsVoluntaryContextSwitches: 3.85M (3846319) - TotalRawHdfsReadTime(*): 87.251ms - TotalReadThroughput: 3.38 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 5.95K (5952) - RowGroups rejected: 0 (0) - RowGroups total: 5.95K (5952) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 6.09M (6094591) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000141 (host=foo.221.32:22000):(Total: 27s748ms, non-child: 24s615ms, % non-child: 88.71%) Hdfs split stats (:<# splits>/): 5:1/158.97 MB 2:3/453.26 MB 4:2/507.81 MB 6:4/822.77 MB 0:4/459.46 MB 3:3/352.06 MB 1:5/879.53 MB Filter 4 arrival: 1s615ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 121.38 MB, 122.37 MB, 122.54 MB, 123.30 MB, 123.04 MB, 123.27 MB, 122.65 MB, 122.19 MB, 122.08 MB, 122.91 MB, 123.32 MB, 123.04 MB, 122.69 MB, 123.23 MB, 123.37 MB, 122.70 MB, 122.87 MB, 122.79 MB, 122.43 MB, 107.09 MB, 106.54 MB, 106.53 MB, 106.84 MB, 106.95 MB, 107.06 MB, 107.17 MB, 106.45 MB, 106.68 MB, 98.63 MB, 98.94 MB, 98.87 MB, 98.67 MB, 83.00 MB, 75.10 MB, 58.85 MB, 59.19 MB, 58.88 MB, 58.87 MB, 45.36 MB, 45.36 MB, 45.33 MB, 45.67 MB, 45.27 MB, 37.29 MB, 37.31 MB, 37.31 MB, 29.44 MB, 21.22 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1 - AverageThreadTokens: 2.75 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 124.21 MB (130242826) - PerHostPeakMemUsage: 897.91 MB (941522907) - RowsProduced: 7.62M (7624714) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s091ms - TotalStorageWaitTime: 55.911ms - TotalThreadsInvoluntaryContextSwitches: 1.47K (1473) - TotalThreadsTotalWallClockTime: 1m15s - TotalThreadsSysTime: 230.964ms - TotalThreadsUserTime: 9s648ms - TotalThreadsVoluntaryContextSwitches: 9.14K (9140) Fragment Instance Lifecycle Timings: - ExecTime: 27s694ms - ExecTreeExecTime: 1s655ms - OpenTime: 25.031ms - ExecTreeOpenTime: 87.049us - PrepareTime: 29.476ms - ExecTreePrepareTime: 304.439us DataStreamSender (dst_id=20):(Total: 1s433ms, non-child: 1s433ms, % non-child: 100.00%) - BytesSent: 177.88 MB (186518847) - OverallThroughput: 124.12 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.62M (7624714) - SerializeBatchTime: 1s430ms - UncompressedRowBatchSize: 177.88 MB (186518847) CodeGen:(Total: 51.370ms, non-child: 51.370ms, % non-child: 100.00%) - CodegenTime: 1.038ms - CompileTime: 6.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.461ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.816ms HDFS_SCAN_NODE (id=1):(Total: 1s648ms, non-child: 1s648ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/158.97 MB 2:3/453.26 MB 4:2/507.81 MB 6:4/822.77 MB 0:4/459.46 MB 3:3/352.06 MB 1:5/879.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s567ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB, 108.71 MB - FooterProcessingTime: (Avg: 2.706ms ; Min: 2.475ms ; Max: 2.936ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.88 - BytesRead: 108.71 MB (113988907) - BytesReadDataNodeCache: 0 - BytesReadLocal: 108.71 MB (113988907) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 108.71 MB (113988907) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 399.997ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.15 MB (125981327) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.987ms - RowBatchQueuePutWaitTime: 41s795ms - RowsRead: 7.62M (7624714) - RowsReturned: 7.62M (7624714) - RowsReturnedRate: 4.63 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 895 (895) - ScannerThreadsTotalWallClockTime: 48s162ms - MaterializeTupleTime(*): 674.117ms - ScannerThreadsSysTime: 54.990ms - ScannerThreadsUserTime: 6s330ms - ScannerThreadsVoluntaryContextSwitches: 7.30K (7300) - TotalRawHdfsReadTime(*): 105.395ms - TotalReadThroughput: 4.26 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 7.45K (7447) - RowGroups rejected: 0 (0) - RowGroups total: 7.45K (7447) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.62M (7624714) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000134 (host=foo.232.43:22000):(Total: 27s443ms, non-child: 25s700ms, % non-child: 93.65%) Hdfs split stats (:<# splits>/): 0:2/255.44 MB 2:3/573.10 MB 5:1/15.62 MB 3:3/340.59 MB 6:5/1.01 GB 7:1/21.69 MB 1:6/677.28 MB 4:3/614.36 MB Filter 4 arrival: 602ms MemoryUsage(500.000ms): 581.02 KB, 853.02 KB, 102.87 MB, 103.42 MB, 102.41 MB, 103.06 MB, 103.91 MB, 102.83 MB, 102.85 MB, 85.96 MB, 84.71 MB, 84.17 MB, 85.39 MB, 77.22 MB, 77.19 MB, 77.02 MB, 76.56 MB, 76.56 MB, 77.03 MB, 68.95 MB, 68.70 MB, 69.00 MB, 69.12 MB, 61.18 MB, 60.86 MB, 61.04 MB, 60.92 MB, 60.74 MB, 60.92 MB, 52.87 MB, 52.92 MB, 53.00 MB, 53.06 MB, 53.06 MB, 53.06 MB, 53.06 MB, 52.77 MB, 52.82 MB, 52.99 MB, 52.71 MB, 52.71 MB, 45.04 MB, 37.12 MB, 37.09 MB, 37.08 MB, 37.06 MB, 36.99 MB, 29.16 MB, 29.10 MB, 3.91 MB, 2.74 MB, 2.74 MB, 2.74 MB, 2.74 MB, 2.74 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.75 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 104.72 MB (109806755) - PerHostPeakMemUsage: 869.14 MB (911361143) - RowsProduced: 5.74M (5736632) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s057ms - TotalStorageWaitTime: 44.809ms - TotalThreadsInvoluntaryContextSwitches: 2.72K (2717) - TotalThreadsTotalWallClockTime: 1m14s - TotalThreadsSysTime: 314.952ms - TotalThreadsUserTime: 22s985ms - TotalThreadsVoluntaryContextSwitches: 6.42K (6415) Fragment Instance Lifecycle Timings: - ExecTime: 27s388ms - ExecTreeExecTime: 621.534ms - OpenTime: 23.993ms - ExecTreeOpenTime: 83.830us - PrepareTime: 30.769ms - ExecTreePrepareTime: 405.025us DataStreamSender (dst_id=20):(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) - BytesSent: 131.89 MB (138292185) - OverallThroughput: 122.75 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.74M (5736632) - SerializeBatchTime: 1s071ms - UncompressedRowBatchSize: 131.89 MB (138292185) CodeGen:(Total: 51.003ms, non-child: 51.003ms, % non-child: 100.00%) - CodegenTime: 1.305ms - CompileTime: 6.141ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.009ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.363ms HDFS_SCAN_NODE (id=1):(Total: 617.290ms, non-child: 617.290ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/255.44 MB 2:3/573.10 MB 5:1/15.62 MB 3:3/340.59 MB 6:5/1.01 GB 7:1/21.69 MB 1:6/677.28 MB 4:3/614.36 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 562ms Hdfs Read Thread Concurrency Bucket: 0:98% 1:0% 2:2% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB, 80.23 MB - FooterProcessingTime: (Avg: 2.714ms ; Min: 2.692ms ; Max: 2.735ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 80.23 MB (84122538) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.23 MB (84122538) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.23 MB (84122538) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 292.118ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 100.64 MB (105524026) - PerReadThreadRawHdfsThroughput: 928.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.605ms - RowBatchQueuePutWaitTime: 26s459ms - RowsRead: 5.74M (5736632) - RowsReturned: 5.74M (5736632) - RowsReturnedRate: 9.29 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.33K (2334) - ScannerThreadsTotalWallClockTime: 47s136ms - MaterializeTupleTime(*): 483.477ms - ScannerThreadsSysTime: 188.971ms - ScannerThreadsUserTime: 20s478ms - ScannerThreadsVoluntaryContextSwitches: 4.99K (4990) - TotalRawHdfsReadTime(*): 86.427ms - TotalReadThroughput: 3.21 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 22 (22) - Files total: 24 (24) - RowGroups processed: 5.60K (5603) - RowGroups rejected: 0 (0) - RowGroups total: 5.60K (5603) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.74M (5736632) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000170 (host=foo.232.45:22000):(Total: 27s143ms, non-child: 25s256ms, % non-child: 93.05%) Hdfs split stats (:<# splits>/): 5:1/212.15 MB 1:1/173.49 MB 7:2/508.04 MB 2:2/344.15 MB 3:5/807.12 MB 6:1/203.87 MB 4:4/787.38 MB 0:2/263.33 MB Filter 4 arrival: 755ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 101.15 MB, 100.99 MB, 100.90 MB, 98.86 MB, 99.26 MB, 100.57 MB, 99.46 MB, 99.22 MB, 100.39 MB, 99.60 MB, 99.64 MB, 99.97 MB, 100.12 MB, 100.17 MB, 100.14 MB, 100.08 MB, 99.65 MB, 99.22 MB, 100.08 MB, 100.09 MB, 99.73 MB, 91.17 MB, 91.88 MB, 91.40 MB, 91.81 MB, 91.99 MB, 84.00 MB, 83.97 MB, 83.85 MB, 83.85 MB, 83.43 MB, 83.84 MB, 83.41 MB, 75.61 MB, 75.95 MB, 53.66 MB, 53.25 MB, 44.66 MB, 44.67 MB, 36.49 MB, 36.29 MB, 36.45 MB, 36.73 MB, 36.41 MB, 36.40 MB, 36.69 MB, 36.55 MB, 5.50 MB, 2.47 MB, 2.47 MB, 2.47 MB, 2.47 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.74 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 101.18 MB (106093842) - PerHostPeakMemUsage: 789.75 MB (828111526) - RowsProduced: 5.42M (5418432) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s109ms - TotalStorageWaitTime: 70.425ms - TotalThreadsInvoluntaryContextSwitches: 1.22K (1217) - TotalThreadsTotalWallClockTime: 1m14s - TotalThreadsSysTime: 187.971ms - TotalThreadsUserTime: 9s019ms - TotalThreadsVoluntaryContextSwitches: 6.97K (6969) Fragment Instance Lifecycle Timings: - ExecTime: 27s088ms - ExecTreeExecTime: 778.950ms - OpenTime: 23.972ms - ExecTreeOpenTime: 91.276us - PrepareTime: 30.558ms - ExecTreePrepareTime: 283.791us DataStreamSender (dst_id=20):(Total: 1s061ms, non-child: 1s061ms, % non-child: 100.00%) - BytesSent: 128.22 MB (134444243) - OverallThroughput: 120.76 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.42M (5418432) - SerializeBatchTime: 1s059ms - UncompressedRowBatchSize: 128.22 MB (134444243) CodeGen:(Total: 50.984ms, non-child: 50.984ms, % non-child: 100.00%) - CodegenTime: 1.118ms - CompileTime: 6.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.931ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.378ms HDFS_SCAN_NODE (id=1):(Total: 774.312ms, non-child: 774.312ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/212.15 MB 1:1/173.49 MB 7:2/508.04 MB 2:2/344.15 MB 3:5/807.12 MB 6:1/203.87 MB 4:4/787.38 MB 0:2/263.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 702ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB, 78.73 MB - FooterProcessingTime: (Avg: 3.500ms ; Min: 2.552ms ; Max: 4.447ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.88 - BytesRead: 78.73 MB (82559535) - BytesReadDataNodeCache: 0 - BytesReadLocal: 78.73 MB (82559535) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78.73 MB (82559535) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 265.410ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 97.15 MB (101866377) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.180ms - RowBatchQueuePutWaitTime: 40s468ms - RowsRead: 5.42M (5418432) - RowsReturned: 5.42M (5418432) - RowsReturnedRate: 7.00 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 785 (785) - ScannerThreadsTotalWallClockTime: 47s174ms - MaterializeTupleTime(*): 566.852ms - ScannerThreadsSysTime: 62.990ms - ScannerThreadsUserTime: 6s504ms - ScannerThreadsVoluntaryContextSwitches: 5.09K (5089) - TotalRawHdfsReadTime(*): 67.130ms - TotalReadThroughput: 3.15 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 16 (16) - Files total: 18 (18) - RowGroups processed: 5.29K (5292) - RowGroups rejected: 0 (0) - RowGroups total: 5.29K (5292) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.42M (5418432) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000013b (host=foo.232.48:22000):(Total: 27s123ms, non-child: 24s902ms, % non-child: 91.81%) Hdfs split stats (:<# splits>/): 3:2/284.63 MB 6:4/600.23 MB 4:2/321.07 MB 2:3/517.25 MB 7:3/584.86 MB 0:4/722.29 MB 5:3/434.95 MB Filter 4 arrival: 751ms MemoryUsage(500.000ms): 581.02 KB, 127.81 MB, 127.40 MB, 128.09 MB, 127.08 MB, 128.38 MB, 128.81 MB, 127.49 MB, 128.52 MB, 128.68 MB, 128.65 MB, 128.68 MB, 127.72 MB, 128.11 MB, 128.47 MB, 127.71 MB, 127.81 MB, 127.76 MB, 127.81 MB, 128.20 MB, 127.93 MB, 127.79 MB, 128.25 MB, 112.24 MB, 111.96 MB, 104.03 MB, 104.36 MB, 104.08 MB, 104.43 MB, 83.56 MB, 83.67 MB, 83.85 MB, 83.77 MB, 83.84 MB, 61.26 MB, 61.41 MB, 60.20 MB, 52.56 MB, 52.29 MB, 44.45 MB, 44.28 MB, 36.47 MB, 36.37 MB, 36.37 MB, 36.38 MB, 36.30 MB, 36.28 MB, 36.32 MB, 36.45 MB, 5.42 MB, 2.34 MB, 2.34 MB, 2.34 MB, 2.34 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.67 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 129.53 MB (135827102) - PerHostPeakMemUsage: 840.42 MB (881248123) - RowsProduced: 7.36M (7357310) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s191ms - TotalStorageWaitTime: 107.948ms - TotalThreadsInvoluntaryContextSwitches: 2.74K (2743) - TotalThreadsTotalWallClockTime: 1m39s - TotalThreadsSysTime: 2s012ms - TotalThreadsUserTime: 19s817ms - TotalThreadsVoluntaryContextSwitches: 108.96K (108957) Fragment Instance Lifecycle Timings: - ExecTime: 27s076ms - ExecTreeExecTime: 809.090ms - OpenTime: 25.050ms - ExecTreeOpenTime: 103.401us - PrepareTime: 22.197ms - ExecTreePrepareTime: 214.301us DataStreamSender (dst_id=20):(Total: 1s373ms, non-child: 1s373ms, % non-child: 100.00%) - BytesSent: 173.11 MB (181516585) - OverallThroughput: 126.03 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.36M (7357310) - SerializeBatchTime: 1s370ms - UncompressedRowBatchSize: 173.11 MB (181516585) CodeGen:(Total: 44.516ms, non-child: 44.516ms, % non-child: 100.00%) - CodegenTime: 1.120ms - CompileTime: 6.874ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.300ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.815ms HDFS_SCAN_NODE (id=1):(Total: 802.700ms, non-child: 802.700ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/284.63 MB 6:4/600.23 MB 4:2/321.07 MB 2:3/517.25 MB 7:3/584.86 MB 0:4/722.29 MB 5:3/434.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 723ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB, 105.03 MB - FooterProcessingTime: (Avg: 3.601ms ; Min: 2.533ms ; Max: 5.280ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.88 - BytesRead: 105.03 MB (110135006) - BytesReadDataNodeCache: 0 - BytesReadLocal: 105.03 MB (110135006) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 105.03 MB (110135006) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 394.703ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 125.53 MB (131623184) - PerReadThreadRawHdfsThroughput: 885.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.527ms - RowBatchQueuePutWaitTime: 53s749ms - RowsRead: 7.36M (7357310) - RowsReturned: 7.36M (7357310) - RowsReturnedRate: 9.17 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 2.21K (2215) - ScannerThreadsTotalWallClockTime: 1m12s - MaterializeTupleTime(*): 658.537ms - ScannerThreadsSysTime: 1s868ms - ScannerThreadsUserTime: 16s601ms - ScannerThreadsVoluntaryContextSwitches: 107.28K (107281) - TotalRawHdfsReadTime(*): 118.611ms - TotalReadThroughput: 4.20 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 7.19K (7187) - RowGroups rejected: 0 (0) - RowGroups total: 7.19K (7187) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 7.36M (7357310) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000145 (host=foo.221.42:22000):(Total: 26s802ms, non-child: 24s181ms, % non-child: 90.22%) Hdfs split stats (:<# splits>/): 4:1/66.41 MB 7:1/165.96 MB 3:3/682.19 MB 5:1/180.14 MB 6:2/189.94 MB 2:3/762.28 MB 1:4/751.93 MB 0:4/465.78 MB Filter 4 arrival: 1s565ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 93.11 MB, 90.90 MB, 92.61 MB, 92.77 MB, 92.66 MB, 92.28 MB, 91.86 MB, 91.52 MB, 92.71 MB, 92.62 MB, 91.27 MB, 92.38 MB, 92.36 MB, 91.96 MB, 91.95 MB, 91.56 MB, 91.30 MB, 91.66 MB, 91.56 MB, 92.00 MB, 91.76 MB, 91.76 MB, 91.88 MB, 91.45 MB, 76.09 MB, 75.98 MB, 76.02 MB, 75.99 MB, 75.95 MB, 75.95 MB, 75.54 MB, 75.50 MB, 75.73 MB, 75.82 MB, 75.84 MB, 53.50 MB, 44.39 MB, 36.53 MB, 36.20 MB, 36.23 MB, 28.54 MB, 28.51 MB, 28.61 MB, 28.25 MB, 28.47 MB, 6.25 MB, 2.56 MB, 2.56 MB, 2.56 MB, 2.56 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.40 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 93.22 MB (97752036) - PerHostPeakMemUsage: 893.01 MB (936386004) - RowsProduced: 5.09M (5093206) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s889ms - TotalStorageWaitTime: 50.308ms - TotalThreadsInvoluntaryContextSwitches: 8.53K (8530) - TotalThreadsTotalWallClockTime: 2m22s - TotalThreadsSysTime: 24s478ms - TotalThreadsUserTime: 46s510ms - TotalThreadsVoluntaryContextSwitches: 2.24M (2235094) Fragment Instance Lifecycle Timings: - ExecTime: 26s743ms - ExecTreeExecTime: 1s595ms - OpenTime: 24.873ms - ExecTreeOpenTime: 78.947us - PrepareTime: 33.266ms - ExecTreePrepareTime: 320.064us DataStreamSender (dst_id=20):(Total: 980.162ms, non-child: 980.162ms, % non-child: 100.00%) - BytesSent: 119.51 MB (125319990) - OverallThroughput: 121.93 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.09M (5093206) - SerializeBatchTime: 977.839ms - UncompressedRowBatchSize: 119.51 MB (125319990) CodeGen:(Total: 48.491ms, non-child: 48.491ms, % non-child: 100.00%) - CodegenTime: 1.277ms - CompileTime: 6.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.205ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.011ms HDFS_SCAN_NODE (id=1):(Total: 1s592ms, non-child: 1s592ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/66.41 MB 7:1/165.96 MB 3:3/682.19 MB 5:1/180.14 MB 6:2/189.94 MB 2:3/762.28 MB 1:4/751.93 MB 0:4/465.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s525ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB, 72.81 MB - FooterProcessingTime: (Avg: 2.769ms ; Min: 2.740ms ; Max: 2.798ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.76 - BytesRead: 72.81 MB (76350018) - BytesReadDataNodeCache: 0 - BytesReadLocal: 72.81 MB (76350018) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 72.81 MB (76350018) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 267.505ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 89.15 MB (93476450) - PerReadThreadRawHdfsThroughput: 983.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.352ms - RowBatchQueuePutWaitTime: 39s039ms - RowsRead: 5.09M (5093206) - RowsReturned: 5.09M (5093206) - RowsReturnedRate: 3.20 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 8.17K (8169) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 443.361ms - ScannerThreadsSysTime: 24s349ms - ScannerThreadsUserTime: 44s189ms - ScannerThreadsVoluntaryContextSwitches: 2.23M (2233524) - TotalRawHdfsReadTime(*): 74.010ms - TotalReadThroughput: 2.97 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 17 (17) - Files total: 19 (19) - RowGroups processed: 4.97K (4975) - RowGroups rejected: 0 (0) - RowGroups total: 4.97K (4975) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.09M (5093206) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000018b (host=foo.187.41:22000):(Total: 26s701ms, non-child: 22s456ms, % non-child: 84.10%) Hdfs split stats (:<# splits>/): 1:1/253.95 MB 5:2/480.76 MB 0:1/151.62 MB 7:4/605.02 MB 4:3/316.92 MB 6:3/449.31 MB 2:7/1.23 GB Filter 4 arrival: 2s195ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 196.33 MB, 191.42 MB, 190.96 MB, 190.96 MB, 191.05 MB, 190.68 MB, 190.47 MB, 189.56 MB, 190.33 MB, 189.84 MB, 189.94 MB, 189.92 MB, 190.33 MB, 189.83 MB, 189.83 MB, 190.17 MB, 190.22 MB, 189.77 MB, 165.93 MB, 165.96 MB, 166.00 MB, 166.16 MB, 166.26 MB, 166.08 MB, 166.18 MB, 142.18 MB, 142.21 MB, 142.31 MB, 142.20 MB, 134.17 MB, 126.28 MB, 118.59 MB, 118.38 MB, 118.61 MB, 110.47 MB, 94.57 MB, 94.60 MB, 94.51 MB, 78.86 MB, 78.86 MB, 78.87 MB, 49.44 MB, 49.47 MB, 33.39 MB, 33.66 MB, 25.59 MB, 2.49 MB, 2.49 MB, 2.49 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.47 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 197.16 MB (206740430) - PerHostPeakMemUsage: 951.45 MB (997669276) - RowsProduced: 11.43M (11430340) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19s312ms - TotalStorageWaitTime: 113.000ms - TotalThreadsInvoluntaryContextSwitches: 4.39K (4387) - TotalThreadsTotalWallClockTime: 1m57s - TotalThreadsSysTime: 2s429ms - TotalThreadsUserTime: 32s266ms - TotalThreadsVoluntaryContextSwitches: 260.51K (260509) Fragment Instance Lifecycle Timings: - ExecTime: 26s652ms - ExecTreeExecTime: 2s251ms - OpenTime: 26.033ms - ExecTreeOpenTime: 63.322us - PrepareTime: 22.235ms - ExecTreePrepareTime: 199.214us DataStreamSender (dst_id=20):(Total: 1s955ms, non-child: 1s955ms, % non-child: 100.00%) - BytesSent: 271.12 MB (284287583) - OverallThroughput: 138.62 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.43M (11430340) - SerializeBatchTime: 1s952ms - UncompressedRowBatchSize: 271.12 MB (284287583) CodeGen:(Total: 45.683ms, non-child: 45.683ms, % non-child: 100.00%) - CodegenTime: 1.159ms - CompileTime: 7.044ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.089ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.036ms HDFS_SCAN_NODE (id=1):(Total: 2s243ms, non-child: 2s243ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.95 MB 5:2/480.76 MB 0:1/151.62 MB 7:4/605.02 MB 4:3/316.92 MB 6:3/449.31 MB 2:7/1.23 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 2s167ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 0, 0, 0, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB, 164.39 MB - FooterProcessingTime: (Avg: 3.216ms ; Min: 2.512ms ; Max: 4.935ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.68 - BytesRead: 164.39 MB (172377056) - BytesReadDataNodeCache: 0 - BytesReadLocal: 164.39 MB (172377056) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 164.39 MB (172377056) - CachedFileHandlesHitCount: 35 (35) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 580.671ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 193.10 MB (202478070) - PerReadThreadRawHdfsThroughput: 954.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.571ms - RowBatchQueuePutWaitTime: 1m - RowsRead: 11.43M (11430340) - RowsReturned: 11.43M (11430340) - RowsReturnedRate: 5.10 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 3.66K (3661) - ScannerThreadsTotalWallClockTime: 1m30s - MaterializeTupleTime(*): 966.686ms - ScannerThreadsSysTime: 2s273ms - ScannerThreadsUserTime: 27s725ms - ScannerThreadsVoluntaryContextSwitches: 258.52K (258522) - TotalRawHdfsReadTime(*): 172.140ms - TotalReadThroughput: 6.58 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 11.16K (11165) - RowGroups rejected: 0 (0) - RowGroups total: 11.16K (11165) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 11.43M (11430340) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000013c (host=foo.234.43:22000):(Total: 25s950ms, non-child: 22s468ms, % non-child: 86.58%) Hdfs split stats (:<# splits>/): 2:1/253.92 MB 3:1/167.08 MB 1:3/389.45 MB 5:3/512.59 MB 0:2/125.61 MB 6:6/995.72 MB 7:4/688.58 MB 4:2/376.49 MB Filter 4 arrival: 580ms MemoryUsage(500.000ms): 568.41 KB, 581.02 KB, 242.97 MB, 242.51 MB, 241.13 MB, 242.27 MB, 241.39 MB, 241.59 MB, 241.89 MB, 242.10 MB, 241.81 MB, 241.59 MB, 241.59 MB, 241.95 MB, 241.55 MB, 241.89 MB, 241.74 MB, 241.71 MB, 241.80 MB, 241.70 MB, 241.83 MB, 241.83 MB, 241.69 MB, 241.79 MB, 233.80 MB, 217.82 MB, 202.05 MB, 202.06 MB, 202.08 MB, 190.44 MB, 190.54 MB, 190.79 MB, 174.64 MB, 166.60 MB, 158.70 MB, 142.78 MB, 142.92 MB, 142.96 MB, 142.66 MB, 118.98 MB, 118.91 MB, 118.92 MB, 111.23 MB, 110.99 MB, 107.94 MB, 107.90 MB, 107.88 MB, 107.90 MB, 79.13 MB, 54.79 MB, 4.05 MB, 2.50 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 5.21 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 243.35 MB (255165773) - PerHostPeakMemUsage: 1004.83 MB (1053640196) - RowsProduced: 16.64M (16635265) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s307ms - TotalStorageWaitTime: 218.179ms - TotalThreadsInvoluntaryContextSwitches: 1.76K (1759) - TotalThreadsTotalWallClockTime: 2m16s - TotalThreadsSysTime: 630.900ms - TotalThreadsUserTime: 10s409ms - TotalThreadsVoluntaryContextSwitches: 44.31K (44313) Fragment Instance Lifecycle Timings: - ExecTime: 25s890ms - ExecTreeExecTime: 640.688ms - OpenTime: 30.135ms - ExecTreeOpenTime: 86.569us - PrepareTime: 29.467ms - ExecTreePrepareTime: 314.410us DataStreamSender (dst_id=20):(Total: 2s797ms, non-child: 2s797ms, % non-child: 100.00%) - BytesSent: 396.91 MB (416190374) - OverallThroughput: 141.89 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 16.64M (16635265) - SerializeBatchTime: 2s791ms - UncompressedRowBatchSize: 396.91 MB (416190374) CodeGen:(Total: 56.369ms, non-child: 56.369ms, % non-child: 100.00%) - CodegenTime: 1.366ms - CompileTime: 7.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 21.439ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.803ms HDFS_SCAN_NODE (id=1):(Total: 627.923ms, non-child: 627.923ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.92 MB 3:1/167.08 MB 1:3/389.45 MB 5:3/512.59 MB 0:2/125.61 MB 6:6/995.72 MB 7:4/688.58 MB 4:2/376.49 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 0, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 199.49 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 227.26 MB, 239.45 MB, 239.45 MB, 239.45 MB, 239.45 MB, 239.45 MB, 239.45 MB, 239.45 MB - FooterProcessingTime: (Avg: 2.325ms ; Min: 748.634us ; Max: 3.496ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.38 - BytesRead: 239.45 MB (251081712) - BytesReadDataNodeCache: 0 - BytesReadLocal: 239.45 MB (251081712) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 239.45 MB (251081712) - CachedFileHandlesHitCount: 55 (55) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 870.784ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 239.28 MB (250903908) - PerReadThreadRawHdfsThroughput: 749.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.630ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 16.64M (16635265) - RowsReturned: 16.64M (16635265) - RowsReturnedRate: 26.49 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 704 (704) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 1s467ms - ScannerThreadsSysTime: 393.937ms - ScannerThreadsUserTime: 3s850ms - ScannerThreadsVoluntaryContextSwitches: 42.22K (42223) - TotalRawHdfsReadTime(*): 319.276ms - TotalReadThroughput: 9.39 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 14 (14) - Files total: 22 (22) - RowGroups processed: 16.25K (16249) - RowGroups rejected: 0 (0) - RowGroups total: 16.25K (16249) - Rows processed: 131.07K (131072) - Rows rejected: 0 (0) - Rows total: 16.64M (16635265) - Splits processed: 8 (8) - Splits rejected: 0 (0) - Splits total: 8 (8) Instance 5f429df048b5534b:41bcce1800000118 (host=foo.246.37:22000):(Total: 25s799ms, non-child: 23s043ms, % non-child: 89.32%) Hdfs split stats (:<# splits>/): 2:3/641.32 MB 0:1/83.89 MB 5:1/186.47 MB 4:3/762.02 MB 3:4/552.27 MB 1:3/512.61 MB 6:4/632.74 MB 7:3/238.66 MB Filter 4 arrival: 303ms MemoryUsage(500.000ms): 581.02 KB, 216.75 MB, 215.93 MB, 218.24 MB, 217.82 MB, 216.42 MB, 216.42 MB, 216.42 MB, 216.42 MB, 216.42 MB, 216.42 MB, 216.99 MB, 217.63 MB, 216.99 MB, 217.07 MB, 217.59 MB, 216.90 MB, 217.31 MB, 217.20 MB, 217.21 MB, 216.76 MB, 208.85 MB, 208.97 MB, 201.22 MB, 193.28 MB, 193.00 MB, 192.96 MB, 193.09 MB, 193.18 MB, 169.23 MB, 169.28 MB, 161.32 MB, 145.59 MB, 145.48 MB, 137.49 MB, 137.45 MB, 121.40 MB, 121.49 MB, 121.60 MB, 121.32 MB, 121.39 MB, 121.44 MB, 121.38 MB, 121.47 MB, 93.05 MB, 91.85 MB, 91.96 MB, 67.93 MB, 60.12 MB, 52.04 MB, 26.48 MB, 2.35 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.88 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 218.60 MB (229221071) - PerHostPeakMemUsage: 983.49 MB (1031260943) - RowsProduced: 13.11M (13114528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19s799ms - TotalStorageWaitTime: 112.490ms - TotalThreadsInvoluntaryContextSwitches: 1.77K (1774) - TotalThreadsTotalWallClockTime: 1m40s - TotalThreadsSysTime: 292.953ms - TotalThreadsUserTime: 10s479ms - TotalThreadsVoluntaryContextSwitches: 15.68K (15678) Fragment Instance Lifecycle Timings: - ExecTime: 25s722ms - ExecTreeExecTime: 357.437ms - OpenTime: 39.812ms - ExecTreeOpenTime: 107.201us - PrepareTime: 36.883ms - ExecTreePrepareTime: 368.990us DataStreamSender (dst_id=20):(Total: 2s337ms, non-child: 2s337ms, % non-child: 100.00%) - BytesSent: 310.65 MB (325739318) - OverallThroughput: 132.92 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 13.11M (13114528) - SerializeBatchTime: 2s332ms - UncompressedRowBatchSize: 310.65 MB (325739318) CodeGen:(Total: 71.699ms, non-child: 71.699ms, % non-child: 100.00%) - CodegenTime: 1.806ms - CompileTime: 8.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 30.208ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.424ms HDFS_SCAN_NODE (id=1):(Total: 347.299ms, non-child: 347.299ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:3/641.32 MB 0:1/83.89 MB 5:1/186.47 MB 4:3/762.02 MB 3:4/552.27 MB 1:3/512.61 MB 6:4/632.74 MB 7:3/238.66 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 241ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB, 187.17 MB - FooterProcessingTime: (Avg: 3.255ms ; Min: 2.634ms ; Max: 4.444ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.94 - BytesRead: 187.17 MB (196262502) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.17 MB (196262502) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.17 MB (196262502) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 661.240ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 214.53 MB (224945990) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.477ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 13.11M (13114528) - RowsReturned: 13.11M (13114528) - RowsReturnedRate: 37.76 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 918 (918) - ScannerThreadsTotalWallClockTime: 1m14s - MaterializeTupleTime(*): 1s103ms - ScannerThreadsSysTime: 98.983ms - ScannerThreadsUserTime: 5s082ms - ScannerThreadsVoluntaryContextSwitches: 13.68K (13683) - TotalRawHdfsReadTime(*): 172.097ms - TotalReadThroughput: 7.34 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 12.81K (12808) - RowGroups rejected: 0 (0) - RowGroups total: 12.81K (12808) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 13.11M (13114528) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000014d (host=foo.221.43:22000):(Total: 25s485ms, non-child: 22s877ms, % non-child: 89.77%) Hdfs split stats (:<# splits>/): 1:4/568.88 MB 2:2/32.62 MB 3:2/508.06 MB 6:4/925.98 MB 4:2/348.53 MB 7:2/333.71 MB 0:3/458.10 MB 5:2/369.05 MB Filter 4 arrival: 1s554ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 85.92 MB, 86.21 MB, 85.27 MB, 84.36 MB, 84.56 MB, 83.91 MB, 84.11 MB, 85.31 MB, 85.02 MB, 84.53 MB, 84.19 MB, 84.35 MB, 76.37 MB, 76.22 MB, 76.98 MB, 76.63 MB, 77.37 MB, 69.27 MB, 61.13 MB, 61.20 MB, 61.04 MB, 61.10 MB, 53.11 MB, 53.11 MB, 52.63 MB, 53.04 MB, 53.36 MB, 52.67 MB, 52.96 MB, 53.08 MB, 52.80 MB, 53.20 MB, 52.87 MB, 44.87 MB, 44.94 MB, 37.06 MB, 37.06 MB, 37.21 MB, 37.06 MB, 37.03 MB, 29.02 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.12 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 86.35 MB (90539541) - PerHostPeakMemUsage: 802.36 MB (841336405) - RowsProduced: 4.98M (4979927) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s023ms - TotalStorageWaitTime: 41.431ms - TotalThreadsInvoluntaryContextSwitches: 9.44K (9435) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 34s779ms - TotalThreadsUserTime: 43s778ms - TotalThreadsVoluntaryContextSwitches: 4.50M (4500133) Fragment Instance Lifecycle Timings: - ExecTime: 25s414ms - ExecTreeExecTime: 1s578ms - OpenTime: 39.806ms - ExecTreeOpenTime: 81.888us - PrepareTime: 31.640ms - ExecTreePrepareTime: 372.458us DataStreamSender (dst_id=20):(Total: 965.455ms, non-child: 965.455ms, % non-child: 100.00%) - BytesSent: 113.63 MB (119146521) - OverallThroughput: 117.69 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.98M (4979927) - SerializeBatchTime: 963.361ms - UncompressedRowBatchSize: 113.63 MB (119146521) CodeGen:(Total: 67.688ms, non-child: 67.688ms, % non-child: 100.00%) - CodegenTime: 1.180ms - CompileTime: 7.007ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 31.851ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.323ms HDFS_SCAN_NODE (id=1):(Total: 1s574ms, non-child: 1s574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:4/568.88 MB 2:2/32.62 MB 3:2/508.06 MB 6:4/925.98 MB 4:2/348.53 MB 7:2/333.71 MB 0:3/458.10 MB 5:2/369.05 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 1s485ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB, 68.55 MB - FooterProcessingTime: (Avg: 3.079ms ; Min: 3.079ms ; Max: 3.079ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.77 - BytesRead: 68.55 MB (71877999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.55 MB (71877999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.55 MB (71877999) - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 252.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 82.27 MB (86261837) - PerReadThreadRawHdfsThroughput: 860.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 50.339ms - RowBatchQueuePutWaitTime: 19s347ms - RowsRead: 4.98M (4979927) - RowsReturned: 4.98M (4979927) - RowsReturnedRate: 3.16 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 9.04K (9045) - ScannerThreadsTotalWallClockTime: 1m43s - MaterializeTupleTime(*): 499.242ms - ScannerThreadsSysTime: 34s659ms - ScannerThreadsUserTime: 41s512ms - ScannerThreadsVoluntaryContextSwitches: 4.50M (4498611) - TotalRawHdfsReadTime(*): 79.663ms - TotalReadThroughput: 3.12 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 20 (20) - Files total: 21 (21) - RowGroups processed: 4.86K (4864) - RowGroups rejected: 0 (0) - RowGroups total: 4.86K (4864) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 4.98M (4979927) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce1800000128 (host=foo.187.54:22000):(Total: 25s148ms, non-child: 21s248ms, % non-child: 84.49%) Hdfs split stats (:<# splits>/): 1:1/254.20 MB 3:4/780.68 MB 2:2/432.08 MB 0:3/546.88 MB 7:3/396.63 MB 4:2/341.59 MB 6:4/608.50 MB 5:1/116.51 MB Filter 4 arrival: 1s940ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 177.64 MB, 178.35 MB, 178.37 MB, 177.43 MB, 177.73 MB, 178.39 MB, 177.45 MB, 178.57 MB, 178.25 MB, 178.28 MB, 178.07 MB, 178.41 MB, 177.58 MB, 178.34 MB, 178.16 MB, 177.82 MB, 178.17 MB, 177.84 MB, 170.47 MB, 170.39 MB, 169.96 MB, 153.94 MB, 154.20 MB, 154.38 MB, 154.27 MB, 154.04 MB, 154.24 MB, 124.01 MB, 114.68 MB, 114.68 MB, 98.73 MB, 99.00 MB, 99.02 MB, 90.95 MB, 91.01 MB, 83.00 MB, 83.06 MB, 82.73 MB, 83.06 MB, 82.99 MB, 54.32 MB, 53.40 MB, 37.64 MB, 37.48 MB, 37.35 MB, 2.58 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.70 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 179.54 MB (188260579) - PerHostPeakMemUsage: 776.94 MB (814679614) - RowsProduced: 10.44M (10441471) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s233ms - TotalStorageWaitTime: 127.902ms - TotalThreadsInvoluntaryContextSwitches: 2.32K (2322) - TotalThreadsTotalWallClockTime: 1m33s - TotalThreadsSysTime: 656.899ms - TotalThreadsUserTime: 16s870ms - TotalThreadsVoluntaryContextSwitches: 61.55K (61551) Fragment Instance Lifecycle Timings: - ExecTime: 25s096ms - ExecTreeExecTime: 2s017ms - OpenTime: 23.814ms - ExecTreeOpenTime: 62.491us - PrepareTime: 27.746ms - ExecTreePrepareTime: 323.976us DataStreamSender (dst_id=20):(Total: 1s842ms, non-child: 1s842ms, % non-child: 100.00%) - BytesSent: 245.04 MB (256943367) - OverallThroughput: 132.97 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.44M (10441471) - SerializeBatchTime: 1s839ms - UncompressedRowBatchSize: 245.04 MB (256943367) CodeGen:(Total: 48.482ms, non-child: 48.482ms, % non-child: 100.00%) - CodegenTime: 1.068ms - CompileTime: 6.445ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.682ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.930ms HDFS_SCAN_NODE (id=1):(Total: 2s008ms, non-child: 2s008ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/254.20 MB 3:4/780.68 MB 2:2/432.08 MB 0:3/546.88 MB 7:3/396.63 MB 4:2/341.59 MB 6:4/608.50 MB 5:1/116.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s907ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 0, 0, 0, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB, 148.04 MB - FooterProcessingTime: (Avg: 3.743ms ; Min: 2.923ms ; Max: 4.498ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.76 - BytesRead: 148.04 MB (155230663) - BytesReadDataNodeCache: 0 - BytesReadLocal: 148.04 MB (155230663) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 148.04 MB (155230663) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 523.404ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 175.53 MB (184053113) - PerReadThreadRawHdfsThroughput: 878.12 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.044ms - RowBatchQueuePutWaitTime: 55s155ms - RowsRead: 10.44M (10441471) - RowsReturned: 10.44M (10441471) - RowsReturnedRate: 5.20 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 1.62K (1621) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 998.729ms - ScannerThreadsSysTime: 494.924ms - ScannerThreadsUserTime: 12s553ms - ScannerThreadsVoluntaryContextSwitches: 58.97K (58971) - TotalRawHdfsReadTime(*): 168.586ms - TotalReadThroughput: 6.04 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 17 (17) - Files total: 20 (20) - RowGroups processed: 10.20K (10198) - RowGroups rejected: 0 (0) - RowGroups total: 10.20K (10198) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 10.44M (10441471) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000017b (host=foo.221.25:22000):(Total: 25s103ms, non-child: 22s500ms, % non-child: 89.63%) Hdfs split stats (:<# splits>/): 1:4/846.51 MB 5:1/226.42 MB 4:1/28.86 MB 7:3/351.45 MB 2:3/344.03 MB 0:3/344.02 MB 3:2/324.06 MB 6:4/887.96 MB Filter 4 arrival: 1s762ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 86.79 MB, 89.35 MB, 87.64 MB, 87.75 MB, 88.73 MB, 88.12 MB, 87.38 MB, 87.31 MB, 87.52 MB, 87.41 MB, 87.21 MB, 87.90 MB, 88.87 MB, 87.91 MB, 88.40 MB, 87.54 MB, 74.65 MB, 73.96 MB, 73.22 MB, 74.14 MB, 74.15 MB, 73.24 MB, 73.94 MB, 73.31 MB, 48.48 MB, 47.28 MB, 47.24 MB, 39.18 MB, 39.55 MB, 39.14 MB, 39.14 MB, 39.26 MB, 39.22 MB, 39.15 MB, 31.18 MB, 31.41 MB, 6.61 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB, 2.59 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.90 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 89.59 MB (93938868) - PerHostPeakMemUsage: 790.48 MB (828876805) - RowsProduced: 4.34M (4344416) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s765ms - TotalStorageWaitTime: 70.069ms - TotalThreadsInvoluntaryContextSwitches: 6.17K (6174) - TotalThreadsTotalWallClockTime: 2m3s - TotalThreadsSysTime: 16s798ms - TotalThreadsUserTime: 36s822ms - TotalThreadsVoluntaryContextSwitches: 1.53M (1532190) Fragment Instance Lifecycle Timings: - ExecTime: 25s051ms - ExecTreeExecTime: 1s767ms - OpenTime: 24.615ms - ExecTreeOpenTime: 80.451us - PrepareTime: 28.165ms - ExecTreePrepareTime: 241.484us DataStreamSender (dst_id=20):(Total: 789.134ms, non-child: 789.134ms, % non-child: 100.00%) - BytesSent: 100.78 MB (105678751) - OverallThroughput: 127.71 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.34M (4344416) - SerializeBatchTime: 787.577ms - UncompressedRowBatchSize: 100.78 MB (105678751) CodeGen:(Total: 49.339ms, non-child: 49.339ms, % non-child: 100.00%) - CodegenTime: 1.248ms - CompileTime: 6.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.214ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.036ms HDFS_SCAN_NODE (id=1):(Total: 1s764ms, non-child: 1s764ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:4/846.51 MB 5:1/226.42 MB 4:1/28.86 MB 7:3/351.45 MB 2:3/344.03 MB 0:3/344.02 MB 3:2/324.06 MB 6:4/887.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s726ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 0, 0, 0, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB, 62.30 MB - FooterProcessingTime: (Avg: 2.762ms ; Min: 2.502ms ; Max: 3.053ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.76 - BytesRead: 62.30 MB (65324186) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.30 MB (65324186) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.30 MB (65324186) - CachedFileHandlesHitCount: 23 (23) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 215.526ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 85.51 MB (89664428) - PerReadThreadRawHdfsThroughput: 712.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.437ms - RowBatchQueuePutWaitTime: 37s743ms - RowsRead: 4.34M (4344416) - RowsReturned: 4.34M (4344416) - RowsReturnedRate: 2.46 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 5.81K (5814) - ScannerThreadsTotalWallClockTime: 1m38s - MaterializeTupleTime(*): 364.757ms - ScannerThreadsSysTime: 16s719ms - ScannerThreadsUserTime: 34s972ms - ScannerThreadsVoluntaryContextSwitches: 1.53M (1530764) - TotalRawHdfsReadTime(*): 87.408ms - TotalReadThroughput: 3.04 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 17 (17) - Files total: 21 (21) - RowGroups processed: 4.25K (4245) - RowGroups rejected: 0 (0) - RowGroups total: 4.25K (4245) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 4.34M (4344416) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000017e (host=foo.234.52:22000):(Total: 25s024ms, non-child: 22s109ms, % non-child: 88.35%) Hdfs split stats (:<# splits>/): 7:1/97.41 MB 0:1/242.60 MB 5:1/170.46 MB 6:3/571.74 MB 2:1/9.72 MB 4:4/684.69 MB 3:2/507.84 MB 1:5/881.99 MB Filter 4 arrival: 416ms MemoryUsage(500.000ms): 581.02 KB, 243.56 MB, 245.05 MB, 243.39 MB, 244.38 MB, 244.45 MB, 243.60 MB, 243.54 MB, 244.18 MB, 243.80 MB, 244.08 MB, 243.78 MB, 244.18 MB, 243.83 MB, 243.68 MB, 243.70 MB, 243.83 MB, 243.82 MB, 243.97 MB, 220.23 MB, 212.15 MB, 212.19 MB, 212.29 MB, 211.97 MB, 211.97 MB, 211.95 MB, 211.96 MB, 212.26 MB, 212.19 MB, 212.19 MB, 203.84 MB, 180.33 MB, 156.32 MB, 148.54 MB, 148.49 MB, 148.28 MB, 148.45 MB, 132.58 MB, 104.59 MB, 104.54 MB, 104.73 MB, 84.00 MB, 82.96 MB, 82.95 MB, 53.52 MB, 45.48 MB, 37.43 MB, 29.36 MB, 2.38 MB, 2.38 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 4.76 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 245.42 MB (257338907) - PerHostPeakMemUsage: 965.91 MB (1012832990) - RowsProduced: 14.28M (14280240) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s530ms - TotalStorageWaitTime: 128.709ms - TotalThreadsInvoluntaryContextSwitches: 2.51K (2508) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 2s722ms - TotalThreadsUserTime: 14s966ms - TotalThreadsVoluntaryContextSwitches: 235.41K (235413) Fragment Instance Lifecycle Timings: - ExecTime: 24s973ms - ExecTreeExecTime: 501.192ms - OpenTime: 24.884ms - ExecTreeOpenTime: 77.895us - PrepareTime: 26.770ms - ExecTreePrepareTime: 296.403us DataStreamSender (dst_id=20):(Total: 2s377ms, non-child: 2s377ms, % non-child: 100.00%) - BytesSent: 339.61 MB (356102815) - OverallThroughput: 142.86 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 14.28M (14280240) - SerializeBatchTime: 2s372ms - UncompressedRowBatchSize: 339.61 MB (356102815) CodeGen:(Total: 47.821ms, non-child: 47.821ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 6.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.177ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.282ms HDFS_SCAN_NODE (id=1):(Total: 490.797ms, non-child: 490.797ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/97.41 MB 0:1/242.60 MB 5:1/170.46 MB 6:3/571.74 MB 2:1/9.72 MB 4:4/684.69 MB 3:2/507.84 MB 1:5/881.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 381ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:14 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB, 204.94 MB - FooterProcessingTime: (Avg: 3.064ms ; Min: 2.711ms ; Max: 4.034ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 204.94 MB (214898060) - BytesReadDataNodeCache: 0 - BytesReadLocal: 204.94 MB (214898060) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 204.94 MB (214898060) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 729.219ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 241.40 MB (253130333) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.880ms - RowBatchQueuePutWaitTime: 1m21s - RowsRead: 14.28M (14280240) - RowsReturned: 14.28M (14280240) - RowsReturnedRate: 29.10 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.68K (1684) - ScannerThreadsTotalWallClockTime: 1m34s - MaterializeTupleTime(*): 1s189ms - ScannerThreadsSysTime: 2s552ms - ScannerThreadsUserTime: 9s450ms - ScannerThreadsVoluntaryContextSwitches: 233.19K (233189) - TotalRawHdfsReadTime(*): 197.588ms - TotalReadThroughput: 8.54 MB/sec Filter 4 (8.00 KB): - Files processed: 18 (18) - Files rejected: 14 (14) - Files total: 18 (18) - RowGroups processed: 13.95K (13949) - RowGroups rejected: 0 (0) - RowGroups total: 13.95K (13949) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 14.28M (14280240) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000012b (host=foo.234.41:22000):(Total: 24s724ms, non-child: 21s472ms, % non-child: 86.85%) Hdfs split stats (:<# splits>/): 0:1/202.93 MB 2:6/1.03 GB 5:1/96.08 MB 1:2/362.04 MB 7:5/838.77 MB 4:3/278.97 MB 3:2/165.83 MB 6:4/490.68 MB Filter 4 arrival: 544ms MemoryUsage(500.000ms): 581.02 KB, 261.21 MB, 262.51 MB, 262.53 MB, 261.77 MB, 262.08 MB, 261.87 MB, 262.42 MB, 262.34 MB, 261.87 MB, 243.94 MB, 243.82 MB, 243.79 MB, 243.86 MB, 243.78 MB, 243.87 MB, 244.00 MB, 243.67 MB, 244.08 MB, 244.08 MB, 244.08 MB, 219.84 MB, 219.96 MB, 212.16 MB, 212.38 MB, 212.02 MB, 211.90 MB, 189.65 MB, 164.78 MB, 164.91 MB, 156.77 MB, 148.83 MB, 140.91 MB, 140.76 MB, 141.02 MB, 125.04 MB, 117.27 MB, 117.24 MB, 96.63 MB, 95.47 MB, 95.69 MB, 95.68 MB, 95.37 MB, 87.61 MB, 63.59 MB, 63.68 MB, 29.12 MB, 2.59 MB, 2.59 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 5.16 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 263.81 MB (276625017) - PerHostPeakMemUsage: 923.85 MB (968727773) - RowsProduced: 15.27M (15266559) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17s363ms - TotalStorageWaitTime: 163.243ms - TotalThreadsInvoluntaryContextSwitches: 3.60K (3601) - TotalThreadsTotalWallClockTime: 2m6s - TotalThreadsSysTime: 1s024ms - TotalThreadsUserTime: 26s914ms - TotalThreadsVoluntaryContextSwitches: 128.63K (128630) Fragment Instance Lifecycle Timings: - ExecTime: 24s670ms - ExecTreeExecTime: 630.954ms - OpenTime: 28.101ms - ExecTreeOpenTime: 113.175us - PrepareTime: 25.671ms - ExecTreePrepareTime: 532.757us DataStreamSender (dst_id=20):(Total: 2s581ms, non-child: 2s581ms, % non-child: 100.00%) - BytesSent: 362.42 MB (380026205) - OverallThroughput: 140.40 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 15.27M (15266559) - SerializeBatchTime: 2s575ms - UncompressedRowBatchSize: 362.42 MB (380026205) CodeGen:(Total: 50.222ms, non-child: 50.222ms, % non-child: 100.00%) - CodegenTime: 1.143ms - CompileTime: 7.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.805ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.479ms HDFS_SCAN_NODE (id=1):(Total: 619.738ms, non-child: 619.738ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/202.93 MB 2:6/1.03 GB 5:1/96.08 MB 1:2/362.04 MB 7:5/838.77 MB 4:3/278.97 MB 3:2/165.83 MB 6:4/490.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 501ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB, 217.49 MB - FooterProcessingTime: (Avg: 3.142ms ; Min: 2.701ms ; Max: 4.432ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.34 - BytesRead: 217.49 MB (228056686) - BytesReadDataNodeCache: 0 - BytesReadLocal: 217.49 MB (228056686) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 217.49 MB (228056686) - CachedFileHandlesHitCount: 44 (44) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 781.633ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 259.77 MB (272390265) - PerReadThreadRawHdfsThroughput: 873.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.175ms - RowBatchQueuePutWaitTime: 1m19s - RowsRead: 15.27M (15266559) - RowsReturned: 15.27M (15266559) - RowsReturnedRate: 24.63 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.75K (2746) - ScannerThreadsTotalWallClockTime: 1m41s - MaterializeTupleTime(*): 1s300ms - ScannerThreadsSysTime: 796.876ms - ScannerThreadsUserTime: 20s916ms - ScannerThreadsVoluntaryContextSwitches: 126.67K (126674) - TotalRawHdfsReadTime(*): 248.878ms - TotalReadThroughput: 9.25 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 19 (19) - Files total: 24 (24) - RowGroups processed: 14.91K (14912) - RowGroups rejected: 0 (0) - RowGroups total: 14.91K (14912) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 15.27M (15266559) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce180000016b (host=foo.232.36:22000):(Total: 24s056ms, non-child: 22s195ms, % non-child: 92.26%) Hdfs split stats (:<# splits>/): 4:2/282.29 MB 6:3/448.26 MB 3:2/228.55 MB 5:4/512.54 MB 7:4/568.33 MB 1:3/396.01 MB 2:1/253.83 MB 0:4/651.91 MB Filter 4 arrival: 723ms MemoryUsage(500.000ms): 581.02 KB, 107.49 MB, 109.38 MB, 108.72 MB, 108.93 MB, 107.16 MB, 108.01 MB, 108.25 MB, 107.56 MB, 107.56 MB, 108.82 MB, 108.78 MB, 107.50 MB, 108.60 MB, 108.53 MB, 108.67 MB, 107.71 MB, 107.85 MB, 107.95 MB, 87.01 MB, 85.74 MB, 85.40 MB, 85.77 MB, 78.01 MB, 77.87 MB, 69.98 MB, 69.58 MB, 69.59 MB, 69.70 MB, 49.28 MB, 48.46 MB, 48.46 MB, 48.43 MB, 40.40 MB, 40.30 MB, 32.23 MB, 32.29 MB, 24.42 MB, 24.32 MB, 24.59 MB, 5.68 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.44 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 109.60 MB (114926554) - PerHostPeakMemUsage: 751.42 MB (787916016) - RowsProduced: 5.72M (5721960) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19s988ms - TotalStorageWaitTime: 72.955ms - TotalThreadsInvoluntaryContextSwitches: 2.22K (2219) - TotalThreadsTotalWallClockTime: 1m22s - TotalThreadsSysTime: 1s559ms - TotalThreadsUserTime: 17s117ms - TotalThreadsVoluntaryContextSwitches: 85.46K (85460) Fragment Instance Lifecycle Timings: - ExecTime: 23s998ms - ExecTreeExecTime: 748.745ms - OpenTime: 25.950ms - ExecTreeOpenTime: 64.647us - PrepareTime: 32.057ms - ExecTreePrepareTime: 578.719us DataStreamSender (dst_id=20):(Total: 1s061ms, non-child: 1s061ms, % non-child: 100.00%) - BytesSent: 134.14 MB (140660570) - OverallThroughput: 126.32 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.72M (5721960) - SerializeBatchTime: 1s059ms - UncompressedRowBatchSize: 134.14 MB (140660570) CodeGen:(Total: 54.284ms, non-child: 54.284ms, % non-child: 100.00%) - CodegenTime: 1.239ms - CompileTime: 7.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.390ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.175ms HDFS_SCAN_NODE (id=1):(Total: 744.612ms, non-child: 744.612ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/282.29 MB 6:3/448.26 MB 3:2/228.55 MB 5:4/512.54 MB 7:4/568.33 MB 1:3/396.01 MB 2:1/253.83 MB 0:4/651.91 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 682ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB, 81.57 MB - FooterProcessingTime: (Avg: 3.438ms ; Min: 2.455ms ; Max: 4.299ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.85 - BytesRead: 81.57 MB (85527281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.57 MB (85527281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.57 MB (85527281) - CachedFileHandlesHitCount: 20 (20) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 301.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 105.50 MB (110621326) - PerReadThreadRawHdfsThroughput: 766.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.223ms - RowBatchQueuePutWaitTime: 41s956ms - RowsRead: 5.72M (5721960) - RowsReturned: 5.72M (5721960) - RowsReturnedRate: 7.68 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 1.85K (1846) - ScannerThreadsTotalWallClockTime: 58s238ms - MaterializeTupleTime(*): 511.825ms - ScannerThreadsSysTime: 1s428ms - ScannerThreadsUserTime: 14s683ms - ScannerThreadsVoluntaryContextSwitches: 84.08K (84078) - TotalRawHdfsReadTime(*): 106.373ms - TotalReadThroughput: 3.98 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 20 (20) - Files total: 23 (23) - RowGroups processed: 5.59K (5589) - RowGroups rejected: 0 (0) - RowGroups total: 5.59K (5589) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 5.72M (5721960) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000011a (host=foo.221.23:22000):(Total: 23s946ms, non-child: 21s173ms, % non-child: 88.42%) Hdfs split stats (:<# splits>/): 5:1/98.99 MB 2:1/131.89 MB 1:3/590.19 MB 7:3/323.52 MB 3:5/636.33 MB 6:2/507.80 MB 0:3/376.87 MB 4:3/725.75 MB Filter 4 arrival: 1s788ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 91.93 MB, 92.01 MB, 92.00 MB, 92.27 MB, 93.43 MB, 93.36 MB, 92.85 MB, 92.39 MB, 93.21 MB, 93.52 MB, 84.41 MB, 79.13 MB, 78.56 MB, 78.11 MB, 79.07 MB, 79.20 MB, 78.13 MB, 78.44 MB, 78.44 MB, 78.40 MB, 79.00 MB, 78.90 MB, 78.64 MB, 78.91 MB, 63.22 MB, 62.39 MB, 62.95 MB, 63.08 MB, 62.98 MB, 62.81 MB, 62.71 MB, 62.48 MB, 40.39 MB, 39.41 MB, 31.43 MB, 23.56 MB, 23.27 MB, 23.27 MB, 6.87 MB, 2.66 MB, 2.66 MB, 2.66 MB, 2.66 MB, 2.66 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 3.38 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 94.60 MB (99195399) - PerHostPeakMemUsage: 818.97 MB (858754569) - RowsProduced: 5.08M (5084197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19s546ms - TotalStorageWaitTime: 67.744ms - TotalThreadsInvoluntaryContextSwitches: 2.34K (2344) - TotalThreadsTotalWallClockTime: 1m22s - TotalThreadsSysTime: 1s124ms - TotalThreadsUserTime: 18s938ms - TotalThreadsVoluntaryContextSwitches: 65.03K (65025) Fragment Instance Lifecycle Timings: - ExecTime: 23s886ms - ExecTreeExecTime: 1s804ms - OpenTime: 24.590ms - ExecTreeOpenTime: 82.757us - PrepareTime: 35.335ms - ExecTreePrepareTime: 290.889us DataStreamSender (dst_id=20):(Total: 920.056ms, non-child: 920.056ms, % non-child: 100.00%) - BytesSent: 118.53 MB (124288324) - OverallThroughput: 128.83 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.08M (5084197) - SerializeBatchTime: 917.923ms - UncompressedRowBatchSize: 118.53 MB (124288324) CodeGen:(Total: 52.534ms, non-child: 52.534ms, % non-child: 100.00%) - CodegenTime: 1.209ms - CompileTime: 6.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.056ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.550ms HDFS_SCAN_NODE (id=1):(Total: 1s800ms, non-child: 1s800ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/98.99 MB 2:1/131.89 MB 1:3/590.19 MB 7:3/323.52 MB 3:5/636.33 MB 6:2/507.80 MB 0:3/376.87 MB 4:3/725.75 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s748ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 0, 0, 0, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB, 72.55 MB - FooterProcessingTime: (Avg: 3.200ms ; Min: 3.121ms ; Max: 3.314ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.65 - BytesRead: 72.55 MB (76069030) - BytesReadDataNodeCache: 0 - BytesReadLocal: 72.55 MB (76069030) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 72.55 MB (76069030) - CachedFileHandlesHitCount: 19 (19) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 270.271ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 90.48 MB (94877245) - PerReadThreadRawHdfsThroughput: 812.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.181ms - RowBatchQueuePutWaitTime: 40s336ms - RowsRead: 5.08M (5084197) - RowsReturned: 5.08M (5084197) - RowsReturnedRate: 2.82 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 1.97K (1970) - ScannerThreadsTotalWallClockTime: 58s273ms - MaterializeTupleTime(*): 457.745ms - ScannerThreadsSysTime: 1s023ms - ScannerThreadsUserTime: 16s783ms - ScannerThreadsVoluntaryContextSwitches: 63.35K (63349) - TotalRawHdfsReadTime(*): 89.293ms - TotalReadThroughput: 3.37 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 18 (18) - Files total: 21 (21) - RowGroups processed: 4.97K (4967) - RowGroups rejected: 0 (0) - RowGroups total: 4.97K (4967) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 5.08M (5084197) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000159 (host=foo.232.46:22000):(Total: 23s580ms, non-child: 21s673ms, % non-child: 91.91%) Hdfs split stats (:<# splits>/): 0:2/446.34 MB 1:1/254.00 MB 2:1/254.01 MB 7:4/672.87 MB 6:5/797.00 MB 4:2/114.32 MB 3:3/88.95 MB 5:6/822.24 MB Filter 4 arrival: 792ms MemoryUsage(500.000ms): 576.41 KB, 581.02 KB, 86.94 MB, 89.42 MB, 88.91 MB, 88.91 MB, 89.20 MB, 88.30 MB, 88.86 MB, 87.98 MB, 87.43 MB, 88.34 MB, 88.34 MB, 88.25 MB, 88.71 MB, 87.99 MB, 88.03 MB, 87.99 MB, 87.62 MB, 87.54 MB, 88.11 MB, 88.23 MB, 88.24 MB, 87.79 MB, 80.01 MB, 72.28 MB, 71.89 MB, 72.55 MB, 72.42 MB, 72.49 MB, 72.49 MB, 72.54 MB, 71.95 MB, 64.54 MB, 41.42 MB, 40.47 MB, 40.45 MB, 32.43 MB, 32.48 MB, 32.20 MB, 24.45 MB, 24.31 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB, 2.42 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.67 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 89.73 MB (94084375) - PerHostPeakMemUsage: 766.16 MB (803379438) - RowsProduced: 5.05M (5046985) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19s623ms - TotalStorageWaitTime: 77.010ms - TotalThreadsInvoluntaryContextSwitches: 916 (916) - TotalThreadsTotalWallClockTime: 1m3s - TotalThreadsSysTime: 180.971ms - TotalThreadsUserTime: 6s874ms - TotalThreadsVoluntaryContextSwitches: 6.32K (6316) Fragment Instance Lifecycle Timings: - ExecTime: 23s524ms - ExecTreeExecTime: 831.835ms - OpenTime: 25.643ms - ExecTreeOpenTime: 83.395us - PrepareTime: 30.449ms - ExecTreePrepareTime: 317.825us DataStreamSender (dst_id=20):(Total: 1s027ms, non-child: 1s027ms, % non-child: 100.00%) - BytesSent: 118.71 MB (124471682) - OverallThroughput: 115.54 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.05M (5046985) - SerializeBatchTime: 1s024ms - UncompressedRowBatchSize: 118.71 MB (124471682) CodeGen:(Total: 52.728ms, non-child: 52.728ms, % non-child: 100.00%) - CodegenTime: 1.255ms - CompileTime: 7.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.371ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.729ms HDFS_SCAN_NODE (id=1):(Total: 826.945ms, non-child: 826.945ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/446.34 MB 1:1/254.00 MB 2:1/254.01 MB 7:4/672.87 MB 6:5/797.00 MB 4:2/114.32 MB 3:3/88.95 MB 5:6/822.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 743ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB, 72.80 MB - FooterProcessingTime: (Avg: 2.910ms ; Min: 2.884ms ; Max: 2.935ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.95 - BytesRead: 72.80 MB (76334210) - BytesReadDataNodeCache: 0 - BytesReadLocal: 72.80 MB (76334210) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 72.80 MB (76334210) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 265.409ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 85.65 MB (89808233) - PerReadThreadRawHdfsThroughput: 682.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 44.950ms - RowBatchQueuePutWaitTime: 35s016ms - RowsRead: 5.05M (5046985) - RowsReturned: 5.05M (5046985) - RowsReturnedRate: 6.10 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 510 (510) - ScannerThreadsTotalWallClockTime: 39s572ms - MaterializeTupleTime(*): 458.491ms - ScannerThreadsSysTime: 43.992ms - ScannerThreadsUserTime: 4s473ms - ScannerThreadsVoluntaryContextSwitches: 4.76K (4764) - TotalRawHdfsReadTime(*): 106.613ms - TotalReadThroughput: 3.47 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 22 (22) - Files total: 24 (24) - RowGroups processed: 4.93K (4930) - RowGroups rejected: 0 (0) - RowGroups total: 4.93K (4930) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.05M (5046985) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000175 (host=foo.232.18:22000):(Total: 23s225ms, non-child: 20s930ms, % non-child: 90.12%) Hdfs split stats (:<# splits>/): 2:3/607.50 MB 0:1/146.77 MB 5:5/1.11 GB 7:3/646.42 MB 1:2/508.11 MB 4:2/417.99 MB Filter 4 arrival: 1s263ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 80.98 MB, 80.29 MB, 81.43 MB, 81.64 MB, 81.31 MB, 81.71 MB, 73.33 MB, 74.04 MB, 72.80 MB, 73.85 MB, 73.87 MB, 73.82 MB, 65.04 MB, 57.02 MB, 57.73 MB, 57.18 MB, 57.61 MB, 49.70 MB, 49.76 MB, 49.59 MB, 49.41 MB, 49.30 MB, 49.37 MB, 49.33 MB, 49.25 MB, 49.23 MB, 49.20 MB, 49.57 MB, 49.52 MB, 49.59 MB, 41.26 MB, 41.63 MB, 41.63 MB, 33.59 MB, 33.56 MB, 25.33 MB, 25.38 MB, 4.20 MB, 2.54 MB, 2.54 MB, 2.54 MB, 2.54 MB, 2.54 MB, 2.54 MB ThreadUsage(500.000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.79 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 82.82 MB (86845771) - PerHostPeakMemUsage: 789.95 MB (828326498) - RowsProduced: 4.75M (4745172) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18s916ms - TotalStorageWaitTime: 38.513ms - TotalThreadsInvoluntaryContextSwitches: 527 (527) - TotalThreadsTotalWallClockTime: 41s592ms - TotalThreadsSysTime: 135.979ms - TotalThreadsUserTime: 2s934ms - TotalThreadsVoluntaryContextSwitches: 5.42K (5418) Fragment Instance Lifecycle Timings: - ExecTime: 23s148ms - ExecTreeExecTime: 1s283ms - OpenTime: 36.394ms - ExecTreeOpenTime: 73.623us - PrepareTime: 39.800ms - ExecTreePrepareTime: 298.599us DataStreamSender (dst_id=20):(Total: 942.061ms, non-child: 942.061ms, % non-child: 100.00%) - BytesSent: 110.92 MB (116312214) - OverallThroughput: 117.75 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.75M (4745172) - SerializeBatchTime: 939.773ms - UncompressedRowBatchSize: 110.92 MB (116312214) CodeGen:(Total: 72.631ms, non-child: 72.631ms, % non-child: 100.00%) - CodegenTime: 1.472ms - CompileTime: 6.479ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 28.665ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 36.687ms HDFS_SCAN_NODE (id=1):(Total: 1s279ms, non-child: 1s279ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:3/607.50 MB 0:1/146.77 MB 5:5/1.11 GB 7:3/646.42 MB 1:2/508.11 MB 4:2/417.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 1s204ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB, 67.74 MB - FooterProcessingTime: (Avg: 3.667ms ; Min: 3.667ms ; Max: 3.667ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.90 - BytesRead: 67.74 MB (71029885) - BytesReadDataNodeCache: 0 - BytesReadLocal: 67.74 MB (71029885) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 67.74 MB (71029885) - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 239.966ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.77 MB (82592677) - PerReadThreadRawHdfsThroughput: 859.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.853ms - RowBatchQueuePutWaitTime: 17s675ms - RowsRead: 4.75M (4745172) - RowsReturned: 4.75M (4745172) - RowsReturnedRate: 3.71 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 157 (157) - ScannerThreadsTotalWallClockTime: 18s406ms - MaterializeTupleTime(*): 403.337ms - ScannerThreadsSysTime: 32.994ms - ScannerThreadsUserTime: 685.895ms - ScannerThreadsVoluntaryContextSwitches: 3.87K (3866) - TotalRawHdfsReadTime(*): 78.851ms - TotalReadThroughput: 3.30 MB/sec Filter 4 (8.00 KB): - Files processed: 16 (16) - Files rejected: 15 (15) - Files total: 16 (16) - RowGroups processed: 4.63K (4634) - RowGroups rejected: 0 (0) - RowGroups total: 4.63K (4634) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 4.75M (4745172) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce1800000185 (host=foo.187.56:22000):(Total: 22s723ms, non-child: 19s234ms, % non-child: 84.65%) Hdfs split stats (:<# splits>/): 6:2/339.67 MB 1:2/319.49 MB 7:2/332.92 MB 3:4/504.02 MB 0:5/724.58 MB 2:2/178.86 MB 5:5/874.08 MB 4:2/302.02 MB Filter 4 arrival: 1s870ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 153.00 MB, 152.64 MB, 152.89 MB, 154.06 MB, 154.17 MB, 152.28 MB, 153.77 MB, 152.86 MB, 153.67 MB, 153.12 MB, 153.42 MB, 152.63 MB, 152.95 MB, 152.75 MB, 153.07 MB, 131.45 MB, 130.87 MB, 130.71 MB, 130.40 MB, 114.87 MB, 114.83 MB, 114.53 MB, 106.78 MB, 98.88 MB, 90.95 MB, 82.96 MB, 83.01 MB, 82.87 MB, 67.05 MB, 67.01 MB, 67.05 MB, 50.47 MB, 49.22 MB, 49.45 MB, 49.60 MB, 49.24 MB, 33.51 MB, 33.42 MB, 25.31 MB, 2.38 MB, 2.38 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 3.60 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 154.61 MB (162117380) - PerHostPeakMemUsage: 855.29 MB (896840391) - RowsProduced: 8.97M (8970394) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s974ms - TotalStorageWaitTime: 77.438ms - TotalThreadsInvoluntaryContextSwitches: 2.55K (2551) - TotalThreadsTotalWallClockTime: 1m20s - TotalThreadsSysTime: 1s005ms - TotalThreadsUserTime: 19s354ms - TotalThreadsVoluntaryContextSwitches: 59.46K (59461) Fragment Instance Lifecycle Timings: - ExecTime: 22s666ms - ExecTreeExecTime: 1s912ms - OpenTime: 27.581ms - ExecTreeOpenTime: 78.632us - PrepareTime: 29.166ms - ExecTreePrepareTime: 362.721us DataStreamSender (dst_id=20):(Total: 1s529ms, non-child: 1s529ms, % non-child: 100.00%) - BytesSent: 210.70 MB (220937532) - OverallThroughput: 137.74 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.97M (8970394) - SerializeBatchTime: 1s526ms - UncompressedRowBatchSize: 210.70 MB (220937532) CodeGen:(Total: 53.442ms, non-child: 53.442ms, % non-child: 100.00%) - CodegenTime: 1.244ms - CompileTime: 8.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.777ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.181ms HDFS_SCAN_NODE (id=1):(Total: 1s905ms, non-child: 1s905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/339.67 MB 1:2/319.49 MB 7:2/332.92 MB 3:4/504.02 MB 0:5/724.58 MB 2:2/178.86 MB 5:5/874.08 MB 4:2/302.02 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 1s826ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 0, 0, 0, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB, 127.28 MB - FooterProcessingTime: (Avg: 3.142ms ; Min: 3.025ms ; Max: 3.313ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.72 - BytesRead: 127.28 MB (133464723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.28 MB (133464723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.28 MB (133464723) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 462.090ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 150.51 MB (157824177) - PerReadThreadRawHdfsThroughput: 906.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 27.246ms - RowBatchQueuePutWaitTime: 41s569ms - RowsRead: 8.97M (8970394) - RowsReturned: 8.97M (8970394) - RowsReturnedRate: 4.71 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 2.01K (2010) - ScannerThreadsTotalWallClockTime: 58s292ms - MaterializeTupleTime(*): 763.222ms - ScannerThreadsSysTime: 841.870ms - ScannerThreadsUserTime: 15s811ms - ScannerThreadsVoluntaryContextSwitches: 57.63K (57626) - TotalRawHdfsReadTime(*): 140.367ms - TotalReadThroughput: 5.92 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 21 (21) - Files total: 24 (24) - RowGroups processed: 8.76K (8762) - RowGroups rejected: 0 (0) - RowGroups total: 8.76K (8762) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.97M (8970394) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000013e (host=foo.187.42:22000):(Total: 22s513ms, non-child: 18s629ms, % non-child: 82.75%) Hdfs split stats (:<# splits>/): 4:1/80.72 MB 1:2/439.15 MB 6:1/148.40 MB 7:1/17.79 MB 5:6/1021.56 MB 3:4/730.18 MB 2:2/452.52 MB 0:4/775.82 MB Filter 4 arrival: 2s158ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 153.18 MB, 153.07 MB, 152.79 MB, 150.92 MB, 152.09 MB, 151.18 MB, 151.28 MB, 151.34 MB, 151.34 MB, 151.34 MB, 151.40 MB, 135.64 MB, 135.72 MB, 135.35 MB, 135.52 MB, 135.60 MB, 135.62 MB, 119.74 MB, 119.62 MB, 111.91 MB, 104.04 MB, 103.83 MB, 103.75 MB, 88.00 MB, 88.00 MB, 88.03 MB, 88.03 MB, 87.87 MB, 88.09 MB, 88.09 MB, 88.17 MB, 87.94 MB, 88.08 MB, 88.05 MB, 56.15 MB, 55.99 MB, 56.14 MB, 56.11 MB, 48.29 MB, 40.19 MB, 8.50 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.78 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 153.22 MB (160667092) - PerHostPeakMemUsage: 775.14 MB (812787996) - RowsProduced: 9.35M (9346800) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s252ms - TotalStorageWaitTime: 58.207ms - TotalThreadsInvoluntaryContextSwitches: 893 (893) - TotalThreadsTotalWallClockTime: 1m2s - TotalThreadsSysTime: 229.965ms - TotalThreadsUserTime: 5s252ms - TotalThreadsVoluntaryContextSwitches: 10.98K (10977) Fragment Instance Lifecycle Timings: - ExecTime: 22s448ms - ExecTreeExecTime: 2s204ms - OpenTime: 27.574ms - ExecTreeOpenTime: 74.990us - PrepareTime: 37.690ms - ExecTreePrepareTime: 391.936us DataStreamSender (dst_id=20):(Total: 1s625ms, non-child: 1s625ms, % non-child: 100.00%) - BytesSent: 221.96 MB (232745611) - OverallThroughput: 136.56 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.35M (9346800) - SerializeBatchTime: 1s622ms - UncompressedRowBatchSize: 221.96 MB (232745611) CodeGen:(Total: 61.213ms, non-child: 61.213ms, % non-child: 100.00%) - CodegenTime: 1.983ms - CompileTime: 6.767ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.542ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.301ms HDFS_SCAN_NODE (id=1):(Total: 2s197ms, non-child: 2s197ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/80.72 MB 1:2/439.15 MB 6:1/148.40 MB 7:1/17.79 MB 5:6/1021.56 MB 3:4/730.18 MB 2:2/452.52 MB 0:4/775.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s107ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB, 135.60 MB - FooterProcessingTime: (Avg: 3.236ms ; Min: 2.962ms ; Max: 3.509ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 135.60 MB (142183859) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.60 MB (142183859) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.60 MB (142183859) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 464.544ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 149.15 MB (156391121) - PerReadThreadRawHdfsThroughput: 1000.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.782ms - RowBatchQueuePutWaitTime: 38s630ms - RowsRead: 9.35M (9346800) - RowsReturned: 9.35M (9346800) - RowsReturnedRate: 4.25 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 317 (317) - ScannerThreadsTotalWallClockTime: 40s130ms - MaterializeTupleTime(*): 767.319ms - ScannerThreadsSysTime: 80.987ms - ScannerThreadsUserTime: 1s433ms - ScannerThreadsVoluntaryContextSwitches: 9.09K (9093) - TotalRawHdfsReadTime(*): 135.582ms - TotalReadThroughput: 6.03 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 19 (19) - Files total: 21 (21) - RowGroups processed: 9.13K (9129) - RowGroups rejected: 0 (0) - RowGroups total: 9.13K (9129) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.35M (9346800) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000014c (host=foo.234.42:22000):(Total: 22s367ms, non-child: 19s560ms, % non-child: 87.45%) Hdfs split stats (:<# splits>/): 5:1/51.02 MB 2:1/46.91 MB 0:5/638.00 MB 7:3/406.09 MB 4:2/316.51 MB 3:2/401.42 MB 1:5/924.09 MB 6:3/546.11 MB Filter 4 arrival: 559ms MemoryUsage(500.000ms): 581.02 KB, 204.85 MB, 204.41 MB, 203.73 MB, 203.49 MB, 204.00 MB, 203.95 MB, 203.20 MB, 203.76 MB, 203.83 MB, 203.83 MB, 203.74 MB, 203.25 MB, 203.61 MB, 203.24 MB, 203.62 MB, 179.76 MB, 179.37 MB, 179.75 MB, 179.89 MB, 179.54 MB, 171.83 MB, 163.59 MB, 155.55 MB, 155.66 MB, 147.77 MB, 147.81 MB, 139.79 MB, 131.91 MB, 123.93 MB, 95.91 MB, 95.89 MB, 95.85 MB, 95.88 MB, 95.81 MB, 95.77 MB, 95.84 MB, 96.00 MB, 95.84 MB, 80.04 MB, 63.92 MB, 64.09 MB, 56.10 MB, 29.27 MB, 2.47 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.87 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 205.10 MB (215066808) - PerHostPeakMemUsage: 939.08 MB (984698753) - RowsProduced: 12.31M (12313551) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s460ms - TotalStorageWaitTime: 81.276ms - TotalThreadsInvoluntaryContextSwitches: 2.00K (2003) - TotalThreadsTotalWallClockTime: 1m26s - TotalThreadsSysTime: 556.914ms - TotalThreadsUserTime: 13s628ms - TotalThreadsVoluntaryContextSwitches: 45.81K (45807) Fragment Instance Lifecycle Timings: - ExecTime: 22s309ms - ExecTreeExecTime: 620.360ms - OpenTime: 23.887ms - ExecTreeOpenTime: 86.591us - PrepareTime: 34.444ms - ExecTreePrepareTime: 364.577us DataStreamSender (dst_id=20):(Total: 2s144ms, non-child: 2s144ms, % non-child: 100.00%) - BytesSent: 290.85 MB (304973378) - OverallThroughput: 135.60 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.31M (12313551) - SerializeBatchTime: 2s140ms - UncompressedRowBatchSize: 290.85 MB (304973378) CodeGen:(Total: 52.518ms, non-child: 52.518ms, % non-child: 100.00%) - CodegenTime: 1.365ms - CompileTime: 6.315ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.644ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.903ms HDFS_SCAN_NODE (id=1):(Total: 609.484ms, non-child: 609.484ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/51.02 MB 2:1/46.91 MB 0:5/638.00 MB 7:3/406.09 MB 4:2/316.51 MB 3:2/401.42 MB 1:5/924.09 MB 6:3/546.11 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 502ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB, 174.32 MB - FooterProcessingTime: (Avg: 2.971ms ; Min: 2.926ms ; Max: 3.043ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.93 - BytesRead: 174.32 MB (182782816) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.32 MB (182782816) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.32 MB (182782816) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 640.448ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 201.03 MB (210790116) - PerReadThreadRawHdfsThroughput: 930.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.209ms - RowBatchQueuePutWaitTime: 54s822ms - RowsRead: 12.31M (12313551) - RowsReturned: 12.31M (12313551) - RowsReturnedRate: 20.20 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1238) - ScannerThreadsTotalWallClockTime: 1m3s - MaterializeTupleTime(*): 1s059ms - ScannerThreadsSysTime: 366.943ms - ScannerThreadsUserTime: 8s538ms - ScannerThreadsVoluntaryContextSwitches: 43.68K (43681) - TotalRawHdfsReadTime(*): 187.286ms - TotalReadThroughput: 7.92 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 12.03K (12027) - RowGroups rejected: 0 (0) - RowGroups total: 12.03K (12027) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.31M (12313551) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000131 (host=foo.234.49:22000):(Total: 22s046ms, non-child: 19s027ms, % non-child: 86.31%) Hdfs split stats (:<# splits>/): 5:1/253.89 MB 4:3/557.50 MB 6:1/30.14 MB 7:1/186.19 MB 0:4/654.52 MB 2:5/693.01 MB 3:2/456.64 MB 1:4/673.00 MB Filter 4 arrival: 447ms MemoryUsage(500.000ms): 581.02 KB, 241.51 MB, 242.96 MB, 242.72 MB, 241.36 MB, 241.65 MB, 241.48 MB, 241.56 MB, 241.78 MB, 242.17 MB, 242.19 MB, 242.06 MB, 241.90 MB, 241.96 MB, 223.62 MB, 223.79 MB, 223.69 MB, 223.12 MB, 223.58 MB, 223.47 MB, 223.68 MB, 223.66 MB, 191.61 MB, 191.66 MB, 191.66 MB, 191.80 MB, 191.72 MB, 191.72 MB, 191.64 MB, 169.15 MB, 152.39 MB, 136.48 MB, 120.33 MB, 120.27 MB, 104.72 MB, 84.10 MB, 83.20 MB, 83.05 MB, 82.94 MB, 82.85 MB, 82.98 MB, 37.37 MB, 29.70 MB, 2.42 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1 - AverageThreadTokens: 5.27 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 243.29 MB (255106996) - PerHostPeakMemUsage: 973.33 MB (1020606732) - RowsProduced: 14.19M (14188328) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s287ms - TotalStorageWaitTime: 155.399ms - TotalThreadsInvoluntaryContextSwitches: 3.03K (3034) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 3s563ms - TotalThreadsUserTime: 18s920ms - TotalThreadsVoluntaryContextSwitches: 333.45K (333449) Fragment Instance Lifecycle Timings: - ExecTime: 21s990ms - ExecTreeExecTime: 521.768ms - OpenTime: 24.627ms - ExecTreeOpenTime: 68.631us - PrepareTime: 31.269ms - ExecTreePrepareTime: 297.746us DataStreamSender (dst_id=20):(Total: 2s456ms, non-child: 2s456ms, % non-child: 100.00%) - BytesSent: 337.00 MB (353374073) - OverallThroughput: 137.18 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 14.19M (14188328) - SerializeBatchTime: 2s451ms - UncompressedRowBatchSize: 337.00 MB (353374073) CodeGen:(Total: 52.205ms, non-child: 52.205ms, % non-child: 100.00%) - CodegenTime: 1.120ms - CompileTime: 6.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.987ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.778ms HDFS_SCAN_NODE (id=1):(Total: 510.458ms, non-child: 510.458ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.89 MB 4:3/557.50 MB 6:1/30.14 MB 7:1/186.19 MB 0:4/654.52 MB 2:5/693.01 MB 3:2/456.64 MB 1:4/673.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 401ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:24 BytesRead(500.000ms): 0, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB, 203.92 MB - FooterProcessingTime: (Avg: 2.854ms ; Min: 1.839ms ; Max: 4.349ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.37 - BytesRead: 203.92 MB (213820535) - BytesReadDataNodeCache: 0 - BytesReadLocal: 203.92 MB (213820535) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 203.92 MB (213820535) - CachedFileHandlesHitCount: 46 (46) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 727.922ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 239.27 MB (250896356) - PerReadThreadRawHdfsThroughput: 914.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.235ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 14.19M (14188328) - RowsReturned: 14.19M (14188328) - RowsReturnedRate: 27.80 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 2.12K (2125) - ScannerThreadsTotalWallClockTime: 1m33s - MaterializeTupleTime(*): 1s248ms - ScannerThreadsSysTime: 3s272ms - ScannerThreadsUserTime: 13s272ms - ScannerThreadsVoluntaryContextSwitches: 331.32K (331318) - TotalRawHdfsReadTime(*): 222.938ms - TotalReadThroughput: 9.48 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 15 (15) - Files total: 21 (21) - RowGroups processed: 13.86K (13859) - RowGroups rejected: 0 (0) - RowGroups total: 13.86K (13859) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 14.19M (14188328) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce1800000140 (host=foo.234.47:22000):(Total: 21s905ms, non-child: 19s309ms, % non-child: 88.15%) Hdfs split stats (:<# splits>/): 0:1/253.95 MB 2:4/724.35 MB 3:3/464.72 MB 4:2/123.71 MB 7:2/92.11 MB 5:5/886.10 MB 1:5/840.47 MB Filter 4 arrival: 433ms MemoryUsage(500.000ms): 581.02 KB, 208.11 MB, 206.33 MB, 207.11 MB, 206.42 MB, 205.93 MB, 206.06 MB, 196.28 MB, 196.59 MB, 196.48 MB, 196.90 MB, 196.37 MB, 196.82 MB, 196.89 MB, 196.85 MB, 196.84 MB, 196.63 MB, 188.84 MB, 180.62 MB, 146.28 MB, 145.16 MB, 145.18 MB, 145.25 MB, 145.33 MB, 145.21 MB, 145.20 MB, 145.06 MB, 145.24 MB, 137.25 MB, 121.24 MB, 113.28 MB, 113.36 MB, 97.33 MB, 97.32 MB, 78.83 MB, 62.11 MB, 62.09 MB, 62.09 MB, 62.18 MB, 62.07 MB, 62.03 MB, 8.55 MB, 2.59 MB, 2.59 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 4.64 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 208.11 MB (218219048) - PerHostPeakMemUsage: 934.21 MB (979593833) - RowsProduced: 11.48M (11477133) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s061ms - TotalStorageWaitTime: 117.434ms - TotalThreadsInvoluntaryContextSwitches: 2.49K (2487) - TotalThreadsTotalWallClockTime: 1m42s - TotalThreadsSysTime: 656.898ms - TotalThreadsUserTime: 18s073ms - TotalThreadsVoluntaryContextSwitches: 30.24K (30241) Fragment Instance Lifecycle Timings: - ExecTime: 21s847ms - ExecTreeExecTime: 481.160ms - OpenTime: 24.407ms - ExecTreeOpenTime: 69.711us - PrepareTime: 32.839ms - ExecTreePrepareTime: 386.026us DataStreamSender (dst_id=20):(Total: 2s072ms, non-child: 2s072ms, % non-child: 100.00%) - BytesSent: 272.01 MB (285227477) - OverallThroughput: 131.24 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.48M (11477133) - SerializeBatchTime: 2s067ms - UncompressedRowBatchSize: 272.01 MB (285227477) CodeGen:(Total: 52.664ms, non-child: 52.664ms, % non-child: 100.00%) - CodegenTime: 1.112ms - CompileTime: 6.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.983ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.661ms HDFS_SCAN_NODE (id=1):(Total: 470.638ms, non-child: 470.638ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/253.95 MB 2:4/724.35 MB 3:3/464.72 MB 4:2/123.71 MB 7:2/92.11 MB 5:5/886.10 MB 1:5/840.47 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 381ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB, 164.62 MB - FooterProcessingTime: (Avg: 2.506ms ; Min: 2.201ms ; Max: 3.331ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.81 - BytesRead: 164.62 MB (172615545) - BytesReadDataNodeCache: 0 - BytesReadLocal: 164.62 MB (172615545) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 164.62 MB (172615545) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 598.851ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 204.02 MB (213931181) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.736ms - RowBatchQueuePutWaitTime: 1m6s - RowsRead: 11.48M (11477133) - RowsReturned: 11.48M (11477133) - RowsReturnedRate: 24.39 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.74K (1743) - ScannerThreadsTotalWallClockTime: 1m20s - MaterializeTupleTime(*): 1s016ms - ScannerThreadsSysTime: 443.930ms - ScannerThreadsUserTime: 13s277ms - ScannerThreadsVoluntaryContextSwitches: 28.48K (28475) - TotalRawHdfsReadTime(*): 153.623ms - TotalReadThroughput: 7.84 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 17 (17) - Files total: 22 (22) - RowGroups processed: 11.21K (11211) - RowGroups rejected: 0 (0) - RowGroups total: 11.21K (11211) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 11.48M (11477133) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000152 (host=foo.221.37:22000):(Total: 21s882ms, non-child: 19s375ms, % non-child: 88.55%) Hdfs split stats (:<# splits>/): 3:2/507.96 MB 1:3/192.95 MB 5:3/435.87 MB 4:3/177.25 MB 2:3/587.61 MB 6:2/281.03 MB 0:5/338.38 MB 7:7/1.09 GB Filter 4 arrival: 1s546ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 106.56 MB, 105.50 MB, 105.02 MB, 104.58 MB, 104.80 MB, 94.46 MB, 91.96 MB, 91.75 MB, 91.42 MB, 92.26 MB, 91.62 MB, 91.61 MB, 92.22 MB, 92.43 MB, 92.12 MB, 91.68 MB, 92.39 MB, 91.94 MB, 92.07 MB, 91.89 MB, 92.22 MB, 92.06 MB, 92.22 MB, 92.22 MB, 91.86 MB, 91.88 MB, 91.91 MB, 92.11 MB, 65.79 MB, 64.66 MB, 48.49 MB, 29.61 MB, 7.42 MB, 4.93 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB, 2.26 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 4.86 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 107.06 MB (112261883) - PerHostPeakMemUsage: 774.75 MB (812382943) - RowsProduced: 4.89M (4888353) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17s789ms - TotalStorageWaitTime: 97.051ms - TotalThreadsInvoluntaryContextSwitches: 3.66K (3662) - TotalThreadsTotalWallClockTime: 1m46s - TotalThreadsSysTime: 3s648ms - TotalThreadsUserTime: 28s851ms - TotalThreadsVoluntaryContextSwitches: 339.83K (339830) Fragment Instance Lifecycle Timings: - ExecTime: 21s819ms - ExecTreeExecTime: 1s538ms - OpenTime: 29.809ms - ExecTreeOpenTime: 92.077us - PrepareTime: 32.553ms - ExecTreePrepareTime: 479.031us DataStreamSender (dst_id=20):(Total: 913.037ms, non-child: 913.037ms, % non-child: 100.00%) - BytesSent: 116.43 MB (122086376) - OverallThroughput: 127.52 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.89M (4888353) - SerializeBatchTime: 910.911ms - UncompressedRowBatchSize: 116.43 MB (122086376) CodeGen:(Total: 58.703ms, non-child: 58.703ms, % non-child: 100.00%) - CodegenTime: 1.132ms - CompileTime: 6.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 21.827ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.828ms HDFS_SCAN_NODE (id=1):(Total: 1s534ms, non-child: 1s534ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/507.96 MB 1:3/192.95 MB 5:3/435.87 MB 4:3/177.25 MB 2:3/587.61 MB 6:2/281.03 MB 0:5/338.38 MB 7:7/1.09 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 1s486ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 0, 0, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB, 70.79 MB - FooterProcessingTime: (Avg: 3.033ms ; Min: 2.529ms ; Max: 4.304ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.59 - BytesRead: 70.79 MB (74228447) - BytesReadDataNodeCache: 0 - BytesReadLocal: 70.79 MB (74228447) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 70.79 MB (74228447) - CachedFileHandlesHitCount: 27 (27) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 245.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 103.01 MB (108017706) - PerReadThreadRawHdfsThroughput: 794.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.785ms - RowBatchQueuePutWaitTime: 50s055ms - RowsRead: 4.89M (4888353) - RowsReturned: 4.89M (4888353) - RowsReturnedRate: 3.19 M/sec - ScanRangesComplete: 28 (28) - ScannerThreadsInvoluntaryContextSwitches: 3.33K (3333) - ScannerThreadsTotalWallClockTime: 1m25s - MaterializeTupleTime(*): 446.060ms - ScannerThreadsSysTime: 3s537ms - ScannerThreadsUserTime: 26s684ms - ScannerThreadsVoluntaryContextSwitches: 338.26K (338261) - TotalRawHdfsReadTime(*): 89.065ms - TotalReadThroughput: 3.83 MB/sec Filter 4 (8.00 KB): - Files processed: 28 (28) - Files rejected: 23 (23) - Files total: 28 (28) - RowGroups processed: 4.78K (4776) - RowGroups rejected: 0 (0) - RowGroups total: 4.78K (4776) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 4.89M (4888353) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000182 (host=foo.234.40:22000):(Total: 21s813ms, non-child: 19s043ms, % non-child: 87.30%) Hdfs split stats (:<# splits>/): 5:1/254.01 MB 7:3/565.65 MB 4:3/500.27 MB 1:3/453.45 MB 6:4/523.70 MB 3:3/371.17 MB 2:2/334.55 MB 0:3/550.21 MB Filter 4 arrival: 563ms MemoryUsage(500.000ms): 581.02 KB, 198.32 MB, 199.37 MB, 199.74 MB, 200.49 MB, 200.13 MB, 200.20 MB, 198.96 MB, 199.37 MB, 199.39 MB, 199.88 MB, 199.28 MB, 199.66 MB, 199.70 MB, 199.46 MB, 199.47 MB, 191.47 MB, 175.59 MB, 175.76 MB, 175.83 MB, 175.82 MB, 175.63 MB, 175.63 MB, 175.58 MB, 151.71 MB, 151.74 MB, 151.74 MB, 127.94 MB, 127.90 MB, 127.85 MB, 120.00 MB, 92.04 MB, 92.04 MB, 91.88 MB, 92.01 MB, 92.11 MB, 91.87 MB, 92.00 MB, 67.99 MB, 60.01 MB, 60.23 MB, 52.19 MB, 44.19 MB, 2.49 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1 - AverageThreadTokens: 5.39 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 201.08 MB (210846789) - PerHostPeakMemUsage: 899.94 MB (943657625) - RowsProduced: 12.21M (12214559) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s076ms - TotalStorageWaitTime: 90.855ms - TotalThreadsInvoluntaryContextSwitches: 5.16K (5160) - TotalThreadsTotalWallClockTime: 1m57s - TotalThreadsSysTime: 6s416ms - TotalThreadsUserTime: 36s015ms - TotalThreadsVoluntaryContextSwitches: 609.56K (609561) Fragment Instance Lifecycle Timings: - ExecTime: 21s752ms - ExecTreeExecTime: 634.405ms - OpenTime: 27.933ms - ExecTreeOpenTime: 68.411us - PrepareTime: 32.774ms - ExecTreePrepareTime: 426.031us DataStreamSender (dst_id=20):(Total: 2s086ms, non-child: 2s086ms, % non-child: 100.00%) - BytesSent: 290.26 MB (304360140) - OverallThroughput: 139.08 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.21M (12214559) - SerializeBatchTime: 2s082ms - UncompressedRowBatchSize: 290.26 MB (304360140) CodeGen:(Total: 57.202ms, non-child: 57.202ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 7.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.646ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.871ms HDFS_SCAN_NODE (id=1):(Total: 625.780ms, non-child: 625.780ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/254.01 MB 7:3/565.65 MB 4:3/500.27 MB 1:3/453.45 MB 6:4/523.70 MB 3:3/371.17 MB 2:2/334.55 MB 0:3/550.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB, 174.43 MB - FooterProcessingTime: (Avg: 2.631ms ; Min: 2.601ms ; Max: 2.661ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.49 - BytesRead: 174.43 MB (182904746) - BytesReadDataNodeCache: 0 - BytesReadLocal: 174.43 MB (182904746) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 174.43 MB (182904746) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 620.157ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 197.03 MB (206596077) - PerReadThreadRawHdfsThroughput: 940.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.022ms - RowBatchQueuePutWaitTime: 54s853ms - RowsRead: 12.21M (12214559) - RowsReturned: 12.21M (12214559) - RowsReturnedRate: 19.52 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 4.44K (4438) - ScannerThreadsTotalWallClockTime: 1m35s - MaterializeTupleTime(*): 1s013ms - ScannerThreadsSysTime: 6s245ms - ScannerThreadsUserTime: 31s186ms - ScannerThreadsVoluntaryContextSwitches: 608.07K (608065) - TotalRawHdfsReadTime(*): 185.496ms - TotalReadThroughput: 8.11 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 11.93K (11929) - RowGroups rejected: 0 (0) - RowGroups total: 11.93K (11929) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.21M (12214559) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000112 (host=foo.187.47:22000):(Total: 21s746ms, non-child: 18s034ms, % non-child: 82.93%) Hdfs split stats (:<# splits>/): 0:2/470.62 MB 3:1/5.42 MB 7:3/676.37 MB 5:5/915.64 MB 4:5/896.47 MB 6:3/547.26 MB Filter 4 arrival: 2s227ms MemoryUsage(500.000ms): 568.41 KB, 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 134.22 MB, 134.38 MB, 135.56 MB, 133.90 MB, 135.55 MB, 135.27 MB, 134.97 MB, 135.16 MB, 134.75 MB, 134.85 MB, 134.93 MB, 134.97 MB, 118.98 MB, 118.93 MB, 118.53 MB, 118.87 MB, 110.91 MB, 94.90 MB, 86.84 MB, 86.93 MB, 86.58 MB, 86.90 MB, 86.65 MB, 86.66 MB, 71.08 MB, 70.97 MB, 71.02 MB, 70.94 MB, 50.38 MB, 49.61 MB, 49.34 MB, 49.57 MB, 41.45 MB, 33.46 MB, 25.50 MB, 4.31 MB, 2.73 MB, 2.73 MB, 2.73 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1 - AverageThreadTokens: 5.43 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 136.21 MB (142825823) - PerHostPeakMemUsage: 792.09 MB (830571004) - RowsProduced: 7.87M (7870838) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s941ms - TotalStorageWaitTime: 66.838ms - TotalThreadsInvoluntaryContextSwitches: 6.99K (6989) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 19s055ms - TotalThreadsUserTime: 39s213ms - TotalThreadsVoluntaryContextSwitches: 1.83M (1834748) Fragment Instance Lifecycle Timings: - ExecTime: 21s682ms - ExecTreeExecTime: 2s266ms - OpenTime: 30.820ms - ExecTreeOpenTime: 95.387us - PrepareTime: 33.016ms - ExecTreePrepareTime: 272.394us DataStreamSender (dst_id=20):(Total: 1s392ms, non-child: 1s392ms, % non-child: 100.00%) - BytesSent: 186.32 MB (195368558) - OverallThroughput: 133.77 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.87M (7870838) - SerializeBatchTime: 1s390ms - UncompressedRowBatchSize: 186.32 MB (195368558) CodeGen:(Total: 59.104ms, non-child: 59.104ms, % non-child: 100.00%) - CodegenTime: 1.338ms - CompileTime: 7.018ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.543ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.986ms HDFS_SCAN_NODE (id=1):(Total: 2s259ms, non-child: 2s259ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/470.62 MB 3:1/5.42 MB 7:3/676.37 MB 5:5/915.64 MB 4:5/896.47 MB 6:3/547.26 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s168ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:17 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 0, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB, 113.66 MB - FooterProcessingTime: (Avg: 3.413ms ; Min: 3.221ms ; Max: 3.605ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.88 - BytesRead: 113.66 MB (119180689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 113.66 MB (119180689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 113.66 MB (119180689) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 391.525ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.15 MB (138565758) - PerReadThreadRawHdfsThroughput: 870.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.226ms - RowBatchQueuePutWaitTime: 30s480ms - RowsRead: 7.87M (7870838) - RowsReturned: 7.87M (7870838) - RowsReturnedRate: 3.48 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6.49K (6489) - ScannerThreadsTotalWallClockTime: 1m37s - MaterializeTupleTime(*): 662.038ms - ScannerThreadsSysTime: 18s881ms - ScannerThreadsUserTime: 35s917ms - ScannerThreadsVoluntaryContextSwitches: 1.83M (1832897) - TotalRawHdfsReadTime(*): 130.557ms - TotalReadThroughput: 5.54 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 17 (17) - Files total: 19 (19) - RowGroups processed: 7.69K (7688) - RowGroups rejected: 0 (0) - RowGroups total: 7.69K (7688) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.87M (7870838) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000157 (host=foo.187.53:22000):(Total: 21s678ms, non-child: 17s822ms, % non-child: 82.21%) Hdfs split stats (:<# splits>/): 3:2/206.27 MB 4:2/190.48 MB 6:3/559.60 MB 5:3/418.39 MB 7:3/180.46 MB 0:6/632.95 MB 2:4/357.98 MB 1:4/706.55 MB Filter 4 arrival: 1s873ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 857.02 KB, 186.09 MB, 186.09 MB, 186.67 MB, 186.44 MB, 186.40 MB, 186.05 MB, 187.06 MB, 186.80 MB, 186.55 MB, 168.80 MB, 168.43 MB, 167.82 MB, 168.16 MB, 167.89 MB, 167.71 MB, 168.18 MB, 168.11 MB, 151.97 MB, 144.09 MB, 144.09 MB, 144.13 MB, 144.01 MB, 144.31 MB, 144.24 MB, 120.23 MB, 112.34 MB, 104.49 MB, 96.57 MB, 96.48 MB, 69.05 MB, 61.00 MB, 61.06 MB, 61.08 MB, 61.07 MB, 61.02 MB, 39.56 MB, 39.51 MB, 7.68 MB, 2.36 MB ThreadUsage(500.000ms): 1, 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 4.53 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 187.93 MB (197060140) - PerHostPeakMemUsage: 838.76 MB (879508012) - RowsProduced: 10.82M (10818114) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s120ms - TotalStorageWaitTime: 116.283ms - TotalThreadsInvoluntaryContextSwitches: 3.18K (3183) - TotalThreadsTotalWallClockTime: 1m37s - TotalThreadsSysTime: 1s860ms - TotalThreadsUserTime: 23s767ms - TotalThreadsVoluntaryContextSwitches: 254.22K (254218) Fragment Instance Lifecycle Timings: - ExecTime: 21s627ms - ExecTreeExecTime: 1s931ms - OpenTime: 22.511ms - ExecTreeOpenTime: 75.948us - PrepareTime: 28.602ms - ExecTreePrepareTime: 349.870us DataStreamSender (dst_id=20):(Total: 1s888ms, non-child: 1s888ms, % non-child: 100.00%) - BytesSent: 255.78 MB (268201732) - OverallThroughput: 135.46 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.82M (10818114) - SerializeBatchTime: 1s884ms - UncompressedRowBatchSize: 255.78 MB (268201732) CodeGen:(Total: 44.777ms, non-child: 44.777ms, % non-child: 100.00%) - CodegenTime: 1.096ms - CompileTime: 6.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.633ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.595ms HDFS_SCAN_NODE (id=1):(Total: 1s923ms, non-child: 1s923ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/206.27 MB 4:2/190.48 MB 6:3/559.60 MB 5:3/418.39 MB 7:3/180.46 MB 0:6/632.95 MB 2:4/357.98 MB 1:4/706.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 1s827ms Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:0% 2:2.381% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 0, 0, 0, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB, 154.78 MB - FooterProcessingTime: (Avg: 4.630ms ; Min: 2.525ms ; Max: 10.143ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 3.62 - BytesRead: 154.78 MB (162298855) - BytesReadDataNodeCache: 0 - BytesReadLocal: 154.78 MB (162298855) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 154.78 MB (162298855) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 545.259ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 183.89 MB (192824799) - PerReadThreadRawHdfsThroughput: 977.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.079ms - RowBatchQueuePutWaitTime: 54s652ms - RowsRead: 10.82M (10818114) - RowsReturned: 10.82M (10818114) - RowsReturnedRate: 5.62 M/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 2.50K (2495) - ScannerThreadsTotalWallClockTime: 1m16s - MaterializeTupleTime(*): 906.689ms - ScannerThreadsSysTime: 1s675ms - ScannerThreadsUserTime: 19s365ms - ScannerThreadsVoluntaryContextSwitches: 252.09K (252088) - TotalRawHdfsReadTime(*): 158.338ms - TotalReadThroughput: 7.37 MB/sec Filter 4 (8.00 KB): - Files processed: 27 (27) - Files rejected: 23 (23) - Files total: 27 (27) - RowGroups processed: 10.57K (10566) - RowGroups rejected: 0 (0) - RowGroups total: 10.57K (10566) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 10.82M (10818114) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000149 (host=foo.234.48:22000):(Total: 21s534ms, non-child: 18s625ms, % non-child: 86.49%) Hdfs split stats (:<# splits>/): 7:1/82.53 MB 6:3/563.23 MB 3:2/507.81 MB 5:1/7.96 MB 0:2/235.20 MB 1:4/517.03 MB 4:1/215.35 MB 2:8/1.49 GB Filter 4 arrival: 437ms MemoryUsage(500.000ms): 581.02 KB, 206.02 MB, 207.19 MB, 205.83 MB, 206.76 MB, 206.09 MB, 206.95 MB, 206.52 MB, 206.84 MB, 206.52 MB, 206.27 MB, 206.24 MB, 206.99 MB, 206.78 MB, 198.36 MB, 182.88 MB, 182.51 MB, 182.79 MB, 182.79 MB, 182.59 MB, 182.60 MB, 182.62 MB, 182.73 MB, 174.66 MB, 158.77 MB, 150.86 MB, 135.04 MB, 134.87 MB, 111.03 MB, 111.05 MB, 95.58 MB, 95.48 MB, 95.64 MB, 95.48 MB, 95.48 MB, 87.72 MB, 71.73 MB, 63.76 MB, 63.80 MB, 55.77 MB, 6.25 MB, 2.45 MB, 2.45 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 3.72 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 208.10 MB (218211922) - PerHostPeakMemUsage: 925.84 MB (970808723) - RowsProduced: 12.76M (12762378) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15s301ms - TotalStorageWaitTime: 96.337ms - TotalThreadsInvoluntaryContextSwitches: 1.76K (1761) - TotalThreadsTotalWallClockTime: 1m21s - TotalThreadsSysTime: 373.943ms - TotalThreadsUserTime: 12s531ms - TotalThreadsVoluntaryContextSwitches: 16.20K (16204) Fragment Instance Lifecycle Timings: - ExecTime: 21s478ms - ExecTreeExecTime: 617.646ms - OpenTime: 23.275ms - ExecTreeOpenTime: 77.111us - PrepareTime: 32.807ms - ExecTreePrepareTime: 552.836us DataStreamSender (dst_id=20):(Total: 2s248ms, non-child: 2s248ms, % non-child: 100.00%) - BytesSent: 299.45 MB (313993946) - OverallThroughput: 133.17 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.76M (12762378) - SerializeBatchTime: 2s243ms - UncompressedRowBatchSize: 299.45 MB (313993946) CodeGen:(Total: 52.549ms, non-child: 52.549ms, % non-child: 100.00%) - CodegenTime: 1.231ms - CompileTime: 5.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.411ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.668ms HDFS_SCAN_NODE (id=1):(Total: 607.499ms, non-child: 607.499ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/82.53 MB 6:3/563.23 MB 3:2/507.81 MB 5:1/7.96 MB 0:2/235.20 MB 1:4/517.03 MB 4:1/215.35 MB 2:8/1.49 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 402ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB, 179.05 MB - FooterProcessingTime: (Avg: 2.504ms ; Min: 2.410ms ; Max: 2.583ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.85 - BytesRead: 179.05 MB (187751591) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.05 MB (187751591) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.05 MB (187751591) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 670.108ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 204.03 MB (213936426) - PerReadThreadRawHdfsThroughput: 964.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.768ms - RowBatchQueuePutWaitTime: 52s321ms - RowsRead: 12.76M (12762378) - RowsReturned: 12.76M (12762378) - RowsReturnedRate: 21.01 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.00K (1000) - ScannerThreadsTotalWallClockTime: 59s769ms - MaterializeTupleTime(*): 1s114ms - ScannerThreadsSysTime: 126.980ms - ScannerThreadsUserTime: 7s322ms - ScannerThreadsVoluntaryContextSwitches: 14.40K (14399) - TotalRawHdfsReadTime(*): 185.585ms - TotalReadThroughput: 8.73 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 12.46K (12465) - RowGroups rejected: 0 (0) - RowGroups total: 12.46K (12465) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.76M (12762378) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000016d (host=foo.232.14:22000):(Total: 20s885ms, non-child: 18s817ms, % non-child: 90.10%) Hdfs split stats (:<# splits>/): 5:3/409.07 MB 1:2/115.70 MB 2:5/823.04 MB 7:3/513.63 MB 4:1/253.97 MB 3:2/188.05 MB 0:5/831.81 MB 6:2/109.45 MB Filter 4 arrival: 1s052ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 86.24 MB, 85.32 MB, 85.19 MB, 84.69 MB, 85.44 MB, 84.82 MB, 76.79 MB, 77.87 MB, 77.77 MB, 77.70 MB, 77.84 MB, 77.01 MB, 77.37 MB, 69.46 MB, 69.25 MB, 61.26 MB, 61.71 MB, 53.15 MB, 53.20 MB, 53.40 MB, 53.14 MB, 53.26 MB, 53.49 MB, 53.57 MB, 53.26 MB, 53.53 MB, 53.49 MB, 53.34 MB, 53.24 MB, 45.39 MB, 37.52 MB, 37.72 MB, 37.58 MB, 29.37 MB, 29.51 MB, 4.34 MB, 2.46 MB, 2.46 MB, 2.46 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 86.82 MB (91040251) - PerHostPeakMemUsage: 797.59 MB (836330103) - RowsProduced: 4.83M (4832782) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s801ms - TotalStorageWaitTime: 35.409ms - TotalThreadsInvoluntaryContextSwitches: 599 (599) - TotalThreadsTotalWallClockTime: 38s295ms - TotalThreadsSysTime: 126.980ms - TotalThreadsUserTime: 2s993ms - TotalThreadsVoluntaryContextSwitches: 5.33K (5334) Fragment Instance Lifecycle Timings: - ExecTime: 20s830ms - ExecTreeExecTime: 1s085ms - OpenTime: 25.284ms - ExecTreeOpenTime: 81.039us - PrepareTime: 29.540ms - ExecTreePrepareTime: 638.396us DataStreamSender (dst_id=20):(Total: 935.992ms, non-child: 935.992ms, % non-child: 100.00%) - BytesSent: 111.56 MB (116983575) - OverallThroughput: 119.19 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.83M (4832782) - SerializeBatchTime: 933.990ms - UncompressedRowBatchSize: 111.56 MB (116983575) CodeGen:(Total: 50.233ms, non-child: 50.233ms, % non-child: 100.00%) - CodegenTime: 1.350ms - CompileTime: 6.315ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.195ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.268ms HDFS_SCAN_NODE (id=1):(Total: 1s081ms, non-child: 1s081ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:3/409.07 MB 1:2/115.70 MB 2:5/823.04 MB 7:3/513.63 MB 4:1/253.97 MB 3:2/188.05 MB 0:5/831.81 MB 6:2/109.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 1s003ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB, 68.13 MB - FooterProcessingTime: (Avg: 3.613ms ; Min: 3.613ms ; Max: 3.613ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.92 - BytesRead: 68.13 MB (71439695) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.13 MB (71439695) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.13 MB (71439695) - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 246.956ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 82.76 MB (86775233) - PerReadThreadRawHdfsThroughput: 760.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.645ms - RowBatchQueuePutWaitTime: 16s702ms - RowsRead: 4.83M (4832782) - RowsReturned: 4.83M (4832782) - RowsReturnedRate: 4.47 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 217 (217) - ScannerThreadsTotalWallClockTime: 17s439ms - MaterializeTupleTime(*): 405.096ms - ScannerThreadsSysTime: 35.994ms - ScannerThreadsUserTime: 697.893ms - ScannerThreadsVoluntaryContextSwitches: 3.89K (3893) - TotalRawHdfsReadTime(*): 89.567ms - TotalReadThroughput: 3.59 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 22 (22) - Files total: 23 (23) - RowGroups processed: 4.72K (4720) - RowGroups rejected: 0 (0) - RowGroups total: 4.72K (4720) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 4.83M (4832782) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce1800000122 (host=foo.187.49:22000):(Total: 20s774ms, non-child: 16s863ms, % non-child: 81.17%) Hdfs split stats (:<# splits>/): 0:3/225.82 MB 1:3/315.26 MB 4:5/682.52 MB 2:4/766.95 MB 6:4/323.49 MB 3:2/267.58 MB 7:5/647.41 MB Filter 4 arrival: 2s223ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 168.06 MB, 165.61 MB, 157.63 MB, 157.61 MB, 156.43 MB, 157.40 MB, 157.39 MB, 156.96 MB, 156.68 MB, 156.69 MB, 157.25 MB, 157.36 MB, 156.85 MB, 157.11 MB, 157.30 MB, 156.85 MB, 157.10 MB, 132.98 MB, 132.99 MB, 133.31 MB, 133.25 MB, 133.20 MB, 133.17 MB, 109.16 MB, 109.18 MB, 109.12 MB, 109.21 MB, 85.30 MB, 85.36 MB, 77.47 MB, 69.57 MB, 61.53 MB, 36.37 MB, 36.51 MB, 36.30 MB, 36.35 MB, 3.76 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1 - AverageThreadTokens: 4.51 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 168.43 MB (176609490) - PerHostPeakMemUsage: 900.63 MB (944377684) - RowsProduced: 9.68M (9676886) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s498ms - TotalStorageWaitTime: 120.810ms - TotalThreadsInvoluntaryContextSwitches: 3.25K (3250) - TotalThreadsTotalWallClockTime: 1m31s - TotalThreadsSysTime: 2s215ms - TotalThreadsUserTime: 23s606ms - TotalThreadsVoluntaryContextSwitches: 224.10K (224100) Fragment Instance Lifecycle Timings: - ExecTime: 20s708ms - ExecTreeExecTime: 2s251ms - OpenTime: 33.199ms - ExecTreeOpenTime: 80.332us - PrepareTime: 32.849ms - ExecTreePrepareTime: 345.046us DataStreamSender (dst_id=20):(Total: 1s603ms, non-child: 1s603ms, % non-child: 100.00%) - BytesSent: 228.18 MB (239264140) - OverallThroughput: 142.26 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.68M (9676886) - SerializeBatchTime: 1s600ms - UncompressedRowBatchSize: 228.18 MB (239264140) CodeGen:(Total: 62.677ms, non-child: 62.677ms, % non-child: 100.00%) - CodegenTime: 1.451ms - CompileTime: 7.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 24.249ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.174ms HDFS_SCAN_NODE (id=1):(Total: 2s244ms, non-child: 2s244ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:3/225.82 MB 1:3/315.26 MB 4:5/682.52 MB 2:4/766.95 MB 6:4/323.49 MB 3:2/267.58 MB 7:5/647.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 2s168ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 0, 0, 0, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB, 138.62 MB - FooterProcessingTime: (Avg: 3.537ms ; Min: 2.452ms ; Max: 4.958ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.51 - BytesRead: 138.62 MB (145357349) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.62 MB (145357349) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.62 MB (145357349) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 512.775ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 164.36 MB (172348761) - PerReadThreadRawHdfsThroughput: 1007.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.022ms - RowBatchQueuePutWaitTime: 48s778ms - RowsRead: 9.68M (9676886) - RowsReturned: 9.68M (9676886) - RowsReturnedRate: 4.31 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 2.65K (2645) - ScannerThreadsTotalWallClockTime: 1m10s - MaterializeTupleTime(*): 851.525ms - ScannerThreadsSysTime: 2s020ms - ScannerThreadsUserTime: 19s811ms - ScannerThreadsVoluntaryContextSwitches: 222.09K (222090) - TotalRawHdfsReadTime(*): 137.570ms - TotalReadThroughput: 6.76 MB/sec Filter 4 (8.00 KB): - Files processed: 26 (26) - Files rejected: 22 (22) - Files total: 26 (26) - RowGroups processed: 9.45K (9453) - RowGroups rejected: 0 (0) - RowGroups total: 9.45K (9453) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 9.68M (9676886) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000013a (host=foo.187.44:22000):(Total: 20s635ms, non-child: 16s969ms, % non-child: 82.23%) Hdfs split stats (:<# splits>/): 5:2/266.57 MB 1:1/139.16 MB 0:2/332.55 MB 4:5/879.78 MB 7:5/759.77 MB 2:4/736.41 MB 6:2/329.44 MB Filter 4 arrival: 2s199ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 126.12 MB, 126.27 MB, 123.99 MB, 124.90 MB, 124.76 MB, 125.28 MB, 125.44 MB, 125.01 MB, 125.25 MB, 124.76 MB, 124.86 MB, 124.77 MB, 117.41 MB, 108.52 MB, 109.27 MB, 109.20 MB, 109.33 MB, 108.63 MB, 109.16 MB, 109.24 MB, 109.24 MB, 92.86 MB, 93.18 MB, 93.41 MB, 77.09 MB, 77.17 MB, 58.47 MB, 49.60 MB, 49.43 MB, 49.22 MB, 49.64 MB, 41.73 MB, 33.57 MB, 25.61 MB, 4.44 MB, 2.57 MB, 2.57 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1 - AverageThreadTokens: 5.63 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 126.48 MB (132618891) - PerHostPeakMemUsage: 810.80 MB (850181971) - RowsProduced: 7.40M (7404233) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s971ms - TotalStorageWaitTime: 62.395ms - TotalThreadsInvoluntaryContextSwitches: 6.56K (6561) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 17s457ms - TotalThreadsUserTime: 38s682ms - TotalThreadsVoluntaryContextSwitches: 2.27M (2266499) Fragment Instance Lifecycle Timings: - ExecTime: 20s572ms - ExecTreeExecTime: 2s233ms - OpenTime: 24.476ms - ExecTreeOpenTime: 79.323us - PrepareTime: 38.300ms - ExecTreePrepareTime: 244.711us DataStreamSender (dst_id=20):(Total: 1s381ms, non-child: 1s381ms, % non-child: 100.00%) - BytesSent: 174.30 MB (182769414) - OverallThroughput: 126.20 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.40M (7404233) - SerializeBatchTime: 1s378ms - UncompressedRowBatchSize: 174.30 MB (182769414) CodeGen:(Total: 57.605ms, non-child: 57.605ms, % non-child: 100.00%) - CodegenTime: 1.195ms - CompileTime: 6.457ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.887ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.262ms HDFS_SCAN_NODE (id=1):(Total: 2s227ms, non-child: 2s227ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/266.57 MB 1:1/139.16 MB 0:2/332.55 MB 4:5/879.78 MB 7:5/759.77 MB 2:4/736.41 MB 6:2/329.44 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s147ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB, 106.20 MB - FooterProcessingTime: (Avg: 3.033ms ; Min: 2.992ms ; Max: 3.075ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.87 - BytesRead: 106.20 MB (111354194) - BytesReadDataNodeCache: 0 - BytesReadLocal: 106.20 MB (111354194) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 106.20 MB (111354194) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 362.624ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.40 MB (128342655) - PerReadThreadRawHdfsThroughput: 828.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.544ms - RowBatchQueuePutWaitTime: 28s900ms - RowsRead: 7.40M (7404233) - RowsReturned: 7.40M (7404233) - RowsReturnedRate: 3.32 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 6.05K (6054) - ScannerThreadsTotalWallClockTime: 1m34s - MaterializeTupleTime(*): 615.047ms - ScannerThreadsSysTime: 17s298ms - ScannerThreadsUserTime: 35s479ms - ScannerThreadsVoluntaryContextSwitches: 2.26M (2264761) - TotalRawHdfsReadTime(*): 128.135ms - TotalReadThroughput: 5.45 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 19 (19) - Files total: 21 (21) - RowGroups processed: 7.23K (7231) - RowGroups rejected: 0 (0) - RowGroups total: 7.23K (7231) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.40M (7404233) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000172 (host=foo.187.55:22000):(Total: 20s213ms, non-child: 16s683ms, % non-child: 82.54%) Hdfs split stats (:<# splits>/): 6:2/420.17 MB 3:3/647.05 MB 2:3/641.56 MB 0:1/254.12 MB 4:2/247.88 MB 7:6/813.40 MB 5:1/25.29 MB 1:4/838.14 MB Filter 4 arrival: 2s020ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 136.04 MB, 133.73 MB, 135.57 MB, 135.01 MB, 135.22 MB, 134.69 MB, 134.42 MB, 134.83 MB, 134.34 MB, 134.23 MB, 134.97 MB, 126.73 MB, 118.59 MB, 118.94 MB, 118.51 MB, 118.89 MB, 118.86 MB, 102.79 MB, 102.74 MB, 86.85 MB, 78.75 MB, 78.81 MB, 70.88 MB, 70.95 MB, 49.40 MB, 49.45 MB, 49.34 MB, 41.38 MB, 33.41 MB, 25.61 MB, 25.35 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.55 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 136.22 MB (142841300) - PerHostPeakMemUsage: 845.70 MB (886783415) - RowsProduced: 7.87M (7867106) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s049ms - TotalStorageWaitTime: 64.567ms - TotalThreadsInvoluntaryContextSwitches: 1.14K (1140) - TotalThreadsTotalWallClockTime: 50s702ms - TotalThreadsSysTime: 230.965ms - TotalThreadsUserTime: 7s937ms - TotalThreadsVoluntaryContextSwitches: 9.00K (9002) Fragment Instance Lifecycle Timings: - ExecTime: 20s140ms - ExecTreeExecTime: 2s057ms - OpenTime: 39.842ms - ExecTreeOpenTime: 83.667us - PrepareTime: 33.020ms - ExecTreePrepareTime: 374.687us DataStreamSender (dst_id=20):(Total: 1s410ms, non-child: 1s410ms, % non-child: 100.00%) - BytesSent: 185.40 MB (194402475) - OverallThroughput: 131.44 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.87M (7867106) - SerializeBatchTime: 1s407ms - UncompressedRowBatchSize: 185.40 MB (194402475) CodeGen:(Total: 68.884ms, non-child: 68.884ms, % non-child: 100.00%) - CodegenTime: 1.543ms - CompileTime: 7.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 31.099ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.719ms HDFS_SCAN_NODE (id=1):(Total: 2s050ms, non-child: 2s050ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/420.17 MB 3:3/647.05 MB 2:3/641.56 MB 0:1/254.12 MB 4:2/247.88 MB 7:6/813.40 MB 5:1/25.29 MB 1:4/838.14 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s966ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB, 112.32 MB - FooterProcessingTime: (Avg: 3.016ms ; Min: 2.516ms ; Max: 3.516ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 112.32 MB (117776774) - BytesReadDataNodeCache: 0 - BytesReadLocal: 112.32 MB (117776774) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 112.32 MB (117776774) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 402.867ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.15 MB (138565639) - PerReadThreadRawHdfsThroughput: 937.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.154ms - RowBatchQueuePutWaitTime: 25s806ms - RowsRead: 7.87M (7867106) - RowsReturned: 7.87M (7867106) - RowsReturnedRate: 3.84 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 674 (674) - ScannerThreadsTotalWallClockTime: 30s521ms - MaterializeTupleTime(*): 655.860ms - ScannerThreadsSysTime: 60.990ms - ScannerThreadsUserTime: 4s659ms - ScannerThreadsVoluntaryContextSwitches: 7.41K (7409) - TotalRawHdfsReadTime(*): 119.788ms - TotalReadThroughput: 6.42 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 7.68K (7683) - RowGroups rejected: 0 (0) - RowGroups total: 7.68K (7683) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.87M (7867106) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000018e (host=foo.232.11:22000):(Total: 20s082ms, non-child: 17s701ms, % non-child: 88.14%) Hdfs split stats (:<# splits>/): 7:1/234.12 MB 5:2/388.18 MB 1:3/323.86 MB 0:5/673.84 MB 2:4/609.45 MB 6:1/91.91 MB 4:1/204.93 MB 3:5/971.93 MB Filter 4 arrival: 1s410ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 90.35 MB, 92.06 MB, 92.43 MB, 90.89 MB, 91.55 MB, 90.77 MB, 91.00 MB, 91.76 MB, 91.60 MB, 91.90 MB, 91.63 MB, 91.89 MB, 91.11 MB, 83.16 MB, 55.63 MB, 55.75 MB, 56.18 MB, 55.79 MB, 55.99 MB, 56.10 MB, 55.78 MB, 55.81 MB, 47.82 MB, 48.24 MB, 39.96 MB, 40.15 MB, 40.42 MB, 32.32 MB, 32.16 MB, 32.27 MB, 32.06 MB, 32.20 MB, 6.32 MB, 2.53 MB, 2.53 MB, 2.53 MB, 2.53 MB ThreadUsage(500.000ms): 1, 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.12 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 92.99 MB (97505019) - PerHostPeakMemUsage: 818.18 MB (857927305) - RowsProduced: 4.77M (4769516) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s204ms - TotalStorageWaitTime: 58.416ms - TotalThreadsInvoluntaryContextSwitches: 6.82K (6824) - TotalThreadsTotalWallClockTime: 1m42s - TotalThreadsSysTime: 24s628ms - TotalThreadsUserTime: 32s943ms - TotalThreadsVoluntaryContextSwitches: 2.32M (2323121) Fragment Instance Lifecycle Timings: - ExecTime: 20s033ms - ExecTreeExecTime: 1s431ms - OpenTime: 25.813ms - ExecTreeOpenTime: 86.622us - PrepareTime: 23.316ms - ExecTreePrepareTime: 321.511us DataStreamSender (dst_id=20):(Total: 906.981ms, non-child: 906.981ms, % non-child: 100.00%) - BytesSent: 111.16 MB (116556409) - OverallThroughput: 122.56 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.77M (4769516) - SerializeBatchTime: 904.823ms - UncompressedRowBatchSize: 111.16 MB (116556409) CodeGen:(Total: 45.759ms, non-child: 45.759ms, % non-child: 100.00%) - CodegenTime: 1.110ms - CompileTime: 6.793ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.163ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 20.322ms HDFS_SCAN_NODE (id=1):(Total: 1s428ms, non-child: 1s428ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/234.12 MB 5:2/388.18 MB 1:3/323.86 MB 0:5/673.84 MB 2:4/609.45 MB 6:1/91.91 MB 4:1/204.93 MB 3:5/971.93 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s367ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB, 68.23 MB - FooterProcessingTime: (Avg: 3.353ms ; Min: 3.309ms ; Max: 3.397ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.58 - BytesRead: 68.23 MB (71539701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.23 MB (71539701) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.23 MB (71539701) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 251.094ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 88.91 MB (93229155) - PerReadThreadRawHdfsThroughput: 826.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.915ms - RowBatchQueuePutWaitTime: 22s736ms - RowsRead: 4.77M (4769516) - RowsReturned: 4.77M (4769516) - RowsReturnedRate: 3.34 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 6.50K (6495) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 416.537ms - ScannerThreadsSysTime: 24s508ms - ScannerThreadsUserTime: 30s858ms - ScannerThreadsVoluntaryContextSwitches: 2.32M (2321771) - TotalRawHdfsReadTime(*): 82.520ms - TotalReadThroughput: 3.79 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 4.66K (4659) - RowGroups rejected: 0 (0) - RowGroups total: 4.66K (4659) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 4.77M (4769516) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000147 (host=foo.221.40:22000):(Total: 20s048ms, non-child: 17s621ms, % non-child: 87.89%) Hdfs split stats (:<# splits>/): 1:2/159.01 MB 5:1/253.94 MB 6:2/241.67 MB 2:3/621.80 MB 7:5/855.60 MB 3:2/472.51 MB 4:4/299.76 MB 0:3/437.77 MB Filter 4 arrival: 1s560ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 73.28 MB, 73.60 MB, 72.73 MB, 72.33 MB, 72.87 MB, 73.15 MB, 72.93 MB, 72.91 MB, 72.55 MB, 72.30 MB, 71.69 MB, 63.69 MB, 64.82 MB, 64.44 MB, 64.17 MB, 56.07 MB, 48.00 MB, 48.96 MB, 48.04 MB, 48.10 MB, 48.39 MB, 48.53 MB, 40.85 MB, 40.85 MB, 40.04 MB, 40.84 MB, 40.98 MB, 40.79 MB, 40.62 MB, 40.30 MB, 24.70 MB, 24.40 MB, 6.70 MB, 3.97 MB, 2.49 MB, 2.49 MB, 2.49 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.38 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 73.82 MB (77408356) - PerHostPeakMemUsage: 740.76 MB (776744461) - RowsProduced: 4.37M (4369437) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16s270ms - TotalStorageWaitTime: 35.320ms - TotalThreadsInvoluntaryContextSwitches: 7.28K (7282) - TotalThreadsTotalWallClockTime: 1m47s - TotalThreadsSysTime: 32s171ms - TotalThreadsUserTime: 29s290ms - TotalThreadsVoluntaryContextSwitches: 2.28M (2279422) Fragment Instance Lifecycle Timings: - ExecTime: 19s995ms - ExecTreeExecTime: 1s597ms - OpenTime: 24.256ms - ExecTreeOpenTime: 73.281us - PrepareTime: 29.084ms - ExecTreePrepareTime: 391.928us DataStreamSender (dst_id=20):(Total: 782.848ms, non-child: 782.848ms, % non-child: 100.00%) - BytesSent: 102.02 MB (106975218) - OverallThroughput: 130.32 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.37M (4369437) - SerializeBatchTime: 781.046ms - UncompressedRowBatchSize: 102.02 MB (106975218) CodeGen:(Total: 50.098ms, non-child: 50.098ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 6.357ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.975ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.305ms HDFS_SCAN_NODE (id=1):(Total: 1s594ms, non-child: 1s594ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/159.01 MB 5:1/253.94 MB 6:2/241.67 MB 2:3/621.80 MB 7:5/855.60 MB 3:2/472.51 MB 4:4/299.76 MB 0:3/437.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 1s526ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 0, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.15 MB - FooterProcessingTime: (Avg: 3.256ms ; Min: 3.256ms ; Max: 3.256ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.73 - BytesRead: 63.15 MB (66212530) - BytesReadDataNodeCache: 0 - BytesReadLocal: 63.15 MB (66212530) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 63.15 MB (66212530) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 225.070ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 69.75 MB (73143380) - PerReadThreadRawHdfsThroughput: 866.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.814ms - RowBatchQueuePutWaitTime: 15s344ms - RowsRead: 4.37M (4369437) - RowsReturned: 4.37M (4369437) - RowsReturnedRate: 2.74 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 6.99K (6987) - ScannerThreadsTotalWallClockTime: 1m27s - MaterializeTupleTime(*): 370.395ms - ScannerThreadsSysTime: 32s085ms - ScannerThreadsUserTime: 27s392ms - ScannerThreadsVoluntaryContextSwitches: 2.28M (2278056) - TotalRawHdfsReadTime(*): 72.855ms - TotalReadThroughput: 3.41 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 21 (21) - Files total: 22 (22) - RowGroups processed: 4.27K (4268) - RowGroups rejected: 0 (0) - RowGroups total: 4.27K (4268) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 4.37M (4369437) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce1800000117 (host=foo.234.37:22000):(Total: 19s308ms, non-child: 16s881ms, % non-child: 87.43%) Hdfs split stats (:<# splits>/): 1:3/369.34 MB 2:5/1.05 GB 0:4/239.03 MB 7:1/52.63 MB 3:1/254.06 MB 6:5/463.60 MB 5:4/414.97 MB 4:3/511.06 MB Filter 4 arrival: 569ms MemoryUsage(500.000ms): 581.02 KB, 182.63 MB, 183.29 MB, 182.76 MB, 183.14 MB, 184.08 MB, 183.41 MB, 182.88 MB, 183.26 MB, 183.01 MB, 183.80 MB, 183.19 MB, 183.42 MB, 183.12 MB, 183.25 MB, 183.63 MB, 183.40 MB, 183.34 MB, 112.88 MB, 112.68 MB, 112.68 MB, 112.77 MB, 112.69 MB, 104.70 MB, 96.78 MB, 97.03 MB, 88.75 MB, 80.92 MB, 80.94 MB, 62.54 MB, 62.24 MB, 53.46 MB, 53.49 MB, 37.43 MB, 37.68 MB, 29.65 MB, 2.47 MB, 2.47 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 4.68 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 184.93 MB (193917938) - PerHostPeakMemUsage: 864.03 MB (905997065) - RowsProduced: 10.12M (10123048) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s206ms - TotalStorageWaitTime: 137.159ms - TotalThreadsInvoluntaryContextSwitches: 3.32K (3318) - TotalThreadsTotalWallClockTime: 1m29s - TotalThreadsSysTime: 3s878ms - TotalThreadsUserTime: 22s361ms - TotalThreadsVoluntaryContextSwitches: 396.47K (396469) Fragment Instance Lifecycle Timings: - ExecTime: 19s249ms - ExecTreeExecTime: 623.428ms - OpenTime: 24.703ms - ExecTreeOpenTime: 92.200us - PrepareTime: 34.419ms - ExecTreePrepareTime: 418.272us DataStreamSender (dst_id=20):(Total: 1s758ms, non-child: 1s758ms, % non-child: 100.00%) - BytesSent: 238.36 MB (249937354) - OverallThroughput: 135.55 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.12M (10123048) - SerializeBatchTime: 1s754ms - UncompressedRowBatchSize: 238.36 MB (249937354) CodeGen:(Total: 51.527ms, non-child: 51.527ms, % non-child: 100.00%) - CodegenTime: 1.312ms - CompileTime: 6.206ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.523ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.234ms HDFS_SCAN_NODE (id=1):(Total: 616.443ms, non-child: 616.443ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/369.34 MB 2:5/1.05 GB 0:4/239.03 MB 7:1/52.63 MB 3:1/254.06 MB 6:5/463.60 MB 5:4/414.97 MB 4:3/511.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB - FooterProcessingTime: (Avg: 3.004ms ; Min: 2.978ms ; Max: 3.019ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.89 - BytesRead: 144.08 MB (151074085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 144.08 MB (151074085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 144.08 MB (151074085) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 527.329ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 180.89 MB (189681031) - PerReadThreadRawHdfsThroughput: 761.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.557ms - RowBatchQueuePutWaitTime: 47s423ms - RowsRead: 10.12M (10123048) - RowsReturned: 10.12M (10123048) - RowsReturnedRate: 16.42 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 2.70K (2698) - ScannerThreadsTotalWallClockTime: 1m9s - MaterializeTupleTime(*): 879.680ms - ScannerThreadsSysTime: 3s694ms - ScannerThreadsUserTime: 18s274ms - ScannerThreadsVoluntaryContextSwitches: 394.90K (394904) - TotalRawHdfsReadTime(*): 189.225ms - TotalReadThroughput: 8.00 MB/sec Filter 4 (8.00 KB): - Files processed: 26 (26) - Files rejected: 22 (22) - Files total: 26 (26) - RowGroups processed: 9.89K (9887) - RowGroups rejected: 0 (0) - RowGroups total: 9.89K (9887) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 10.12M (10123048) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000160 (host=foo.234.45:22000):(Total: 19s232ms, non-child: 16s447ms, % non-child: 85.52%) Hdfs split stats (:<# splits>/): 2:2/393.74 MB 1:2/92.62 MB 3:2/458.17 MB 0:2/282.39 MB 7:3/439.12 MB 4:3/565.19 MB 6:4/398.46 MB 5:3/648.65 MB Filter 4 arrival: 445ms MemoryUsage(500.000ms): 589.02 KB, 214.63 MB, 214.84 MB, 212.92 MB, 213.24 MB, 213.42 MB, 213.49 MB, 214.00 MB, 214.08 MB, 213.44 MB, 214.03 MB, 213.32 MB, 195.10 MB, 195.17 MB, 177.14 MB, 176.78 MB, 176.73 MB, 177.04 MB, 161.17 MB, 153.26 MB, 153.14 MB, 153.06 MB, 153.08 MB, 153.06 MB, 129.16 MB, 129.07 MB, 129.29 MB, 105.24 MB, 105.22 MB, 105.34 MB, 70.96 MB, 71.03 MB, 50.45 MB, 49.26 MB, 33.48 MB, 25.59 MB, 4.32 MB, 2.50 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 4.82 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 215.32 MB (225779851) - PerHostPeakMemUsage: 732.11 MB (767674607) - RowsProduced: 12.43M (12432470) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s330ms - TotalStorageWaitTime: 261.183ms - TotalThreadsInvoluntaryContextSwitches: 2.47K (2467) - TotalThreadsTotalWallClockTime: 1m32s - TotalThreadsSysTime: 3s505ms - TotalThreadsUserTime: 15s370ms - TotalThreadsVoluntaryContextSwitches: 321.34K (321339) Fragment Instance Lifecycle Timings: - ExecTime: 19s170ms - ExecTreeExecTime: 556.950ms - OpenTime: 30.565ms - ExecTreeOpenTime: 94.308us - PrepareTime: 31.599ms - ExecTreePrepareTime: 546.818us DataStreamSender (dst_id=20):(Total: 2s179ms, non-child: 2s179ms, % non-child: 100.00%) - BytesSent: 294.89 MB (309209483) - OverallThroughput: 135.30 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.43M (12432470) - SerializeBatchTime: 2s175ms - UncompressedRowBatchSize: 294.89 MB (309209483) CodeGen:(Total: 58.219ms, non-child: 58.219ms, % non-child: 100.00%) - CodegenTime: 1.271ms - CompileTime: 6.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.705ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.564ms HDFS_SCAN_NODE (id=1):(Total: 547.324ms, non-child: 547.324ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:2/393.74 MB 1:2/92.62 MB 3:2/458.17 MB 0:2/282.39 MB 7:3/439.12 MB 4:3/565.19 MB 6:4/398.46 MB 5:3/648.65 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 402ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:20 BytesRead(500.000ms): 0, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB, 178.27 MB - FooterProcessingTime: (Avg: 3.798ms ; Min: 3.354ms ; Max: 5.096ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.92 - BytesRead: 178.27 MB (186929283) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.27 MB (186929283) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.27 MB (186929283) - CachedFileHandlesHitCount: 39 (39) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 620.423ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 211.27 MB (221534642) - PerReadThreadRawHdfsThroughput: 817.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.143ms - RowBatchQueuePutWaitTime: 58s853ms - RowsRead: 12.43M (12432470) - RowsReturned: 12.43M (12432470) - RowsReturnedRate: 22.71 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1748) - ScannerThreadsTotalWallClockTime: 1m13s - MaterializeTupleTime(*): 1s053ms - ScannerThreadsSysTime: 3s284ms - ScannerThreadsUserTime: 10s358ms - ScannerThreadsVoluntaryContextSwitches: 319.53K (319532) - TotalRawHdfsReadTime(*): 217.936ms - TotalReadThroughput: 9.64 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 16 (16) - Files total: 21 (21) - RowGroups processed: 12.14K (12143) - RowGroups rejected: 0 (0) - RowGroups total: 12.14K (12143) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 12.43M (12432470) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000187 (host=foo.246.50:22000):(Total: 18s500ms, non-child: 16s511ms, % non-child: 89.25%) Hdfs split stats (:<# splits>/): 5:2/487.70 MB 2:1/250.17 MB 6:3/490.93 MB 7:3/524.55 MB 3:4/762.48 MB 0:3/221.71 MB 1:5/585.31 MB 4:5/417.56 MB Filter 4 arrival: 123ms MemoryUsage(500.000ms): 183.96 MB, 182.97 MB, 166.67 MB, 165.68 MB, 165.70 MB, 165.72 MB, 165.92 MB, 165.71 MB, 165.81 MB, 165.91 MB, 166.11 MB, 166.00 MB, 166.15 MB, 142.08 MB, 142.07 MB, 142.02 MB, 142.30 MB, 141.96 MB, 142.21 MB, 142.16 MB, 141.94 MB, 141.94 MB, 120.01 MB, 118.72 MB, 102.86 MB, 94.66 MB, 86.97 MB, 86.80 MB, 86.93 MB, 71.02 MB, 70.88 MB, 70.79 MB, 49.55 MB, 33.41 MB, 25.57 MB, 2.53 MB, 2.53 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 4.97 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 185.33 MB (194328621) - PerHostPeakMemUsage: 878.51 MB (921186052) - RowsProduced: 10.29M (10286898) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13s975ms - TotalStorageWaitTime: 124.047ms - TotalThreadsInvoluntaryContextSwitches: 4.09K (4092) - TotalThreadsTotalWallClockTime: 1m31s - TotalThreadsSysTime: 2s960ms - TotalThreadsUserTime: 29s491ms - TotalThreadsVoluntaryContextSwitches: 336.88K (336884) Fragment Instance Lifecycle Timings: - ExecTime: 18s436ms - ExecTreeExecTime: 174.681ms - OpenTime: 33.395ms - ExecTreeOpenTime: 162.461us - PrepareTime: 30.417ms - ExecTreePrepareTime: 451.239us DataStreamSender (dst_id=20):(Total: 1s762ms, non-child: 1s762ms, % non-child: 100.00%) - BytesSent: 243.75 MB (255595425) - OverallThroughput: 138.32 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.29M (10286898) - SerializeBatchTime: 1s758ms - UncompressedRowBatchSize: 243.75 MB (255595425) CodeGen:(Total: 58.979ms, non-child: 58.979ms, % non-child: 100.00%) - CodegenTime: 1.389ms - CompileTime: 8.335ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.900ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.199ms HDFS_SCAN_NODE (id=1):(Total: 167.835ms, non-child: 167.835ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:2/487.70 MB 2:1/250.17 MB 6:3/490.93 MB 7:3/524.55 MB 3:4/762.48 MB 0:3/221.71 MB 1:5/585.31 MB 4:5/417.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Runtime filters: All filters arrived. Waited 80ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:20 BytesRead(500.000ms): 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB, 148.36 MB - FooterProcessingTime: (Avg: 4.105ms ; Min: 2.654ms ; Max: 9.517ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.20 - BytesRead: 148.36 MB (155571966) - BytesReadDataNodeCache: 0 - BytesReadLocal: 148.36 MB (155571966) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 148.36 MB (155571966) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 510.732ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 181.27 MB (190075446) - PerReadThreadRawHdfsThroughput: 839.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 20.718ms - RowBatchQueuePutWaitTime: 44s218ms - RowsRead: 10.29M (10286898) - RowsReturned: 10.29M (10286898) - RowsReturnedRate: 61.29 M/sec - ScanRangesComplete: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 3.43K (3434) - ScannerThreadsTotalWallClockTime: 1m12s - MaterializeTupleTime(*): 857.809ms - ScannerThreadsSysTime: 2s782ms - ScannerThreadsUserTime: 25s429ms - ScannerThreadsVoluntaryContextSwitches: 335.20K (335201) - TotalRawHdfsReadTime(*): 176.670ms - TotalReadThroughput: 8.48 MB/sec Filter 4 (8.00 KB): - Files processed: 26 (26) - Files rejected: 21 (21) - Files total: 26 (26) - RowGroups processed: 10.05K (10048) - RowGroups rejected: 0 (0) - RowGroups total: 10.05K (10048) - Rows processed: 81.92K (81920) - Rows rejected: 0 (0) - Rows total: 10.29M (10286898) - Splits processed: 5 (5) - Splits rejected: 0 (0) - Splits total: 5 (5) Instance 5f429df048b5534b:41bcce1800000167 (host=foo.246.49:22000):(Total: 18s476ms, non-child: 16s085ms, % non-child: 87.06%) Hdfs split stats (:<# splits>/): 1:2/265.41 MB 6:2/466.62 MB 7:3/530.94 MB 0:5/969.15 MB 4:4/408.64 MB 5:3/486.78 MB 3:4/410.88 MB Filter 4 arrival: 119ms MemoryUsage(500.000ms): 63.01 MB, 222.44 MB, 222.51 MB, 223.14 MB, 222.28 MB, 222.04 MB, 207.70 MB, 208.46 MB, 208.00 MB, 207.85 MB, 208.03 MB, 208.17 MB, 208.07 MB, 207.92 MB, 200.03 MB, 184.30 MB, 184.33 MB, 184.32 MB, 184.18 MB, 168.32 MB, 160.17 MB, 160.32 MB, 160.28 MB, 144.39 MB, 136.41 MB, 136.41 MB, 136.50 MB, 112.51 MB, 112.54 MB, 112.57 MB, 112.51 MB, 112.56 MB, 83.02 MB, 59.30 MB, 25.70 MB, 2.33 MB, 2.33 MB ThreadUsage(500.000ms): 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1 - AverageThreadTokens: 4.78 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 223.91 MB (234784317) - PerHostPeakMemUsage: 794.82 MB (833428598) - RowsProduced: 12.99M (12993639) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s664ms - TotalStorageWaitTime: 106.659ms - TotalThreadsInvoluntaryContextSwitches: 2.94K (2941) - TotalThreadsTotalWallClockTime: 1m27s - TotalThreadsSysTime: 1s012ms - TotalThreadsUserTime: 23s154ms - TotalThreadsVoluntaryContextSwitches: 129.26K (129257) Fragment Instance Lifecycle Timings: - ExecTime: 18s401ms - ExecTreeExecTime: 170.250ms - OpenTime: 35.933ms - ExecTreeOpenTime: 97.147us - PrepareTime: 38.387ms - ExecTreePrepareTime: 365.465us DataStreamSender (dst_id=20):(Total: 2s160ms, non-child: 2s160ms, % non-child: 100.00%) - BytesSent: 309.04 MB (324053019) - OverallThroughput: 143.01 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.99M (12993639) - SerializeBatchTime: 2s156ms - UncompressedRowBatchSize: 309.04 MB (324053019) CodeGen:(Total: 68.691ms, non-child: 68.691ms, % non-child: 100.00%) - CodegenTime: 1.750ms - CompileTime: 7.570ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 26.087ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.907ms HDFS_SCAN_NODE (id=1):(Total: 160.766ms, non-child: 160.766ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/265.41 MB 6:2/466.62 MB 7:3/530.94 MB 0:5/969.15 MB 4:4/408.64 MB 5:3/486.78 MB 3:4/410.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 61ms Hdfs Read Thread Concurrency Bucket: 0:97.14% 1:0% 2:0% 3:2.857% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:16 BytesRead(500.000ms): 33.32 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB, 187.84 MB - FooterProcessingTime: (Avg: 2.984ms ; Min: 2.258ms ; Max: 4.507ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 4.00 - BytesRead: 187.84 MB (196961716) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.84 MB (196961716) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.84 MB (196961716) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 641.428ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 219.89 MB (230574254) - PerReadThreadRawHdfsThroughput: 940.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.388ms - RowBatchQueuePutWaitTime: 50s331ms - RowsRead: 12.99M (12993639) - RowsReturned: 12.99M (12993639) - RowsReturnedRate: 80.82 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 2.22K (2217) - ScannerThreadsTotalWallClockTime: 1m9s - MaterializeTupleTime(*): 1s071ms - ScannerThreadsSysTime: 802.875ms - ScannerThreadsUserTime: 17s991ms - ScannerThreadsVoluntaryContextSwitches: 127.54K (127538) - TotalRawHdfsReadTime(*): 199.738ms - TotalReadThroughput: 10.73 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 19 (19) - Files total: 23 (23) - RowGroups processed: 12.69K (12692) - RowGroups rejected: 0 (0) - RowGroups total: 12.69K (12692) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 12.99M (12993639) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce1800000181 (host=foo.232.25:22000):(Total: 18s299ms, non-child: 16s117ms, % non-child: 88.08%) Hdfs split stats (:<# splits>/): 3:2/101.63 MB 1:2/426.21 MB 2:2/227.22 MB 0:3/354.78 MB 4:4/725.40 MB 5:3/320.84 MB 7:3/540.81 MB 6:3/573.88 MB Filter 4 arrival: 1s258ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 82.50 MB, 82.26 MB, 80.46 MB, 80.73 MB, 82.16 MB, 81.24 MB, 82.03 MB, 73.11 MB, 72.82 MB, 73.82 MB, 72.78 MB, 73.41 MB, 65.90 MB, 65.22 MB, 65.23 MB, 49.13 MB, 49.30 MB, 49.59 MB, 49.22 MB, 49.43 MB, 49.34 MB, 49.24 MB, 49.23 MB, 49.51 MB, 41.38 MB, 41.34 MB, 33.31 MB, 33.51 MB, 25.62 MB, 4.79 MB, 2.50 MB, 2.50 MB, 2.50 MB, 2.50 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1, 1, 1, 1 - AverageThreadTokens: 5.19 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 82.75 MB (86772887) - PerHostPeakMemUsage: 825.31 MB (865404536) - RowsProduced: 4.83M (4831346) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s153ms - TotalStorageWaitTime: 38.938ms - TotalThreadsInvoluntaryContextSwitches: 6.67K (6666) - TotalThreadsTotalWallClockTime: 1m36s - TotalThreadsSysTime: 27s173ms - TotalThreadsUserTime: 29s191ms - TotalThreadsVoluntaryContextSwitches: 2.52M (2517211) Fragment Instance Lifecycle Timings: - ExecTime: 18s237ms - ExecTreeExecTime: 1s244ms - OpenTime: 27.234ms - ExecTreeOpenTime: 72.882us - PrepareTime: 34.951ms - ExecTreePrepareTime: 359.703us DataStreamSender (dst_id=20):(Total: 882.431ms, non-child: 882.431ms, % non-child: 100.00%) - BytesSent: 113.42 MB (118924785) - OverallThroughput: 128.53 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.83M (4831346) - SerializeBatchTime: 880.671ms - UncompressedRowBatchSize: 113.42 MB (118924785) CodeGen:(Total: 58.727ms, non-child: 58.727ms, % non-child: 100.00%) - CodegenTime: 1.160ms - CompileTime: 7.475ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.560ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.170ms HDFS_SCAN_NODE (id=1):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/101.63 MB 1:2/426.21 MB 2:2/227.22 MB 0:3/354.78 MB 4:4/725.40 MB 5:3/320.84 MB 7:3/540.81 MB 6:3/573.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s204ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB, 69.74 MB - FooterProcessingTime: (Avg: 2.691ms ; Min: 2.676ms ; Max: 2.706ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.70 - BytesRead: 69.74 MB (73132180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.74 MB (73132180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.74 MB (73132180) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 237.242ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.77 MB (82593474) - PerReadThreadRawHdfsThroughput: 958.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.284ms - RowBatchQueuePutWaitTime: 13s850ms - RowsRead: 4.83M (4831346) - RowsReturned: 4.83M (4831346) - RowsReturnedRate: 3.89 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 6.32K (6322) - ScannerThreadsTotalWallClockTime: 1m18s - MaterializeTupleTime(*): 398.979ms - ScannerThreadsSysTime: 27s085ms - ScannerThreadsUserTime: 27s123ms - ScannerThreadsVoluntaryContextSwitches: 2.52M (2515681) - TotalRawHdfsReadTime(*): 72.787ms - TotalReadThroughput: 4.23 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 4.72K (4719) - RowGroups rejected: 0 (0) - RowGroups total: 4.72K (4719) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 4.83M (4831346) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000186 (host=foo.246.36:22000):(Total: 17s732ms, non-child: 15s369ms, % non-child: 86.68%) Hdfs split stats (:<# splits>/): 3:2/300.84 MB 4:3/251.73 MB 6:2/377.18 MB 2:2/224.89 MB 7:2/466.27 MB 5:7/1.32 GB 0:1/37.76 MB 1:4/490.03 MB Filter 4 arrival: 323ms MemoryUsage(500.000ms): 581.02 KB, 202.50 MB, 203.87 MB, 203.59 MB, 203.53 MB, 203.86 MB, 203.89 MB, 203.75 MB, 195.87 MB, 195.79 MB, 195.98 MB, 187.98 MB, 180.06 MB, 179.80 MB, 179.86 MB, 180.02 MB, 155.98 MB, 155.96 MB, 140.30 MB, 123.91 MB, 108.15 MB, 108.38 MB, 108.28 MB, 83.72 MB, 82.82 MB, 82.75 MB, 82.64 MB, 82.77 MB, 82.85 MB, 82.86 MB, 37.14 MB, 37.01 MB, 2.54 MB, 2.54 MB, 2.54 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 3.66 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 205.31 MB (215279116) - PerHostPeakMemUsage: 900.81 MB (944572125) - RowsProduced: 12.53M (12527603) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s517ms - TotalStorageWaitTime: 113.633ms - TotalThreadsInvoluntaryContextSwitches: 1.92K (1918) - TotalThreadsTotalWallClockTime: 1m4s - TotalThreadsSysTime: 1s026ms - TotalThreadsUserTime: 10s827ms - TotalThreadsVoluntaryContextSwitches: 102.81K (102810) Fragment Instance Lifecycle Timings: - ExecTime: 17s682ms - ExecTreeExecTime: 385.521ms - OpenTime: 23.752ms - ExecTreeOpenTime: 83.518us - PrepareTime: 25.544ms - ExecTreePrepareTime: 256.502us DataStreamSender (dst_id=20):(Total: 1s939ms, non-child: 1s939ms, % non-child: 100.00%) - BytesSent: 294.37 MB (308672535) - OverallThroughput: 151.79 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.53M (12527603) - SerializeBatchTime: 1s935ms - UncompressedRowBatchSize: 294.37 MB (308672535) CodeGen:(Total: 45.750ms, non-child: 45.750ms, % non-child: 100.00%) - CodegenTime: 1.186ms - CompileTime: 6.748ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.153ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.363ms HDFS_SCAN_NODE (id=1):(Total: 377.173ms, non-child: 377.173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:2/300.84 MB 4:3/251.73 MB 6:2/377.18 MB 2:2/224.89 MB 7:2/466.27 MB 5:7/1.32 GB 0:1/37.76 MB 1:4/490.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 281ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB, 175.75 MB - FooterProcessingTime: (Avg: 3.114ms ; Min: 2.487ms ; Max: 4.298ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.91 - BytesRead: 175.75 MB (184286929) - BytesReadDataNodeCache: 0 - BytesReadLocal: 175.75 MB (184286929) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 175.75 MB (184286929) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 651.891ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 201.27 MB (211051881) - PerReadThreadRawHdfsThroughput: 986.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 33.580ms - RowBatchQueuePutWaitTime: 39s513ms - RowsRead: 12.53M (12527603) - RowsReturned: 12.53M (12527603) - RowsReturnedRate: 33.21 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1189) - ScannerThreadsTotalWallClockTime: 46s948ms - MaterializeTupleTime(*): 1s048ms - ScannerThreadsSysTime: 841.871ms - ScannerThreadsUserTime: 6s397ms - ScannerThreadsVoluntaryContextSwitches: 100.93K (100930) - TotalRawHdfsReadTime(*): 178.132ms - TotalReadThroughput: 10.98 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 20 (20) - Files total: 23 (23) - RowGroups processed: 12.24K (12236) - RowGroups rejected: 0 (0) - RowGroups total: 12.24K (12236) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.53M (12527603) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000015e (host=foo.246.39:22000):(Total: 17s729ms, non-child: 15s504ms, % non-child: 87.45%) Hdfs split stats (:<# splits>/): 3:1/251.58 MB 0:1/18.81 MB 1:1/132.97 MB 7:4/772.83 MB 6:4/768.31 MB 4:5/643.38 MB 5:1/254.04 MB 2:5/627.32 MB Filter 4 arrival: 313ms MemoryUsage(500.000ms): 581.02 KB, 184.45 MB, 183.06 MB, 183.36 MB, 183.60 MB, 183.19 MB, 183.13 MB, 183.20 MB, 183.25 MB, 183.19 MB, 183.34 MB, 183.42 MB, 183.44 MB, 183.37 MB, 151.49 MB, 151.55 MB, 151.59 MB, 151.65 MB, 130.25 MB, 130.27 MB, 130.04 MB, 130.21 MB, 122.10 MB, 106.36 MB, 106.33 MB, 106.42 MB, 82.39 MB, 82.38 MB, 82.60 MB, 66.12 MB, 50.31 MB, 50.10 MB, 29.63 MB, 6.04 MB, 2.59 MB, 2.59 MB ThreadUsage(500.000ms): 1, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 1, 1, 1 - AverageThreadTokens: 4.56 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 184.97 MB (193952323) - PerHostPeakMemUsage: 866.41 MB (908494657) - RowsProduced: 10.78M (10775227) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s930ms - TotalStorageWaitTime: 120.927ms - TotalThreadsInvoluntaryContextSwitches: 2.07K (2073) - TotalThreadsTotalWallClockTime: 1m22s - TotalThreadsSysTime: 882.863ms - TotalThreadsUserTime: 15s321ms - TotalThreadsVoluntaryContextSwitches: 78.47K (78465) Fragment Instance Lifecycle Timings: - ExecTime: 17s658ms - ExecTreeExecTime: 358.319ms - OpenTime: 43.112ms - ExecTreeOpenTime: 128.097us - PrepareTime: 27.505ms - ExecTreePrepareTime: 287.840us DataStreamSender (dst_id=20):(Total: 1s807ms, non-child: 1s807ms, % non-child: 100.00%) - BytesSent: 256.06 MB (268499685) - OverallThroughput: 141.65 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 10.78M (10775227) - SerializeBatchTime: 1s804ms - UncompressedRowBatchSize: 256.06 MB (268499685) CodeGen:(Total: 66.556ms, non-child: 66.556ms, % non-child: 100.00%) - CodegenTime: 1.422ms - CompileTime: 14.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 27.725ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.823ms HDFS_SCAN_NODE (id=1):(Total: 350.551ms, non-child: 350.551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/251.58 MB 0:1/18.81 MB 1:1/132.97 MB 7:4/772.83 MB 6:4/768.31 MB 4:5/643.38 MB 5:1/254.04 MB 2:5/627.32 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 261ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:16 BytesRead(500.000ms): 0, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB, 155.73 MB - FooterProcessingTime: (Avg: 3.000ms ; Min: 2.486ms ; Max: 4.211ms ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.76 - BytesRead: 155.73 MB (163291890) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.73 MB (163291890) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.73 MB (163291890) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 555.165ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 4 (4) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 180.90 MB (189691952) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.542ms - RowBatchQueuePutWaitTime: 53s101ms - RowsRead: 10.78M (10775227) - RowsReturned: 10.78M (10775227) - RowsReturnedRate: 30.74 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.44K (1444) - ScannerThreadsTotalWallClockTime: 1m5s - MaterializeTupleTime(*): 921.750ms - ScannerThreadsSysTime: 694.892ms - ScannerThreadsUserTime: 11s145ms - ScannerThreadsVoluntaryContextSwitches: 76.89K (76893) - TotalRawHdfsReadTime(*): 148.793ms - TotalReadThroughput: 9.16 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 18 (18) - Files total: 22 (22) - RowGroups processed: 10.53K (10525) - RowGroups rejected: 0 (0) - RowGroups total: 10.53K (10525) - Rows processed: 65.54K (65536) - Rows rejected: 0 (0) - Rows total: 10.78M (10775227) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) Instance 5f429df048b5534b:41bcce180000015b (host=foo.246.48:22000):(Total: 17s603ms, non-child: 15s272ms, % non-child: 86.76%) Hdfs split stats (:<# splits>/): 5:1/253.99 MB 6:2/463.72 MB 1:1/135.80 MB 4:4/702.99 MB 0:4/1015.97 MB 3:2/507.92 MB 7:2/387.24 MB Filter 4 arrival: 144ms MemoryUsage(500.000ms): 203.04 MB, 201.33 MB, 201.79 MB, 202.14 MB, 201.70 MB, 201.59 MB, 202.42 MB, 202.08 MB, 202.00 MB, 201.76 MB, 201.63 MB, 185.83 MB, 186.29 MB, 178.19 MB, 178.22 MB, 177.94 MB, 178.13 MB, 177.94 MB, 170.19 MB, 154.31 MB, 146.26 MB, 146.37 MB, 130.45 MB, 130.43 MB, 130.36 MB, 103.90 MB, 95.87 MB, 95.84 MB, 79.96 MB, 64.08 MB, 56.09 MB, 29.27 MB, 2.44 MB, 2.44 MB, 2.44 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 3.74 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 203.58 MB (213470304) - PerHostPeakMemUsage: 712.07 MB (746655641) - RowsProduced: 12.24M (12243552) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s237ms - TotalStorageWaitTime: 98.535ms - TotalThreadsInvoluntaryContextSwitches: 1.55K (1555) - TotalThreadsTotalWallClockTime: 1m5s - TotalThreadsSysTime: 766.881ms - TotalThreadsUserTime: 10s362ms - TotalThreadsVoluntaryContextSwitches: 65.04K (65038) Fragment Instance Lifecycle Timings: - ExecTime: 17s545ms - ExecTreeExecTime: 221.457ms - OpenTime: 26.664ms - ExecTreeOpenTime: 65.025us - PrepareTime: 31.982ms - ExecTreePrepareTime: 287.475us DataStreamSender (dst_id=20):(Total: 2s065ms, non-child: 2s065ms, % non-child: 100.00%) - BytesSent: 288.81 MB (302836106) - OverallThroughput: 139.83 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.24M (12243552) - SerializeBatchTime: 2s061ms - UncompressedRowBatchSize: 288.81 MB (302836106) CodeGen:(Total: 54.606ms, non-child: 54.606ms, % non-child: 100.00%) - CodegenTime: 1.315ms - CompileTime: 7.212ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.478ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.327ms HDFS_SCAN_NODE (id=1):(Total: 211.420ms, non-child: 211.420ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.99 MB 6:2/463.72 MB 1:1/135.80 MB 4:4/702.99 MB 0:4/1015.97 MB 3:2/507.92 MB 7:2/387.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 101ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:13 PARQUET/SNAPPY:12 BytesRead(500.000ms): 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB, 173.43 MB - FooterProcessingTime: (Avg: 3.734ms ; Min: 2.837ms ; Max: 5.020ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 173.43 MB (181859060) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.43 MB (181859060) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.43 MB (181859060) - CachedFileHandlesHitCount: 32 (32) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 623.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 199.53 MB (209218266) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.371ms - RowBatchQueuePutWaitTime: 41s909ms - RowsRead: 12.24M (12243552) - RowsReturned: 12.24M (12243552) - RowsReturnedRate: 57.91 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 860 (860) - ScannerThreadsTotalWallClockTime: 48s101ms - MaterializeTupleTime(*): 1s046ms - ScannerThreadsSysTime: 519.919ms - ScannerThreadsUserTime: 5s553ms - ScannerThreadsVoluntaryContextSwitches: 63.39K (63392) - TotalRawHdfsReadTime(*): 154.801ms - TotalReadThroughput: 10.84 MB/sec Filter 4 (8.00 KB): - Files processed: 16 (16) - Files rejected: 13 (13) - Files total: 16 (16) - RowGroups processed: 11.96K (11958) - RowGroups rejected: 0 (0) - RowGroups total: 11.96K (11958) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.24M (12243552) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000138 (host=foo.234.44:22000):(Total: 17s587ms, non-child: 15s174ms, % non-child: 86.28%) Hdfs split stats (:<# splits>/): 7:1/254.05 MB 1:2/507.85 MB 2:1/140.05 MB 6:4/708.42 MB 0:1/253.97 MB 4:4/728.73 MB 3:2/116.79 MB 5:4/652.71 MB Filter 4 arrival: 254ms MemoryUsage(500.000ms): 212.90 MB, 212.73 MB, 211.93 MB, 212.50 MB, 212.15 MB, 211.91 MB, 211.83 MB, 211.99 MB, 211.91 MB, 212.35 MB, 204.04 MB, 204.04 MB, 196.31 MB, 188.03 MB, 188.38 MB, 188.29 MB, 188.41 MB, 188.19 MB, 156.47 MB, 140.56 MB, 116.51 MB, 116.52 MB, 116.67 MB, 116.29 MB, 86.82 MB, 86.96 MB, 63.12 MB, 55.12 MB, 55.09 MB, 47.18 MB, 26.56 MB, 2.50 MB, 2.50 MB, 2.50 MB, 2.50 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1, 1 - AverageThreadTokens: 3.66 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 213.72 MB (224105245) - PerHostPeakMemUsage: 759.10 MB (795969934) - RowsProduced: 12.90M (12897796) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s285ms - TotalStorageWaitTime: 93.993ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1665) - TotalThreadsTotalWallClockTime: 1m3s - TotalThreadsSysTime: 321.951ms - TotalThreadsUserTime: 10s146ms - TotalThreadsVoluntaryContextSwitches: 19.12K (19118) Fragment Instance Lifecycle Timings: - ExecTime: 17s530ms - ExecTreeExecTime: 314.034ms - OpenTime: 28.888ms - ExecTreeOpenTime: 78.705us - PrepareTime: 28.034ms - ExecTreePrepareTime: 381.118us DataStreamSender (dst_id=20):(Total: 2s054ms, non-child: 2s054ms, % non-child: 100.00%) - BytesSent: 305.68 MB (320525726) - OverallThroughput: 148.75 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 12.90M (12897796) - SerializeBatchTime: 2s051ms - UncompressedRowBatchSize: 305.68 MB (320525726) CodeGen:(Total: 52.698ms, non-child: 52.698ms, % non-child: 100.00%) - CodegenTime: 1.297ms - CompileTime: 7.871ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.102ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.125ms HDFS_SCAN_NODE (id=1):(Total: 304.484ms, non-child: 304.484ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/254.05 MB 1:2/507.85 MB 2:1/140.05 MB 6:4/708.42 MB 0:1/253.97 MB 4:4/728.73 MB 3:2/116.79 MB 5:4/652.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:12 BytesRead(500.000ms): 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB, 183.75 MB - FooterProcessingTime: (Avg: 3.350ms ; Min: 3.080ms ; Max: 3.742ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 183.75 MB (192677456) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.75 MB (192677456) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.75 MB (192677456) - CachedFileHandlesHitCount: 33 (33) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 682.022ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 209.65 MB (219833864) - PerReadThreadRawHdfsThroughput: 998.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.107ms - RowBatchQueuePutWaitTime: 39s961ms - RowsRead: 12.90M (12897796) - RowsReturned: 12.90M (12897796) - RowsReturnedRate: 42.36 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1009) - ScannerThreadsTotalWallClockTime: 45s566ms - MaterializeTupleTime(*): 1s115ms - ScannerThreadsSysTime: 120.981ms - ScannerThreadsUserTime: 5s489ms - ScannerThreadsVoluntaryContextSwitches: 17.27K (17266) - TotalRawHdfsReadTime(*): 184.118ms - TotalReadThroughput: 11.85 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 16 (16) - Files total: 19 (19) - RowGroups processed: 12.60K (12597) - RowGroups rejected: 0 (0) - RowGroups total: 12.60K (12597) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 12.90M (12897796) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce1800000163 (host=foo.232.33:22000):(Total: 17s502ms, non-child: 15s936ms, % non-child: 91.05%) Hdfs split stats (:<# splits>/): 5:1/2.88 MB 6:1/254.00 MB 1:4/638.77 MB 2:3/548.29 MB 3:4/631.04 MB 0:5/862.35 MB 4:1/253.92 MB 7:1/139.53 MB Filter 4 arrival: 970ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 51.64 MB, 52.27 MB, 52.27 MB, 52.13 MB, 51.74 MB, 51.21 MB, 50.40 MB, 50.19 MB, 49.95 MB, 51.59 MB, 43.31 MB, 42.51 MB, 42.86 MB, 42.86 MB, 43.57 MB, 42.33 MB, 42.21 MB, 35.55 MB, 34.64 MB, 34.37 MB, 35.18 MB, 27.10 MB, 27.23 MB, 26.74 MB, 18.96 MB, 7.30 MB, 2.76 MB, 2.76 MB, 2.76 MB, 2.76 MB, 2.76 MB, 2.76 MB, 2.76 MB ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.71 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 52.33 MB (54873086) - PerHostPeakMemUsage: 819.00 MB (858783036) - RowsProduced: 2.69M (2690632) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14s193ms - TotalStorageWaitTime: 36.453ms - TotalThreadsInvoluntaryContextSwitches: 316 (316) - TotalThreadsTotalWallClockTime: 30s187ms - TotalThreadsSysTime: 90.986ms - TotalThreadsUserTime: 1s693ms - TotalThreadsVoluntaryContextSwitches: 3.11K (3110) Fragment Instance Lifecycle Timings: - ExecTime: 17s444ms - ExecTreeExecTime: 987.236ms - OpenTime: 24.966ms - ExecTreeOpenTime: 78.559us - PrepareTime: 32.852ms - ExecTreePrepareTime: 377.797us DataStreamSender (dst_id=20):(Total: 526.146ms, non-child: 526.146ms, % non-child: 100.00%) - BytesSent: 61.75 MB (64749190) - OverallThroughput: 117.36 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 2.69M (2690632) - SerializeBatchTime: 524.938ms - UncompressedRowBatchSize: 61.75 MB (64749190) CodeGen:(Total: 54.077ms, non-child: 54.077ms, % non-child: 100.00%) - CodegenTime: 1.242ms - CompileTime: 6.129ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.970ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.464ms HDFS_SCAN_NODE (id=1):(Total: 985.500ms, non-child: 985.500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/2.88 MB 6:1/254.00 MB 1:4/638.77 MB 2:3/548.29 MB 3:4/631.04 MB 0:5/862.35 MB 4:1/253.92 MB 7:1/139.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 923ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 0, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB, 38.40 MB - FooterProcessingTime: (Avg: 3.026ms ; Min: 3.026ms ; Max: 3.026ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.89 - BytesRead: 38.40 MB (40261353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 38.40 MB (40261353) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 38.40 MB (40261353) - CachedFileHandlesHitCount: 9 (9) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 139.064ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.23 MB (50570284) - PerReadThreadRawHdfsThroughput: 709.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.807ms - RowBatchQueuePutWaitTime: 12s277ms - RowsRead: 2.69M (2690632) - RowsReturned: 2.69M (2690632) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 100 (100) - ScannerThreadsTotalWallClockTime: 12s718ms - MaterializeTupleTime(*): 235.066ms - ScannerThreadsSysTime: 25.996ms - ScannerThreadsUserTime: 397.939ms - ScannerThreadsVoluntaryContextSwitches: 1.86K (1863) - TotalRawHdfsReadTime(*): 54.124ms - TotalReadThroughput: 2.74 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 19 (19) - Files total: 20 (20) - RowGroups processed: 2.63K (2628) - RowGroups rejected: 0 (0) - RowGroups total: 2.63K (2628) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 2.69M (2690632) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Instance 5f429df048b5534b:41bcce1800000169 (host=foo.234.51:22000):(Total: 17s028ms, non-child: 14s901ms, % non-child: 87.51%) Hdfs split stats (:<# splits>/): 0:1/213.20 MB 5:3/700.34 MB 1:4/540.44 MB 6:2/322.15 MB 4:3/292.29 MB 2:4/651.07 MB 3:3/646.71 MB Filter 4 arrival: 408ms MemoryUsage(500.000ms): 162.26 MB, 163.60 MB, 164.22 MB, 163.95 MB, 162.69 MB, 162.61 MB, 162.91 MB, 162.75 MB, 163.58 MB, 154.79 MB, 147.63 MB, 147.64 MB, 147.32 MB, 147.43 MB, 147.12 MB, 139.15 MB, 131.37 MB, 131.33 MB, 115.73 MB, 99.39 MB, 99.43 MB, 99.40 MB, 99.45 MB, 99.35 MB, 99.39 MB, 99.35 MB, 99.29 MB, 99.32 MB, 67.58 MB, 67.50 MB, 59.61 MB, 51.55 MB, 2.75 MB, 2.75 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1 - AverageThreadTokens: 2.88 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 164.72 MB (172725353) - PerHostPeakMemUsage: 857.61 MB (899272088) - RowsProduced: 9.57M (9568676) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s577ms - TotalStorageWaitTime: 51.102ms - TotalThreadsInvoluntaryContextSwitches: 998 (998) - TotalThreadsTotalWallClockTime: 48s226ms - TotalThreadsSysTime: 240.963ms - TotalThreadsUserTime: 5s228ms - TotalThreadsVoluntaryContextSwitches: 10.84K (10835) Fragment Instance Lifecycle Timings: - ExecTime: 16s973ms - ExecTreeExecTime: 452.813ms - OpenTime: 24.732ms - ExecTreeOpenTime: 97.710us - PrepareTime: 29.868ms - ExecTreePrepareTime: 307.290us DataStreamSender (dst_id=20):(Total: 1s630ms, non-child: 1s630ms, % non-child: 100.00%) - BytesSent: 225.14 MB (236073701) - OverallThroughput: 138.07 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 9.57M (9568676) - SerializeBatchTime: 1s627ms - UncompressedRowBatchSize: 225.14 MB (236073701) CodeGen:(Total: 50.374ms, non-child: 50.374ms, % non-child: 100.00%) - CodegenTime: 1.324ms - CompileTime: 8.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.740ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.877ms HDFS_SCAN_NODE (id=1):(Total: 445.987ms, non-child: 445.987ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/213.20 MB 5:3/700.34 MB 1:4/540.44 MB 6:2/322.15 MB 4:3/292.29 MB 2:4/651.07 MB 3:3/646.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 361ms Hdfs Read Thread Concurrency Bucket: 0:96.88% 1:3.125% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(500.000ms): 131.51 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB, 135.63 MB - FooterProcessingTime: (Avg: 2.722ms ; Min: 2.708ms ; Max: 2.736ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 135.63 MB (142214693) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.63 MB (142214693) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.63 MB (142214693) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 505.104ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 160.65 MB (168449176) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.679ms - RowBatchQueuePutWaitTime: 29s703ms - RowsRead: 9.57M (9568676) - RowsReturned: 9.57M (9568676) - RowsReturnedRate: 21.46 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 424 (424) - ScannerThreadsTotalWallClockTime: 31s228ms - MaterializeTupleTime(*): 819.316ms - ScannerThreadsSysTime: 78.987ms - ScannerThreadsUserTime: 1s471ms - ScannerThreadsVoluntaryContextSwitches: 9.23K (9227) - TotalRawHdfsReadTime(*): 115.976ms - TotalReadThroughput: 8.48 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 9.35K (9346) - RowGroups rejected: 0 (0) - RowGroups total: 9.35K (9346) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 9.57M (9568676) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000155 (host=foo.246.42:22000):(Total: 16s293ms, non-child: 14s046ms, % non-child: 86.21%) Hdfs split stats (:<# splits>/): 7:1/147.27 MB 6:2/190.57 MB 4:3/580.84 MB 0:3/677.01 MB 2:8/940.00 MB 5:2/297.23 MB 1:3/670.15 MB 3:1/114.33 MB Filter 4 arrival: 225ms MemoryUsage(500.000ms): 581.02 KB, 195.55 MB, 196.90 MB, 196.37 MB, 195.75 MB, 196.12 MB, 195.63 MB, 196.15 MB, 172.44 MB, 171.89 MB, 172.02 MB, 172.09 MB, 172.32 MB, 172.05 MB, 156.37 MB, 140.38 MB, 132.53 MB, 124.44 MB, 124.64 MB, 108.46 MB, 108.56 MB, 100.64 MB, 100.60 MB, 100.53 MB, 100.50 MB, 100.51 MB, 80.06 MB, 79.01 MB, 49.31 MB, 33.41 MB, 33.58 MB, 2.47 MB, 2.47 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1 - AverageThreadTokens: 3.73 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 197.60 MB (207203427) - PerHostPeakMemUsage: 796.61 MB (835310838) - RowsProduced: 11.71M (11713706) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11s180ms - TotalStorageWaitTime: 90.354ms - TotalThreadsInvoluntaryContextSwitches: 1.62K (1625) - TotalThreadsTotalWallClockTime: 1m1s - TotalThreadsSysTime: 592.908ms - TotalThreadsUserTime: 9s888ms - TotalThreadsVoluntaryContextSwitches: 33.91K (33913) Fragment Instance Lifecycle Timings: - ExecTime: 16s225ms - ExecTreeExecTime: 272.252ms - OpenTime: 28.802ms - ExecTreeOpenTime: 86.685us - PrepareTime: 38.750ms - ExecTreePrepareTime: 511.501us DataStreamSender (dst_id=20):(Total: 1s919ms, non-child: 1s919ms, % non-child: 100.00%) - BytesSent: 276.84 MB (290283983) - OverallThroughput: 144.20 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.71M (11713706) - SerializeBatchTime: 1s916ms - UncompressedRowBatchSize: 276.84 MB (290283983) CodeGen:(Total: 62.528ms, non-child: 62.528ms, % non-child: 100.00%) - CodegenTime: 1.128ms - CompileTime: 8.132ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.611ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.162ms HDFS_SCAN_NODE (id=1):(Total: 264.244ms, non-child: 264.244ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/147.27 MB 6:2/190.57 MB 4:3/580.84 MB 0:3/677.01 MB 2:8/940.00 MB 5:2/297.23 MB 1:3/670.15 MB 3:1/114.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 161ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB, 166.21 MB - FooterProcessingTime: (Avg: 2.801ms ; Min: 2.751ms ; Max: 2.877ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.90 - BytesRead: 166.21 MB (174286129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 166.21 MB (174286129) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166.21 MB (174286129) - CachedFileHandlesHitCount: 30 (30) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 610.359ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 193.52 MB (202924796) - PerReadThreadRawHdfsThroughput: 990.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 39.335ms - RowBatchQueuePutWaitTime: 39s866ms - RowsRead: 11.71M (11713706) - RowsReturned: 11.71M (11713706) - RowsReturnedRate: 44.33 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 945 (945) - ScannerThreadsTotalWallClockTime: 45s676ms - MaterializeTupleTime(*): 990.508ms - ScannerThreadsSysTime: 402.937ms - ScannerThreadsUserTime: 5s381ms - ScannerThreadsVoluntaryContextSwitches: 32.14K (32140) - TotalRawHdfsReadTime(*): 167.877ms - TotalReadThroughput: 10.72 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 20 (20) - Files total: 23 (23) - RowGroups processed: 11.44K (11440) - RowGroups rejected: 0 (0) - RowGroups total: 11.44K (11440) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 11.71M (11713706) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000015d (host=foo.246.51:22000):(Total: 15s775ms, non-child: 13s691ms, % non-child: 86.79%) Hdfs split stats (:<# splits>/): 0:2/331.51 MB 7:2/467.21 MB 3:3/445.90 MB 5:3/596.01 MB 4:4/605.84 MB 2:3/323.84 MB 1:4/578.17 MB Filter 4 arrival: 150ms MemoryUsage(500.000ms): 185.36 MB, 184.50 MB, 184.24 MB, 194.75 MB, 194.84 MB, 194.95 MB, 195.48 MB, 194.97 MB, 195.04 MB, 178.20 MB, 176.91 MB, 177.16 MB, 176.78 MB, 177.15 MB, 158.54 MB, 158.38 MB, 158.45 MB, 134.72 MB, 114.23 MB, 113.41 MB, 113.28 MB, 105.24 MB, 97.07 MB, 89.41 MB, 81.31 MB, 53.12 MB, 53.40 MB, 53.59 MB, 53.28 MB, 37.31 MB, 29.53 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 5.35 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 197.06 MB (206631748) - PerHostPeakMemUsage: 720.16 MB (755145065) - RowsProduced: 11.03M (11028576) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10s949ms - TotalStorageWaitTime: 113.464ms - TotalThreadsInvoluntaryContextSwitches: 2.93K (2928) - TotalThreadsTotalWallClockTime: 1m21s - TotalThreadsSysTime: 2s931ms - TotalThreadsUserTime: 20s919ms - TotalThreadsVoluntaryContextSwitches: 347.67K (347668) Fragment Instance Lifecycle Timings: - ExecTime: 15s720ms - ExecTreeExecTime: 191.346ms - OpenTime: 29.741ms - ExecTreeOpenTime: 112.737us - PrepareTime: 25.260ms - ExecTreePrepareTime: 401.988us DataStreamSender (dst_id=20):(Total: 1s850ms, non-child: 1s850ms, % non-child: 100.00%) - BytesSent: 259.80 MB (272418774) - OverallThroughput: 140.38 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 11.03M (11028576) - SerializeBatchTime: 1s846ms - UncompressedRowBatchSize: 259.80 MB (272418774) CodeGen:(Total: 50.922ms, non-child: 50.922ms, % non-child: 100.00%) - CodegenTime: 1.166ms - CompileTime: 11.050ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.726ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.691ms HDFS_SCAN_NODE (id=1):(Total: 182.562ms, non-child: 182.562ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/331.51 MB 7:2/467.21 MB 3:3/445.90 MB 5:3/596.01 MB 4:4/605.84 MB 2:3/323.84 MB 1:4/578.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Runtime filters: All filters arrived. Waited 101ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:24 BytesRead(500.000ms): 145.62 MB, 145.62 MB, 145.62 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB, 157.16 MB - FooterProcessingTime: (Avg: 2.860ms ; Min: 2.727ms ; Max: 3.029ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.35 - BytesRead: 157.16 MB (164796489) - BytesReadDataNodeCache: 0 - BytesReadLocal: 157.16 MB (164796489) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 157.16 MB (164796489) - CachedFileHandlesHitCount: 42 (42) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 551.643ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 193.79 MB (203202417) - PerReadThreadRawHdfsThroughput: 897.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.778ms - RowBatchQueuePutWaitTime: 46s311ms - RowsRead: 11.03M (11028576) - RowsReturned: 11.03M (11028576) - RowsReturnedRate: 60.41 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 2.29K (2293) - ScannerThreadsTotalWallClockTime: 1m6s - MaterializeTupleTime(*): 928.732ms - ScannerThreadsSysTime: 2s749ms - ScannerThreadsUserTime: 16s572ms - ScannerThreadsVoluntaryContextSwitches: 346.12K (346123) - TotalRawHdfsReadTime(*): 175.107ms - TotalReadThroughput: 10.14 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 15 (15) - Files total: 21 (21) - RowGroups processed: 10.77K (10773) - RowGroups rejected: 0 (0) - RowGroups total: 10.77K (10773) - Rows processed: 98.30K (98304) - Rows rejected: 0 (0) - Rows total: 11.03M (11028576) - Splits processed: 6 (6) - Splits rejected: 0 (0) - Splits total: 6 (6) Instance 5f429df048b5534b:41bcce1800000125 (host=foo.232.42:22000):(Total: 15s722ms, non-child: 14s393ms, % non-child: 91.54%) Hdfs split stats (:<# splits>/): 4:2/508.06 MB 2:1/138.03 MB 1:1/201.84 MB 3:3/519.69 MB 5:3/311.98 MB 0:3/598.88 MB 6:3/727.71 MB 7:4/643.36 MB Filter 4 arrival: 735ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 51.69 MB, 50.79 MB, 51.31 MB, 50.99 MB, 50.96 MB, 50.92 MB, 49.55 MB, 49.81 MB, 50.38 MB, 42.79 MB, 41.78 MB, 42.82 MB, 42.84 MB, 42.35 MB, 42.63 MB, 42.36 MB, 34.06 MB, 34.24 MB, 26.27 MB, 26.59 MB, 26.28 MB, 26.59 MB, 26.16 MB, 5.40 MB, 2.73 MB, 2.73 MB, 2.73 MB, 2.73 MB, 2.73 MB, 2.73 MB ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.44 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 56.81 MB (59566231) - PerHostPeakMemUsage: 684.68 MB (717941631) - RowsProduced: 2.83M (2825601) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s892ms - TotalStorageWaitTime: 46.381ms - TotalThreadsInvoluntaryContextSwitches: 1.55K (1547) - TotalThreadsTotalWallClockTime: 39s415ms - TotalThreadsSysTime: 106.982ms - TotalThreadsUserTime: 13s569ms - TotalThreadsVoluntaryContextSwitches: 3.36K (3361) Fragment Instance Lifecycle Timings: - ExecTime: 15s666ms - ExecTreeExecTime: 723.973ms - OpenTime: 25.380ms - ExecTreeOpenTime: 79.414us - PrepareTime: 30.973ms - ExecTreePrepareTime: 436.605us DataStreamSender (dst_id=20):(Total: 555.197ms, non-child: 555.197ms, % non-child: 100.00%) - BytesSent: 65.53 MB (68717271) - OverallThroughput: 118.04 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 2.83M (2825601) - SerializeBatchTime: 554.016ms - UncompressedRowBatchSize: 65.53 MB (68717271) CodeGen:(Total: 52.395ms, non-child: 52.395ms, % non-child: 100.00%) - CodegenTime: 1.188ms - CompileTime: 6.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.785ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.379ms HDFS_SCAN_NODE (id=1):(Total: 722.245ms, non-child: 722.245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:2/508.06 MB 2:1/138.03 MB 1:1/201.84 MB 3:3/519.69 MB 5:3/311.98 MB 0:3/598.88 MB 6:3/727.71 MB 7:4/643.36 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 682ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB - FooterProcessingTime: (Avg: 2.820ms ; Min: 2.541ms ; Max: 3.099ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 41.04 MB (43029441) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.04 MB (43029441) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.04 MB (43029441) - CachedFileHandlesHitCount: 13 (13) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 141.956ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 53.31 MB (55902334) - PerReadThreadRawHdfsThroughput: 647.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.460ms - RowBatchQueuePutWaitTime: 11s439ms - RowsRead: 2.83M (2825601) - RowsReturned: 2.83M (2825601) - RowsReturnedRate: 3.91 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 1.35K (1348) - ScannerThreadsTotalWallClockTime: 23s723ms - MaterializeTupleTime(*): 248.262ms - ScannerThreadsSysTime: 24.995ms - ScannerThreadsUserTime: 12s223ms - ScannerThreadsVoluntaryContextSwitches: 2.21K (2207) - TotalRawHdfsReadTime(*): 63.381ms - TotalReadThroughput: 3.16 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 2.76K (2761) - RowGroups rejected: 0 (0) - RowGroups total: 2.76K (2761) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 2.83M (2825601) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000018a (host=foo.221.26:22000):(Total: 15s488ms, non-child: 13s097ms, % non-child: 84.56%) Hdfs split stats (:<# splits>/): 5:5/901.80 MB 3:3/263.36 MB 1:1/85.49 MB 2:1/71.66 MB 6:5/617.04 MB 4:5/692.84 MB 0:2/264.16 MB 7:5/765.23 MB Filter 4 arrival: 1s745ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 64.08 MB, 61.51 MB, 62.44 MB, 63.97 MB, 63.59 MB, 63.47 MB, 62.72 MB, 62.69 MB, 63.12 MB, 62.58 MB, 62.45 MB, 62.53 MB, 62.31 MB, 63.14 MB, 63.23 MB, 62.27 MB, 62.64 MB, 62.94 MB, 62.36 MB, 62.33 MB, 28.58 MB, 27.50 MB, 7.62 MB, 4.16 MB, 2.37 MB, 2.37 MB, 2.37 MB, 2.37 MB ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.42 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 64.22 MB (67343448) - PerHostPeakMemUsage: 579.45 MB (607601743) - RowsProduced: 2.85M (2845349) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11s535ms - TotalStorageWaitTime: 62.165ms - TotalThreadsInvoluntaryContextSwitches: 558 (558) - TotalThreadsTotalWallClockTime: 37s693ms - TotalThreadsSysTime: 125.980ms - TotalThreadsUserTime: 3s246ms - TotalThreadsVoluntaryContextSwitches: 3.96K (3958) Fragment Instance Lifecycle Timings: - ExecTime: 15s424ms - ExecTreeExecTime: 1s749ms - OpenTime: 29.691ms - ExecTreeOpenTime: 85.117us - PrepareTime: 33.997ms - ExecTreePrepareTime: 321.401us DataStreamSender (dst_id=20):(Total: 582.461ms, non-child: 582.461ms, % non-child: 100.00%) - BytesSent: 66.77 MB (70015418) - OverallThroughput: 114.64 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 2.85M (2845349) - SerializeBatchTime: 581.228ms - UncompressedRowBatchSize: 66.77 MB (70015418) CodeGen:(Total: 60.576ms, non-child: 60.576ms, % non-child: 100.00%) - CodegenTime: 1.245ms - CompileTime: 7.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.959ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 31.566ms HDFS_SCAN_NODE (id=1):(Total: 1s747ms, non-child: 1s747ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:5/901.80 MB 3:3/263.36 MB 1:1/85.49 MB 2:1/71.66 MB 6:5/617.04 MB 4:5/692.84 MB 0:2/264.16 MB 7:5/765.23 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s685ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:25 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB, 40.43 MB - FooterProcessingTime: (Avg: 4.313ms ; Min: 4.307ms ; Max: 4.319ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.63 - BytesRead: 40.43 MB (42389557) - BytesReadDataNodeCache: 0 - BytesReadLocal: 40.43 MB (42389557) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 40.43 MB (42389557) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 143.832ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 60.12 MB (63045296) - PerReadThreadRawHdfsThroughput: 567.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 38.902ms - RowBatchQueuePutWaitTime: 20s201ms - RowsRead: 2.85M (2845349) - RowsReturned: 2.85M (2845349) - RowsReturnedRate: 1.63 M/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 261 (261) - ScannerThreadsTotalWallClockTime: 22s239ms - MaterializeTupleTime(*): 364.949ms - ScannerThreadsSysTime: 34.994ms - ScannerThreadsUserTime: 1s854ms - ScannerThreadsVoluntaryContextSwitches: 2.73K (2726) - TotalRawHdfsReadTime(*): 71.215ms - TotalReadThroughput: 2.99 MB/sec Filter 4 (8.00 KB): - Files processed: 27 (27) - Files rejected: 25 (25) - Files total: 27 (27) - RowGroups processed: 2.78K (2779) - RowGroups rejected: 0 (0) - RowGroups total: 2.78K (2779) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 2.85M (2845349) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000177 (host=foo.246.41:22000):(Total: 15s039ms, non-child: 13s326ms, % non-child: 88.61%) Hdfs split stats (:<# splits>/): 6:2/287.79 MB 7:2/478.47 MB 3:4/781.07 MB 4:2/191.65 MB 0:3/423.19 MB 2:5/602.40 MB 1:3/525.39 MB 5:3/436.21 MB Filter 4 arrival: 273ms MemoryUsage(500.000ms): 74.75 MB, 144.08 MB, 144.69 MB, 144.31 MB, 143.62 MB, 143.45 MB, 144.47 MB, 144.72 MB, 144.25 MB, 143.99 MB, 143.77 MB, 144.35 MB, 144.10 MB, 144.11 MB, 143.88 MB, 120.07 MB, 77.19 MB, 61.35 MB, 61.21 MB, 53.55 MB, 53.50 MB, 53.56 MB, 53.65 MB, 53.65 MB, 37.58 MB, 29.35 MB, 6.68 MB, 2.63 MB, 2.63 MB, 2.63 MB ThreadUsage(500.000ms): 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4, 4, 4, 4, 4, 1, 1, 1, 1 - AverageThreadTokens: 5.00 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 145.52 MB (152583625) - PerHostPeakMemUsage: 830.32 MB (870654387) - RowsProduced: 8.03M (8034002) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10s998ms - TotalStorageWaitTime: 86.546ms - TotalThreadsInvoluntaryContextSwitches: 4.14K (4136) - TotalThreadsTotalWallClockTime: 1m14s - TotalThreadsSysTime: 8s334ms - TotalThreadsUserTime: 25s821ms - TotalThreadsVoluntaryContextSwitches: 591.38K (591377) Fragment Instance Lifecycle Timings: - ExecTime: 14s979ms - ExecTreeExecTime: 298.190ms - OpenTime: 31.385ms - ExecTreeOpenTime: 100.796us - PrepareTime: 28.541ms - ExecTreePrepareTime: 272.015us DataStreamSender (dst_id=20):(Total: 1s364ms, non-child: 1s364ms, % non-child: 100.00%) - BytesSent: 188.48 MB (197638705) - OverallThroughput: 138.12 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.03M (8034002) - SerializeBatchTime: 1s361ms - UncompressedRowBatchSize: 188.48 MB (197638705) CodeGen:(Total: 55.836ms, non-child: 55.836ms, % non-child: 100.00%) - CodegenTime: 1.552ms - CompileTime: 6.939ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.973ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.317ms HDFS_SCAN_NODE (id=1):(Total: 292.523ms, non-child: 292.523ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/287.79 MB 7:2/478.47 MB 3:4/781.07 MB 4:2/191.65 MB 0:3/423.19 MB 2:5/602.40 MB 1:3/525.39 MB 5:3/436.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 221ms Hdfs Read Thread Concurrency Bucket: 0:96.3% 1:3.704% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:12 BytesRead(500.000ms): 48.74 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB, 114.09 MB - FooterProcessingTime: (Avg: 3.290ms ; Min: 2.392ms ; Max: 4.602ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 4.44 - BytesRead: 114.09 MB (119630350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 114.09 MB (119630350) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 114.09 MB (119630350) - CachedFileHandlesHitCount: 24 (24) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 408.106ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 141.53 MB (148399936) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 26.334ms - RowBatchQueuePutWaitTime: 27s154ms - RowsRead: 8.03M (8034002) - RowsReturned: 8.03M (8034002) - RowsReturnedRate: 27.46 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 3.68K (3679) - ScannerThreadsTotalWallClockTime: 59s822ms - MaterializeTupleTime(*): 662.801ms - ScannerThreadsSysTime: 8s177ms - ScannerThreadsUserTime: 22s677ms - ScannerThreadsVoluntaryContextSwitches: 590.18K (590182) - TotalRawHdfsReadTime(*): 110.556ms - TotalReadThroughput: 8.45 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 21 (21) - Files total: 24 (24) - RowGroups processed: 7.85K (7847) - RowGroups rejected: 0 (0) - RowGroups total: 7.85K (7847) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.03M (8034002) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000011e (host=foo.187.45:22000):(Total: 15s006ms, non-child: 11s782ms, % non-child: 78.52%) Hdfs split stats (:<# splits>/): 5:1/253.99 MB 2:1/254.03 MB 3:5/1.09 GB 0:2/216.64 MB 7:1/54.20 MB 4:5/652.96 MB 6:2/163.21 MB 1:5/570.58 MB Filter 4 arrival: 2s195ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 104.16 MB, 105.15 MB, 105.51 MB, 104.89 MB, 104.70 MB, 105.25 MB, 104.85 MB, 104.96 MB, 104.69 MB, 88.75 MB, 88.97 MB, 88.73 MB, 88.63 MB, 88.45 MB, 88.69 MB, 81.05 MB, 72.85 MB, 72.77 MB, 72.77 MB, 64.97 MB, 57.01 MB, 56.75 MB, 41.03 MB, 2.58 MB, 2.58 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1, 1 - AverageThreadTokens: 5.50 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 106.23 MB (111393972) - PerHostPeakMemUsage: 773.72 MB (811305845) - RowsProduced: 5.98M (5980143) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10s168ms - TotalStorageWaitTime: 52.550ms - TotalThreadsInvoluntaryContextSwitches: 4.61K (4608) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 11s539ms - TotalThreadsUserTime: 25s885ms - TotalThreadsVoluntaryContextSwitches: 1.20M (1202942) Fragment Instance Lifecycle Timings: - ExecTime: 14s956ms - ExecTreeExecTime: 2s218ms - OpenTime: 22.578ms - ExecTreeOpenTime: 78.632us - PrepareTime: 28.035ms - ExecTreePrepareTime: 289.087us DataStreamSender (dst_id=20):(Total: 962.864ms, non-child: 962.864ms, % non-child: 100.00%) - BytesSent: 140.58 MB (147409202) - OverallThroughput: 146.00 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.98M (5980143) - SerializeBatchTime: 960.682ms - UncompressedRowBatchSize: 140.58 MB (147409202) CodeGen:(Total: 47.543ms, non-child: 47.543ms, % non-child: 100.00%) - CodegenTime: 986.254us - CompileTime: 6.246ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.574ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.271ms HDFS_SCAN_NODE (id=1):(Total: 2s213ms, non-child: 2s213ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.99 MB 2:1/254.03 MB 3:5/1.09 GB 0:2/216.64 MB 7:1/54.20 MB 4:5/652.96 MB 6:2/163.21 MB 1:5/570.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s147ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 0, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB, 86.26 MB - FooterProcessingTime: (Avg: 2.518ms ; Min: 2.515ms ; Max: 2.520ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.82 - BytesRead: 86.26 MB (90447074) - BytesReadDataNodeCache: 0 - BytesReadLocal: 86.26 MB (90447074) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 86.26 MB (90447074) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 301.935ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 102.15 MB (107109431) - PerReadThreadRawHdfsThroughput: 990.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.382ms - RowBatchQueuePutWaitTime: 22s440ms - RowsRead: 5.98M (5980143) - RowsReturned: 5.98M (5980143) - RowsReturnedRate: 2.70 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 4.28K (4275) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 502.805ms - ScannerThreadsSysTime: 11s432ms - ScannerThreadsUserTime: 23s581ms - ScannerThreadsVoluntaryContextSwitches: 1.20M (1201440) - TotalRawHdfsReadTime(*): 87.070ms - TotalReadThroughput: 6.16 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 5.84K (5841) - RowGroups rejected: 0 (0) - RowGroups total: 5.84K (5841) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.98M (5980143) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000184 (host=foo.187.40:22000):(Total: 14s185ms, non-child: 11s093ms, % non-child: 78.20%) Hdfs split stats (:<# splits>/): 2:1/253.97 MB 0:1/253.97 MB 7:2/508.06 MB 5:5/693.13 MB 4:5/867.35 MB 3:4/369.54 MB 6:3/470.38 MB Filter 4 arrival: 2s167ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 853.02 KB, 86.48 MB, 84.53 MB, 84.47 MB, 85.14 MB, 84.60 MB, 84.88 MB, 77.80 MB, 77.87 MB, 77.28 MB, 69.37 MB, 69.73 MB, 61.18 MB, 61.84 MB, 53.64 MB, 53.34 MB, 53.74 MB, 53.33 MB, 53.60 MB, 53.55 MB, 37.39 MB, 37.49 MB, 29.75 MB, 4.17 MB ThreadUsage(500.000ms): 1, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 1 - AverageThreadTokens: 5.64 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 86.79 MB (91007422) - PerHostPeakMemUsage: 703.45 MB (737624302) - RowsProduced: 4.88M (4879422) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9s728ms - TotalStorageWaitTime: 48.216ms - TotalThreadsInvoluntaryContextSwitches: 5.44K (5441) - TotalThreadsTotalWallClockTime: 1m21s - TotalThreadsSysTime: 20s099ms - TotalThreadsUserTime: 25s554ms - TotalThreadsVoluntaryContextSwitches: 2.46M (2461982) Fragment Instance Lifecycle Timings: - ExecTime: 14s124ms - ExecTreeExecTime: 2s172ms - OpenTime: 24.550ms - ExecTreeOpenTime: 82.186us - PrepareTime: 36.470ms - ExecTreePrepareTime: 308.631us DataStreamSender (dst_id=20):(Total: 869.821ms, non-child: 869.821ms, % non-child: 100.00%) - BytesSent: 113.89 MB (119420244) - OverallThroughput: 130.93 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.88M (4879422) - SerializeBatchTime: 868.092ms - UncompressedRowBatchSize: 113.89 MB (119420244) CodeGen:(Total: 52.986ms, non-child: 52.986ms, % non-child: 100.00%) - CodegenTime: 1.044ms - CompileTime: 6.978ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.714ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.857ms HDFS_SCAN_NODE (id=1):(Total: 2s169ms, non-child: 2s169ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.97 MB 0:1/253.97 MB 7:2/508.06 MB 5:5/693.13 MB 4:5/867.35 MB 3:4/369.54 MB 6:3/470.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s126ms Hdfs Read Thread Concurrency Bucket: 0:96.43% 1:0% 2:3.571% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 0, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB, 70.41 MB - FooterProcessingTime: (Avg: 3.001ms ; Min: 2.885ms ; Max: 3.117ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 4.64 - BytesRead: 70.41 MB (73832840) - BytesReadDataNodeCache: 0 - BytesReadLocal: 70.41 MB (73832840) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 70.41 MB (73832840) - CachedFileHandlesHitCount: 17 (17) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 237.470ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 82.77 MB (86787769) - PerReadThreadRawHdfsThroughput: 812.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.533ms - RowBatchQueuePutWaitTime: 10s714ms - RowsRead: 4.88M (4879422) - RowsReturned: 4.88M (4879422) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 5.14K (5140) - ScannerThreadsTotalWallClockTime: 1m7s - MaterializeTupleTime(*): 410.748ms - ScannerThreadsSysTime: 19s984ms - ScannerThreadsUserTime: 23s521ms - ScannerThreadsVoluntaryContextSwitches: 2.46M (2460638) - TotalRawHdfsReadTime(*): 86.669ms - TotalReadThroughput: 5.03 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 19 (19) - Files total: 21 (21) - RowGroups processed: 4.77K (4766) - RowGroups rejected: 0 (0) - RowGroups total: 4.77K (4766) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 4.88M (4879422) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000143 (host=foo.234.39:22000):(Total: 13s451ms, non-child: 11s770ms, % non-child: 87.50%) Hdfs split stats (:<# splits>/): 7:3/549.39 MB 5:3/418.41 MB 1:3/367.50 MB 0:1/36.47 MB 3:3/573.97 MB 6:3/137.52 MB 2:3/585.53 MB 4:6/933.30 MB Filter 4 arrival: 545ms MemoryUsage(500.000ms): 581.02 KB, 111.71 MB, 110.68 MB, 111.60 MB, 110.47 MB, 111.34 MB, 110.87 MB, 110.33 MB, 110.80 MB, 110.50 MB, 95.09 MB, 94.84 MB, 74.07 MB, 73.14 MB, 65.15 MB, 49.56 MB, 49.59 MB, 49.10 MB, 49.47 MB, 41.51 MB, 41.23 MB, 33.74 MB, 33.30 MB, 33.83 MB, 25.93 MB, 2.65 MB, 2.65 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1 - AverageThreadTokens: 2.78 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 112.22 MB (117675820) - PerHostPeakMemUsage: 764.85 MB (801999330) - RowsProduced: 6.41M (6408121) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10s101ms - TotalStorageWaitTime: 50.249ms - TotalThreadsInvoluntaryContextSwitches: 1.43K (1429) - TotalThreadsTotalWallClockTime: 37s197ms - TotalThreadsSysTime: 196.969ms - TotalThreadsUserTime: 9s994ms - TotalThreadsVoluntaryContextSwitches: 7.13K (7132) Fragment Instance Lifecycle Timings: - ExecTime: 13s392ms - ExecTreeExecTime: 569.921ms - OpenTime: 26.480ms - ExecTreeOpenTime: 96.605us - PrepareTime: 32.362ms - ExecTreePrepareTime: 613.124us DataStreamSender (dst_id=20):(Total: 1s058ms, non-child: 1s058ms, % non-child: 100.00%) - BytesSent: 150.91 MB (158240133) - OverallThroughput: 142.52 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 6.41M (6408121) - SerializeBatchTime: 1s056ms - UncompressedRowBatchSize: 150.91 MB (158240133) CodeGen:(Total: 55.171ms, non-child: 55.171ms, % non-child: 100.00%) - CodegenTime: 1.148ms - CompileTime: 7.822ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.584ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.294ms HDFS_SCAN_NODE (id=1):(Total: 566.807ms, non-child: 566.807ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:3/549.39 MB 5:3/418.41 MB 1:3/367.50 MB 0:1/36.47 MB 3:3/573.97 MB 6:3/137.52 MB 2:3/585.53 MB 4:6/933.30 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 502ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB, 92.24 MB - FooterProcessingTime: (Avg: 2.787ms ; Min: 2.713ms ; Max: 2.861ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 92.24 MB (96722254) - BytesReadDataNodeCache: 0 - BytesReadLocal: 92.24 MB (96722254) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 92.24 MB (96722254) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 317.981ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 108.14 MB (113398169) - PerReadThreadRawHdfsThroughput: 911.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30.558ms - RowBatchQueuePutWaitTime: 16s144ms - RowsRead: 6.41M (6408121) - RowsReturned: 6.41M (6408121) - RowsReturnedRate: 11.31 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 974 (974) - ScannerThreadsTotalWallClockTime: 23s778ms - MaterializeTupleTime(*): 525.502ms - ScannerThreadsSysTime: 85.986ms - ScannerThreadsUserTime: 7s522ms - ScannerThreadsVoluntaryContextSwitches: 5.74K (5740) - TotalRawHdfsReadTime(*): 101.201ms - TotalReadThroughput: 7.38 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 23 (23) - Files total: 25 (25) - RowGroups processed: 6.26K (6259) - RowGroups rejected: 0 (0) - RowGroups total: 6.26K (6259) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 6.41M (6408121) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000139 (host=foo.234.50:22000):(Total: 12s988ms, non-child: 11s068ms, % non-child: 85.22%) Hdfs split stats (:<# splits>/): 5:1/252.47 MB 3:1/195.81 MB 6:1/253.91 MB 2:2/221.68 MB 1:5/1.08 GB 0:1/232.72 MB 4:4/700.49 MB 7:4/583.15 MB Filter 4 arrival: 443ms MemoryUsage(500.000ms): 581.02 KB, 141.46 MB, 142.86 MB, 142.58 MB, 142.15 MB, 142.75 MB, 142.54 MB, 142.52 MB, 126.83 MB, 126.95 MB, 126.73 MB, 118.64 MB, 110.79 MB, 110.85 MB, 94.88 MB, 94.91 MB, 95.05 MB, 86.91 MB, 78.89 MB, 78.90 MB, 78.96 MB, 78.96 MB, 41.40 MB, 33.50 MB, 25.37 MB, 2.48 MB ThreadUsage(500.000ms): 1, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1 - AverageThreadTokens: 3.77 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 144.22 MB (151230144) - PerHostPeakMemUsage: 793.73 MB (832285286) - RowsProduced: 8.13M (8133530) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9s161ms - TotalStorageWaitTime: 61.890ms - TotalThreadsInvoluntaryContextSwitches: 2.29K (2290) - TotalThreadsTotalWallClockTime: 49s115ms - TotalThreadsSysTime: 1s261ms - TotalThreadsUserTime: 16s587ms - TotalThreadsVoluntaryContextSwitches: 158.06K (158062) Fragment Instance Lifecycle Timings: - ExecTime: 12s934ms - ExecTreeExecTime: 475.127ms - OpenTime: 23.905ms - ExecTreeOpenTime: 63.223us - PrepareTime: 29.864ms - ExecTreePrepareTime: 316.970us DataStreamSender (dst_id=20):(Total: 1s400ms, non-child: 1s400ms, % non-child: 100.00%) - BytesSent: 192.91 MB (202278735) - OverallThroughput: 137.75 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 8.13M (8133530) - SerializeBatchTime: 1s397ms - UncompressedRowBatchSize: 192.91 MB (202278735) CodeGen:(Total: 49.949ms, non-child: 49.949ms, % non-child: 100.00%) - CodegenTime: 1.168ms - CompileTime: 6.597ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.530ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.347ms HDFS_SCAN_NODE (id=1):(Total: 469.408ms, non-child: 469.408ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/252.47 MB 3:1/195.81 MB 6:1/253.91 MB 2:2/221.68 MB 1:5/1.08 GB 0:1/232.72 MB 4:4/700.49 MB 7:4/583.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 402ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:16 PARQUET/SNAPPY:12 BytesRead(500.000ms): 0, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB, 118.57 MB - FooterProcessingTime: (Avg: 2.308ms ; Min: 2.251ms ; Max: 2.420ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.88 - BytesRead: 118.57 MB (124329826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 118.57 MB (124329826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 118.57 MB (124329826) - CachedFileHandlesHitCount: 26 (26) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 406.349ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 140.15 MB (146953746) - PerReadThreadRawHdfsThroughput: 921.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.498ms - RowBatchQueuePutWaitTime: 21s319ms - RowsRead: 8.13M (8133530) - RowsReturned: 8.13M (8133530) - RowsReturnedRate: 17.33 M/sec - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1.84K (1837) - ScannerThreadsTotalWallClockTime: 36s157ms - MaterializeTupleTime(*): 668.122ms - ScannerThreadsSysTime: 1s142ms - ScannerThreadsUserTime: 13s386ms - ScannerThreadsVoluntaryContextSwitches: 156.92K (156916) - TotalRawHdfsReadTime(*): 128.620ms - TotalReadThroughput: 9.49 MB/sec Filter 4 (8.00 KB): - Files processed: 19 (19) - Files rejected: 16 (16) - Files total: 19 (19) - RowGroups processed: 7.94K (7944) - RowGroups rejected: 0 (0) - RowGroups total: 7.94K (7944) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 8.13M (8133530) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000015f (host=foo.234.38:22000):(Total: 12s513ms, non-child: 10s635ms, % non-child: 84.99%) Hdfs split stats (:<# splits>/): 0:5/326.38 MB 4:2/462.52 MB 1:2/140.15 MB 3:3/257.10 MB 2:4/777.85 MB 6:5/904.39 MB 7:2/409.92 MB Filter 4 arrival: 555ms MemoryUsage(500.000ms): 581.02 KB, 126.22 MB, 126.22 MB, 124.67 MB, 125.02 MB, 124.97 MB, 109.50 MB, 109.17 MB, 109.20 MB, 101.39 MB, 93.03 MB, 93.28 MB, 93.03 MB, 93.13 MB, 53.05 MB, 52.89 MB, 52.88 MB, 52.83 MB, 52.82 MB, 36.99 MB, 36.90 MB, 5.86 MB, 2.54 MB, 2.54 MB, 2.54 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1 - AverageThreadTokens: 2.60 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 126.73 MB (132882258) - PerHostPeakMemUsage: 709.26 MB (743711926) - RowsProduced: 7.46M (7464929) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s813ms - TotalStorageWaitTime: 48.373ms - TotalThreadsInvoluntaryContextSwitches: 1.11K (1111) - TotalThreadsTotalWallClockTime: 32s768ms - TotalThreadsSysTime: 143.977ms - TotalThreadsUserTime: 7s425ms - TotalThreadsVoluntaryContextSwitches: 8.29K (8293) Fragment Instance Lifecycle Timings: - ExecTime: 12s453ms - ExecTreeExecTime: 579.134ms - OpenTime: 27.390ms - ExecTreeOpenTime: 65.781us - PrepareTime: 32.783ms - ExecTreePrepareTime: 366.654us DataStreamSender (dst_id=20):(Total: 1s247ms, non-child: 1s247ms, % non-child: 100.00%) - BytesSent: 172.47 MB (180850993) - OverallThroughput: 138.24 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.46M (7464929) - SerializeBatchTime: 1s244ms - UncompressedRowBatchSize: 172.47 MB (180850993) CodeGen:(Total: 56.452ms, non-child: 56.452ms, % non-child: 100.00%) - CodegenTime: 1.420ms - CompileTime: 7.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.860ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.813ms HDFS_SCAN_NODE (id=1):(Total: 573.926ms, non-child: 573.926ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:5/326.38 MB 4:2/462.52 MB 1:2/140.15 MB 3:3/257.10 MB 2:4/777.85 MB 6:5/904.39 MB 7:2/409.92 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 501ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB, 104.88 MB - FooterProcessingTime: (Avg: 2.539ms ; Min: 2.523ms ; Max: 2.555ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 104.88 MB (109972675) - BytesReadDataNodeCache: 0 - BytesReadLocal: 104.88 MB (109972675) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 104.88 MB (109972675) - CachedFileHandlesHitCount: 20 (20) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 382.345ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.65 MB (128604894) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.130ms - RowBatchQueuePutWaitTime: 15s742ms - RowsRead: 7.46M (7464929) - RowsReturned: 7.46M (7464929) - RowsReturnedRate: 13.01 M/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 721 (721) - ScannerThreadsTotalWallClockTime: 20s287ms - MaterializeTupleTime(*): 619.613ms - ScannerThreadsSysTime: 39.993ms - ScannerThreadsUserTime: 4s505ms - ScannerThreadsVoluntaryContextSwitches: 6.90K (6904) - TotalRawHdfsReadTime(*): 94.331ms - TotalReadThroughput: 9.53 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 21 (21) - Files total: 23 (23) - RowGroups processed: 7.29K (7291) - RowGroups rejected: 0 (0) - RowGroups total: 7.29K (7291) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.46M (7464929) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000113 (host=foo.234.46:22000):(Total: 12s384ms, non-child: 10s955ms, % non-child: 88.46%) Hdfs split stats (:<# splits>/): 1:4/731.98 MB 5:1/254.11 MB 3:1/254.05 MB 4:4/738.63 MB 2:5/969.89 MB 0:2/342.98 MB Filter 4 arrival: 57ms MemoryUsage(500.000ms): 589.02 KB, 126.40 MB, 126.40 MB, 124.53 MB, 124.63 MB, 125.02 MB, 125.05 MB, 109.37 MB, 109.49 MB, 109.32 MB, 109.31 MB, 93.13 MB, 93.26 MB, 77.46 MB, 77.43 MB, 61.49 MB, 49.36 MB, 49.49 MB, 49.52 MB, 49.49 MB, 33.37 MB, 33.43 MB, 5.35 MB, 2.36 MB, 2.36 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1 - AverageThreadTokens: 2.68 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 126.73 MB (132881815) - PerHostPeakMemUsage: 783.23 MB (821271330) - RowsProduced: 7.46M (7457162) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s894ms - TotalStorageWaitTime: 57.468ms - TotalThreadsInvoluntaryContextSwitches: 1.12K (1120) - TotalThreadsTotalWallClockTime: 34s290ms - TotalThreadsSysTime: 231.964ms - TotalThreadsUserTime: 7s292ms - TotalThreadsVoluntaryContextSwitches: 8.33K (8327) Fragment Instance Lifecycle Timings: - ExecTime: 12s328ms - ExecTreeExecTime: 104.348ms - OpenTime: 27.890ms - ExecTreeOpenTime: 72.845us - PrepareTime: 28.202ms - ExecTreePrepareTime: 287.853us DataStreamSender (dst_id=20):(Total: 1s279ms, non-child: 1s279ms, % non-child: 100.00%) - BytesSent: 175.87 MB (184412820) - OverallThroughput: 137.50 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.46M (7457162) - SerializeBatchTime: 1s276ms - UncompressedRowBatchSize: 175.87 MB (184412820) CodeGen:(Total: 52.050ms, non-child: 52.050ms, % non-child: 100.00%) - CodegenTime: 1.197ms - CompileTime: 6.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.070ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 24.547ms HDFS_SCAN_NODE (id=1):(Total: 98.661ms, non-child: 98.661ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:4/731.98 MB 5:1/254.11 MB 3:1/254.05 MB 4:4/738.63 MB 2:5/969.89 MB 0:2/342.98 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:15 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB, 107.39 MB - FooterProcessingTime: (Avg: 2.539ms ; Min: 2.504ms ; Max: 2.573ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.83 - BytesRead: 107.39 MB (112606629) - BytesReadDataNodeCache: 0 - BytesReadLocal: 107.39 MB (112606629) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 107.39 MB (112606629) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 382.504ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.65 MB (128604586) - PerReadThreadRawHdfsThroughput: 1016.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 34.011ms - RowBatchQueuePutWaitTime: 17s482ms - RowsRead: 7.46M (7457162) - RowsReturned: 7.46M (7457162) - RowsReturnedRate: 75.58 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 657 (657) - ScannerThreadsTotalWallClockTime: 21s933ms - MaterializeTupleTime(*): 625.507ms - ScannerThreadsSysTime: 92.985ms - ScannerThreadsUserTime: 4s341ms - ScannerThreadsVoluntaryContextSwitches: 6.95K (6946) - TotalRawHdfsReadTime(*): 105.671ms - TotalReadThroughput: 9.34 MB/sec Filter 4 (8.00 KB): - Files processed: 17 (17) - Files rejected: 15 (15) - Files total: 17 (17) - RowGroups processed: 7.28K (7284) - RowGroups rejected: 0 (0) - RowGroups total: 7.28K (7284) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.46M (7457162) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000012a (host=foo.221.20:22000):(Total: 11s595ms, non-child: 9s326ms, % non-child: 80.43%) Hdfs split stats (:<# splits>/): 5:3/603.77 MB 0:2/399.83 MB 7:1/253.92 MB 1:3/462.80 MB 4:4/324.03 MB 6:5/345.70 MB 3:5/679.24 MB 2:4/393.88 MB Filter 4 arrival: 1s766ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 15.61 MB, 51.97 MB, 52.94 MB, 53.94 MB, 52.02 MB, 51.91 MB, 52.54 MB, 53.31 MB, 52.53 MB, 52.02 MB, 53.43 MB, 52.63 MB, 51.95 MB, 52.06 MB, 52.72 MB, 35.84 MB, 33.73 MB, 33.74 MB, 5.73 MB, 5.26 MB ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1 - AverageThreadTokens: 2.57 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 54.22 MB (56858681) - PerHostPeakMemUsage: 739.01 MB (774910776) - RowsProduced: 2.16M (2164808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s621ms - TotalStorageWaitTime: 45.346ms - TotalThreadsInvoluntaryContextSwitches: 435 (435) - TotalThreadsTotalWallClockTime: 29s466ms - TotalThreadsSysTime: 99.985ms - TotalThreadsUserTime: 3s037ms - TotalThreadsVoluntaryContextSwitches: 3.01K (3012) Fragment Instance Lifecycle Timings: - ExecTime: 11s543ms - ExecTreeExecTime: 1s773ms - OpenTime: 22.404ms - ExecTreeOpenTime: 76.946us - PrepareTime: 29.059ms - ExecTreePrepareTime: 375.349us DataStreamSender (dst_id=20):(Total: 448.825ms, non-child: 448.825ms, % non-child: 100.00%) - BytesSent: 51.28 MB (53769773) - OverallThroughput: 114.25 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 2.16M (2164808) - SerializeBatchTime: 447.817ms - UncompressedRowBatchSize: 51.28 MB (53769773) CodeGen:(Total: 47.925ms, non-child: 47.925ms, % non-child: 100.00%) - CodegenTime: 958.847us - CompileTime: 6.235ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.356ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.897ms HDFS_SCAN_NODE (id=1):(Total: 1s772ms, non-child: 1s772ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:3/603.77 MB 0:2/399.83 MB 7:1/253.92 MB 1:3/462.80 MB 4:4/324.03 MB 6:5/345.70 MB 3:5/679.24 MB 2:4/393.88 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 1s726ms Hdfs Read Thread Concurrency Bucket: 0:95.65% 1:0% 2:4.348% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:25 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 2.06 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB, 31.48 MB - FooterProcessingTime: (Avg: 2.667ms ; Min: 2.660ms ; Max: 2.674ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.57 - BytesRead: 31.48 MB (33006711) - BytesReadDataNodeCache: 0 - BytesReadLocal: 31.48 MB (33006711) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 31.48 MB (33006711) - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 114.282ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 50.13 MB (52569867) - PerReadThreadRawHdfsThroughput: 585.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.775ms - RowBatchQueuePutWaitTime: 15s879ms - RowsRead: 2.16M (2164808) - RowsReturned: 2.16M (2164808) - RowsReturnedRate: 1.22 M/sec - ScanRangesComplete: 27 (27) - ScannerThreadsInvoluntaryContextSwitches: 261 (261) - ScannerThreadsTotalWallClockTime: 17s900ms - MaterializeTupleTime(*): 204.978ms - ScannerThreadsSysTime: 29.995ms - ScannerThreadsUserTime: 1s963ms - ScannerThreadsVoluntaryContextSwitches: 1.96K (1963) - TotalRawHdfsReadTime(*): 53.799ms - TotalReadThroughput: 2.74 MB/sec Filter 4 (8.00 KB): - Files processed: 27 (27) - Files rejected: 25 (25) - Files total: 27 (27) - RowGroups processed: 2.12K (2115) - RowGroups rejected: 0 (0) - RowGroups total: 2.12K (2115) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 2.16M (2164808) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000129 (host=foo.246.52:22000):(Total: 11s396ms, non-child: 9s993ms, % non-child: 87.69%) Hdfs split stats (:<# splits>/): 3:3/366.73 MB 2:1/253.93 MB 1:3/492.96 MB 4:3/490.63 MB 0:1/253.94 MB 5:3/595.35 MB 7:5/818.03 MB 6:2/162.68 MB Filter 4 arrival: 114ms MemoryUsage(500.000ms): 118.01 MB, 116.44 MB, 116.11 MB, 116.62 MB, 116.31 MB, 116.22 MB, 109.15 MB, 100.83 MB, 100.34 MB, 100.94 MB, 100.85 MB, 100.52 MB, 84.89 MB, 76.84 MB, 76.95 MB, 68.96 MB, 68.97 MB, 40.57 MB, 40.49 MB, 40.47 MB, 7.31 MB, 2.42 MB, 2.42 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1 - AverageThreadTokens: 2.74 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 118.21 MB (123952139) - PerHostPeakMemUsage: 773.18 MB (810736619) - RowsProduced: 7.08M (7077433) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8s070ms - TotalStorageWaitTime: 50.956ms - TotalThreadsInvoluntaryContextSwitches: 911 (911) - TotalThreadsTotalWallClockTime: 31s726ms - TotalThreadsSysTime: 221.965ms - TotalThreadsUserTime: 5s464ms - TotalThreadsVoluntaryContextSwitches: 7.93K (7927) Fragment Instance Lifecycle Timings: - ExecTime: 11s341ms - ExecTreeExecTime: 134.356ms - OpenTime: 24.731ms - ExecTreeOpenTime: 62.840us - PrepareTime: 29.590ms - ExecTreePrepareTime: 294.608us DataStreamSender (dst_id=20):(Total: 1s222ms, non-child: 1s222ms, % non-child: 100.00%) - BytesSent: 166.24 MB (174310776) - OverallThroughput: 135.97 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.08M (7077433) - SerializeBatchTime: 1s220ms - UncompressedRowBatchSize: 166.24 MB (174310776) CodeGen:(Total: 50.811ms, non-child: 50.811ms, % non-child: 100.00%) - CodegenTime: 1.115ms - CompileTime: 6.905ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.765ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.667ms HDFS_SCAN_NODE (id=1):(Total: 129.133ms, non-child: 129.133ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:3/366.73 MB 2:1/253.93 MB 1:3/492.96 MB 4:3/490.63 MB 0:1/253.94 MB 5:3/595.35 MB 7:5/818.03 MB 6:2/162.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 61ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:8 BytesRead(500.000ms): 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB, 101.48 MB - FooterProcessingTime: (Avg: 2.461ms ; Min: 2.407ms ; Max: 2.515ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 101.48 MB (106413172) - BytesReadDataNodeCache: 0 - BytesReadLocal: 101.48 MB (106413172) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 101.48 MB (106413172) - CachedFileHandlesHitCount: 20 (20) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 363.660ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 114.15 MB (119692246) - PerReadThreadRawHdfsThroughput: 900.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 31.327ms - RowBatchQueuePutWaitTime: 17s639ms - RowsRead: 7.08M (7077433) - RowsReturned: 7.08M (7077433) - RowsReturnedRate: 54.81 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 491 (491) - ScannerThreadsTotalWallClockTime: 20s360ms - MaterializeTupleTime(*): 602.851ms - ScannerThreadsSysTime: 57.990ms - ScannerThreadsUserTime: 2s660ms - ScannerThreadsVoluntaryContextSwitches: 6.58K (6576) - TotalRawHdfsReadTime(*): 112.635ms - TotalReadThroughput: 9.67 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 19 (19) - Files total: 21 (21) - RowGroups processed: 6.91K (6913) - RowGroups rejected: 0 (0) - RowGroups total: 6.91K (6913) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.08M (7077433) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000012d (host=foo.246.38:22000):(Total: 11s014ms, non-child: 9s354ms, % non-child: 84.94%) Hdfs split stats (:<# splits>/): 1:1/96.95 MB 6:4/376.40 MB 3:4/769.42 MB 7:4/701.19 MB 0:1/254.02 MB 5:4/700.29 MB 4:4/606.43 MB Filter 4 arrival: 336ms MemoryUsage(500.000ms): 581.02 KB, 125.50 MB, 125.24 MB, 123.90 MB, 124.30 MB, 125.08 MB, 124.83 MB, 109.04 MB, 108.60 MB, 108.88 MB, 100.44 MB, 100.56 MB, 93.01 MB, 85.05 MB, 76.76 MB, 77.17 MB, 77.13 MB, 60.80 MB, 45.23 MB, 37.39 MB, 29.36 MB, 2.52 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.82 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 126.21 MB (132339071) - PerHostPeakMemUsage: 776.11 MB (813807736) - RowsProduced: 7.51M (7509764) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s611ms - TotalStorageWaitTime: 46.763ms - TotalThreadsInvoluntaryContextSwitches: 929 (929) - TotalThreadsTotalWallClockTime: 30s798ms - TotalThreadsSysTime: 151.976ms - TotalThreadsUserTime: 5s439ms - TotalThreadsVoluntaryContextSwitches: 8.43K (8425) Fragment Instance Lifecycle Timings: - ExecTime: 10s959ms - ExecTreeExecTime: 374.337ms - OpenTime: 24.763ms - ExecTreeOpenTime: 95.783us - PrepareTime: 29.906ms - ExecTreePrepareTime: 347.244us DataStreamSender (dst_id=20):(Total: 1s239ms, non-child: 1s239ms, % non-child: 100.00%) - BytesSent: 177.96 MB (186599891) - OverallThroughput: 143.51 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.51M (7509764) - SerializeBatchTime: 1s237ms - UncompressedRowBatchSize: 177.96 MB (186599891) CodeGen:(Total: 50.098ms, non-child: 50.098ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 6.805ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.825ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.750ms HDFS_SCAN_NODE (id=1):(Total: 369.059ms, non-child: 369.059ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/96.95 MB 6:4/376.40 MB 3:4/769.42 MB 7:4/701.19 MB 0:1/254.02 MB 5:4/700.29 MB 4:4/606.43 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 301ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB, 109.17 MB - FooterProcessingTime: (Avg: 2.680ms ; Min: 2.455ms ; Max: 2.905ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 109.17 MB (114473757) - BytesReadDataNodeCache: 0 - BytesReadLocal: 109.17 MB (114473757) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 109.17 MB (114473757) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 370.140ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 122.14 MB (128078256) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.915ms - RowBatchQueuePutWaitTime: 17s218ms - RowsRead: 7.51M (7509764) - RowsReturned: 7.51M (7509764) - RowsReturnedRate: 20.35 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 520 (520) - ScannerThreadsTotalWallClockTime: 19s814ms - MaterializeTupleTime(*): 620.496ms - ScannerThreadsSysTime: 51.991ms - ScannerThreadsUserTime: 2s562ms - ScannerThreadsVoluntaryContextSwitches: 6.99K (6985) - TotalRawHdfsReadTime(*): 99.949ms - TotalReadThroughput: 10.40 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 20 (20) - Files total: 22 (22) - RowGroups processed: 7.33K (7334) - RowGroups rejected: 0 (0) - RowGroups total: 7.33K (7334) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.51M (7509764) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000161 (host=foo.246.47:22000):(Total: 10s348ms, non-child: 9s253ms, % non-child: 89.42%) Hdfs split stats (:<# splits>/): 7:1/254.05 MB 3:2/428.02 MB 1:3/549.29 MB 5:3/642.66 MB 4:2/461.11 MB 6:1/38.81 MB 2:3/422.84 MB 0:7/765.93 MB Filter 4 arrival: 139ms MemoryUsage(500.000ms): 55.69 MB, 96.11 MB, 96.31 MB, 97.79 MB, 97.57 MB, 96.64 MB, 96.73 MB, 97.36 MB, 61.35 MB, 60.41 MB, 60.13 MB, 52.32 MB, 44.27 MB, 36.17 MB, 28.45 MB, 28.52 MB, 28.37 MB, 28.46 MB, 2.63 MB, 2.63 MB, 2.63 MB ThreadUsage(500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 1, 1, 1 - AverageThreadTokens: 3.57 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 98.60 MB (103388242) - PerHostPeakMemUsage: 731.25 MB (766772158) - RowsProduced: 5.15M (5150680) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s934ms - TotalStorageWaitTime: 51.683ms - TotalThreadsInvoluntaryContextSwitches: 1.52K (1523) - TotalThreadsTotalWallClockTime: 36s273ms - TotalThreadsSysTime: 1s869ms - TotalThreadsUserTime: 10s494ms - TotalThreadsVoluntaryContextSwitches: 159.99K (159988) Fragment Instance Lifecycle Timings: - ExecTime: 10s285ms - ExecTreeExecTime: 157.830ms - OpenTime: 26.163ms - ExecTreeOpenTime: 98.757us - PrepareTime: 36.663ms - ExecTreePrepareTime: 446.240us DataStreamSender (dst_id=20):(Total: 888.577ms, non-child: 888.577ms, % non-child: 100.00%) - BytesSent: 120.00 MB (125825385) - OverallThroughput: 135.04 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.15M (5150680) - SerializeBatchTime: 886.791ms - UncompressedRowBatchSize: 120.00 MB (125825385) CodeGen:(Total: 52.317ms, non-child: 52.317ms, % non-child: 100.00%) - CodegenTime: 1.168ms - CompileTime: 7.736ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.346ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 26.612ms HDFS_SCAN_NODE (id=1):(Total: 154.233ms, non-child: 154.233ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/254.05 MB 3:2/428.02 MB 1:3/549.29 MB 5:3/642.66 MB 4:2/461.11 MB 6:1/38.81 MB 2:3/422.84 MB 0:7/765.93 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 100ms Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:0% 2:0% 3:5.556% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:12 BytesRead(500.000ms): 26.90 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB, 73.37 MB - FooterProcessingTime: (Avg: 2.784ms ; Min: 2.654ms ; Max: 2.876ms ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 73.37 MB (76938060) - BytesReadDataNodeCache: 0 - BytesReadLocal: 73.37 MB (76938060) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 73.37 MB (76938060) - CachedFileHandlesHitCount: 19 (19) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 268.246ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 3 (3) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 94.51 MB (99105546) - PerReadThreadRawHdfsThroughput: 953.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.600ms - RowBatchQueuePutWaitTime: 15s419ms - RowsRead: 5.15M (5150680) - RowsReturned: 5.15M (5150680) - RowsReturnedRate: 33.40 M/sec - ScanRangesComplete: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1209) - ScannerThreadsTotalWallClockTime: 25s960ms - MaterializeTupleTime(*): 434.693ms - ScannerThreadsSysTime: 1s775ms - ScannerThreadsUserTime: 8s443ms - ScannerThreadsVoluntaryContextSwitches: 159.03K (159032) - TotalRawHdfsReadTime(*): 76.975ms - TotalReadThroughput: 8.15 MB/sec Filter 4 (8.00 KB): - Files processed: 22 (22) - Files rejected: 19 (19) - Files total: 22 (22) - RowGroups processed: 5.03K (5031) - RowGroups rejected: 0 (0) - RowGroups total: 5.03K (5031) - Rows processed: 49.15K (49152) - Rows rejected: 0 (0) - Rows total: 5.15M (5150680) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) Instance 5f429df048b5534b:41bcce180000017a (host=foo.246.45:22000):(Total: 10s344ms, non-child: 9s156ms, % non-child: 88.52%) Hdfs split stats (:<# splits>/): 1:2/78.22 MB 5:2/221.65 MB 4:2/389.55 MB 7:6/689.26 MB 3:3/594.30 MB 2:1/253.52 MB 0:3/414.69 MB 6:6/951.00 MB Filter 4 arrival: 136ms MemoryUsage(500.000ms): 96.60 MB, 98.80 MB, 98.23 MB, 98.28 MB, 97.55 MB, 97.56 MB, 90.01 MB, 82.35 MB, 82.03 MB, 82.31 MB, 82.08 MB, 82.01 MB, 66.02 MB, 66.22 MB, 50.23 MB, 50.25 MB, 50.07 MB, 42.26 MB, 22.52 MB, 4.94 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.90 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 99.48 MB (104307640) - PerHostPeakMemUsage: 713.22 MB (747860247) - RowsProduced: 5.61M (5609812) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s719ms - TotalStorageWaitTime: 65.145ms - TotalThreadsInvoluntaryContextSwitches: 717 (717) - TotalThreadsTotalWallClockTime: 29s566ms - TotalThreadsSysTime: 151.976ms - TotalThreadsUserTime: 3s886ms - TotalThreadsVoluntaryContextSwitches: 6.66K (6660) Fragment Instance Lifecycle Timings: - ExecTime: 10s290ms - ExecTreeExecTime: 174.293ms - OpenTime: 26.492ms - ExecTreeOpenTime: 84.396us - PrepareTime: 27.186ms - ExecTreePrepareTime: 348.358us DataStreamSender (dst_id=20):(Total: 967.257ms, non-child: 967.257ms, % non-child: 100.00%) - BytesSent: 132.58 MB (139023747) - OverallThroughput: 137.07 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 5.61M (5609812) - SerializeBatchTime: 965.359ms - UncompressedRowBatchSize: 132.58 MB (139023747) CodeGen:(Total: 49.347ms, non-child: 49.347ms, % non-child: 100.00%) - CodegenTime: 1.253ms - CompileTime: 7.196ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.446ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 23.264ms HDFS_SCAN_NODE (id=1):(Total: 170.798ms, non-child: 170.798ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/78.22 MB 5:2/221.65 MB 4:2/389.55 MB 7:6/689.26 MB 3:3/594.30 MB 2:1/253.52 MB 0:3/414.69 MB 6:6/951.00 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 100ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:8 BytesRead(500.000ms): 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB, 81.45 MB - FooterProcessingTime: (Avg: 2.541ms ; Min: 2.227ms ; Max: 2.855ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 81.45 MB (85411607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.45 MB (85411607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.45 MB (85411607) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 287.791ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 95.40 MB (100030549) - PerReadThreadRawHdfsThroughput: 880.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.388ms - RowBatchQueuePutWaitTime: 17s563ms - RowsRead: 5.61M (5609812) - RowsReturned: 5.61M (5609812) - RowsReturnedRate: 32.84 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 349 (349) - ScannerThreadsTotalWallClockTime: 19s249ms - MaterializeTupleTime(*): 474.575ms - ScannerThreadsSysTime: 40.993ms - ScannerThreadsUserTime: 1s617ms - ScannerThreadsVoluntaryContextSwitches: 5.29K (5286) - TotalRawHdfsReadTime(*): 92.485ms - TotalReadThroughput: 8.15 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 23 (23) - Files total: 25 (25) - RowGroups processed: 5.48K (5480) - RowGroups rejected: 0 (0) - RowGroups total: 5.48K (5480) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 5.61M (5609812) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000135 (host=foo.246.44:22000):(Total: 9s863ms, non-child: 8s394ms, % non-child: 85.10%) Hdfs split stats (:<# splits>/): 6:1/254.14 MB 7:2/394.06 MB 1:2/39.41 MB 3:2/483.88 MB 4:3/498.44 MB 0:4/333.27 MB 2:5/736.38 MB 5:6/772.39 MB Filter 4 arrival: 187ms MemoryUsage(500.000ms): 8.60 MB, 121.20 MB, 120.90 MB, 121.80 MB, 121.96 MB, 121.30 MB, 121.76 MB, 113.79 MB, 106.01 MB, 105.68 MB, 105.49 MB, 106.16 MB, 105.98 MB, 105.56 MB, 81.89 MB, 73.98 MB, 74.20 MB, 46.36 MB, 22.48 MB, 6.07 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.90 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 123.29 MB (129276947) - PerHostPeakMemUsage: 791.88 MB (830341532) - RowsProduced: 7.26M (7261988) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s717ms - TotalStorageWaitTime: 60.026ms - TotalThreadsInvoluntaryContextSwitches: 844 (844) - TotalThreadsTotalWallClockTime: 28s508ms - TotalThreadsSysTime: 169.974ms - TotalThreadsUserTime: 4s861ms - TotalThreadsVoluntaryContextSwitches: 7.99K (7986) Fragment Instance Lifecycle Timings: - ExecTime: 9s804ms - ExecTreeExecTime: 218.737ms - OpenTime: 25.399ms - ExecTreeOpenTime: 77.478us - PrepareTime: 33.882ms - ExecTreePrepareTime: 342.271us DataStreamSender (dst_id=20):(Total: 1s200ms, non-child: 1s200ms, % non-child: 100.00%) - BytesSent: 172.43 MB (180801756) - OverallThroughput: 143.62 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 7.26M (7261988) - SerializeBatchTime: 1s198ms - UncompressedRowBatchSize: 172.43 MB (180801756) CodeGen:(Total: 54.387ms, non-child: 54.387ms, % non-child: 100.00%) - CodegenTime: 1.290ms - CompileTime: 6.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.643ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.414ms HDFS_SCAN_NODE (id=1):(Total: 214.336ms, non-child: 214.336ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/254.14 MB 7:2/394.06 MB 1:2/39.41 MB 3:2/483.88 MB 4:3/498.44 MB 0:4/333.27 MB 2:5/736.38 MB 5:6/772.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 140ms Hdfs Read Thread Concurrency Bucket: 0:95% 1:0% 2:5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:23 PARQUET/SNAPPY:8 BytesRead(500.000ms): 200.00 KB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB, 105.95 MB - FooterProcessingTime: (Avg: 2.938ms ; Min: 2.933ms ; Max: 2.942ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 1.90 - BytesRead: 105.95 MB (111098009) - BytesReadDataNodeCache: 0 - BytesReadLocal: 105.95 MB (111098009) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 105.95 MB (111098009) - CachedFileHandlesHitCount: 21 (21) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 350.932ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 119.21 MB (125001692) - PerReadThreadRawHdfsThroughput: 978.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.055ms - RowBatchQueuePutWaitTime: 16s521ms - RowsRead: 7.26M (7261988) - RowsReturned: 7.26M (7261988) - RowsReturnedRate: 33.88 M/sec - ScanRangesComplete: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 445 (445) - ScannerThreadsTotalWallClockTime: 18s679ms - MaterializeTupleTime(*): 584.952ms - ScannerThreadsSysTime: 45.992ms - ScannerThreadsUserTime: 2s103ms - ScannerThreadsVoluntaryContextSwitches: 6.74K (6743) - TotalRawHdfsReadTime(*): 108.327ms - TotalReadThroughput: 10.60 MB/sec Filter 4 (8.00 KB): - Files processed: 25 (25) - Files rejected: 23 (23) - Files total: 25 (25) - RowGroups processed: 7.09K (7093) - RowGroups rejected: 0 (0) - RowGroups total: 7.09K (7093) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 7.26M (7261988) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce180000016a (host=foo.246.46:22000):(Total: 9s524ms, non-child: 8s639ms, % non-child: 90.71%) Hdfs split stats (:<# splits>/): 0:1/159.31 MB 6:1/254.05 MB 3:2/291.25 MB 5:1/45.75 MB 7:6/1.02 GB 2:2/445.69 MB 1:7/1.44 GB Filter 4 arrival: 145ms MemoryUsage(500.000ms): 85.66 MB, 86.69 MB, 85.72 MB, 87.51 MB, 86.51 MB, 87.28 MB, 68.62 MB, 68.73 MB, 68.63 MB, 60.36 MB, 59.96 MB, 60.49 MB, 52.07 MB, 44.48 MB, 44.36 MB, 36.51 MB, 36.58 MB, 36.41 MB, 2.54 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.89 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 88.22 MB (92508919) - PerHostPeakMemUsage: 620.41 MB (650545234) - RowsProduced: 4.10M (4100816) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s582ms - TotalStorageWaitTime: 51.117ms - TotalThreadsInvoluntaryContextSwitches: 1.05K (1051) - TotalThreadsTotalWallClockTime: 27s548ms - TotalThreadsSysTime: 83.986ms - TotalThreadsUserTime: 8s147ms - TotalThreadsVoluntaryContextSwitches: 4.57K (4573) Fragment Instance Lifecycle Timings: - ExecTime: 9s477ms - ExecTreeExecTime: 147.496ms - OpenTime: 23.575ms - ExecTreeOpenTime: 68.625us - PrepareTime: 23.853ms - ExecTreePrepareTime: 185.408us DataStreamSender (dst_id=20):(Total: 695.691ms, non-child: 695.691ms, % non-child: 100.00%) - BytesSent: 95.99 MB (100657140) - OverallThroughput: 137.98 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.10M (4100816) - SerializeBatchTime: 694.272ms - UncompressedRowBatchSize: 95.99 MB (100657140) CodeGen:(Total: 44.384ms, non-child: 44.384ms, % non-child: 100.00%) - CodegenTime: 1.188ms - CompileTime: 6.682ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.198ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.014ms HDFS_SCAN_NODE (id=1):(Total: 144.806ms, non-child: 144.806ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/159.31 MB 6:1/254.05 MB 3:2/291.25 MB 5:1/45.75 MB 7:6/1.02 GB 2:2/445.69 MB 1:7/1.44 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 101ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:8 BytesRead(500.000ms): 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB, 59.43 MB - FooterProcessingTime: (Avg: 2.347ms ; Min: 2.235ms ; Max: 2.459ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 59.43 MB (62317923) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.43 MB (62317923) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.43 MB (62317923) - CachedFileHandlesHitCount: 14 (14) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 202.876ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 84.13 MB (88221779) - PerReadThreadRawHdfsThroughput: 799.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.864ms - RowBatchQueuePutWaitTime: 11s462ms - RowsRead: 4.10M (4100816) - RowsReturned: 4.10M (4100816) - RowsReturnedRate: 28.32 M/sec - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 788 (788) - ScannerThreadsTotalWallClockTime: 18s047ms - MaterializeTupleTime(*): 334.028ms - ScannerThreadsSysTime: 16.997ms - ScannerThreadsUserTime: 6s526ms - ScannerThreadsVoluntaryContextSwitches: 3.47K (3468) - TotalRawHdfsReadTime(*): 74.336ms - TotalReadThroughput: 6.60 MB/sec Filter 4 (8.00 KB): - Files processed: 20 (20) - Files rejected: 18 (18) - Files total: 20 (20) - RowGroups processed: 4.01K (4006) - RowGroups rejected: 0 (0) - RowGroups total: 4.01K (4006) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 4.10M (4100816) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000158 (host=foo.246.35:22000):(Total: 7s662ms, non-child: 6s523ms, % non-child: 85.14%) Hdfs split stats (:<# splits>/): 5:1/254.06 MB 6:2/36.10 MB 3:3/400.60 MB 4:6/965.41 MB 1:1/5.56 MB 2:4/512.26 MB 7:4/704.13 MB 0:3/466.24 MB Filter 4 arrival: 312ms MemoryUsage(500.000ms): 581.02 KB, 81.61 MB, 80.47 MB, 80.39 MB, 79.86 MB, 79.61 MB, 79.89 MB, 80.43 MB, 80.12 MB, 64.40 MB, 43.99 MB, 42.54 MB, 34.80 MB, 26.77 MB, 2.37 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.73 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 81.71 MB (85677868) - PerHostPeakMemUsage: 728.36 MB (763742099) - RowsProduced: 4.31M (4310604) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s301ms - TotalStorageWaitTime: 51.537ms - TotalThreadsInvoluntaryContextSwitches: 623 (623) - TotalThreadsTotalWallClockTime: 20s731ms - TotalThreadsSysTime: 140.978ms - TotalThreadsUserTime: 4s158ms - TotalThreadsVoluntaryContextSwitches: 5.31K (5310) Fragment Instance Lifecycle Timings: - ExecTime: 7s609ms - ExecTreeExecTime: 320.340ms - OpenTime: 23.891ms - ExecTreeOpenTime: 76.042us - PrepareTime: 29.002ms - ExecTreePrepareTime: 296.088us DataStreamSender (dst_id=20):(Total: 772.242ms, non-child: 772.242ms, % non-child: 100.00%) - BytesSent: 101.19 MB (106105112) - OverallThroughput: 131.03 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 4.31M (4310604) - SerializeBatchTime: 770.417ms - UncompressedRowBatchSize: 101.19 MB (106105112) CodeGen:(Total: 49.386ms, non-child: 49.386ms, % non-child: 100.00%) - CodegenTime: 1.120ms - CompileTime: 6.314ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.636ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.955ms HDFS_SCAN_NODE (id=1):(Total: 317.384ms, non-child: 317.384ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/254.06 MB 6:2/36.10 MB 3:3/400.60 MB 4:6/965.41 MB 1:1/5.56 MB 2:4/512.26 MB 7:4/704.13 MB 0:3/466.24 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 261ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:22 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB, 61.99 MB - FooterProcessingTime: (Avg: 2.664ms ; Min: 2.625ms ; Max: 2.704ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 61.99 MB (64999841) - BytesReadDataNodeCache: 0 - BytesReadLocal: 61.99 MB (64999841) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 61.99 MB (64999841) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 225.377ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.65 MB (81418374) - PerReadThreadRawHdfsThroughput: 849.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.933ms - RowBatchQueuePutWaitTime: 10s667ms - RowsRead: 4.31M (4310604) - RowsReturned: 4.31M (4310604) - RowsReturnedRate: 13.58 M/sec - ScanRangesComplete: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 365 (365) - ScannerThreadsTotalWallClockTime: 13s097ms - MaterializeTupleTime(*): 370.089ms - ScannerThreadsSysTime: 51.991ms - ScannerThreadsUserTime: 2s357ms - ScannerThreadsVoluntaryContextSwitches: 3.97K (3973) - TotalRawHdfsReadTime(*): 72.938ms - TotalReadThroughput: 8.86 MB/sec Filter 4 (8.00 KB): - Files processed: 24 (24) - Files rejected: 22 (22) - Files total: 24 (24) - RowGroups processed: 4.21K (4210) - RowGroups rejected: 0 (0) - RowGroups total: 4.21K (4210) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 4.31M (4310604) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000127 (host=foo.187.39:22000):(Total: 7s456ms, non-child: 4s883ms, % non-child: 65.49%) Hdfs split stats (:<# splits>/): 7:1/188.45 MB 0:2/452.21 MB 5:4/574.30 MB 4:3/266.21 MB 2:3/151.65 MB 6:2/334.30 MB 1:3/466.30 MB 3:5/1.10 GB Filter 4 arrival: 2s175ms MemoryUsage(500.000ms): 581.02 KB, 581.02 KB, 581.02 KB, 581.02 KB, 43.91 MB, 36.62 MB, 34.47 MB, 35.92 MB, 34.78 MB, 35.88 MB, 34.89 MB, 27.16 MB, 2.83 MB, 2.83 MB, 2.83 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1 - AverageThreadTokens: 2.07 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 44.47 MB (46635300) - PerHostPeakMemUsage: 671.83 MB (704464905) - RowsProduced: 1.80M (1796782) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s006ms - TotalStorageWaitTime: 30.846ms - TotalThreadsInvoluntaryContextSwitches: 561 (561) - TotalThreadsTotalWallClockTime: 15s425ms - TotalThreadsSysTime: 90.986ms - TotalThreadsUserTime: 4s358ms - TotalThreadsVoluntaryContextSwitches: 2.24K (2240) Fragment Instance Lifecycle Timings: - ExecTime: 7s410ms - ExecTreeExecTime: 2s180ms - OpenTime: 22.961ms - ExecTreeOpenTime: 92.680us - PrepareTime: 23.747ms - ExecTreePrepareTime: 275.323us DataStreamSender (dst_id=20):(Total: 351.253ms, non-child: 351.253ms, % non-child: 100.00%) - BytesSent: 42.36 MB (44419285) - OverallThroughput: 120.60 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 1.80M (1796782) - SerializeBatchTime: 350.481ms - UncompressedRowBatchSize: 42.36 MB (44419285) CodeGen:(Total: 42.020ms, non-child: 42.020ms, % non-child: 100.00%) - CodegenTime: 1.152ms - CompileTime: 6.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.933ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.402ms HDFS_SCAN_NODE (id=1):(Total: 2s179ms, non-child: 2s179ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/188.45 MB 0:2/452.21 MB 5:4/574.30 MB 4:3/266.21 MB 2:3/151.65 MB 6:2/334.30 MB 1:3/466.30 MB 3:5/1.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: All filters arrived. Waited 2s148ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:21 PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0, 0, 0, 26.40 MB, 26.40 MB, 26.40 MB, 26.40 MB, 26.40 MB, 26.40 MB, 26.40 MB, 26.40 MB - FooterProcessingTime: (Avg: 2.881ms ; Min: 2.848ms ; Max: 2.914ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 26.40 MB (27679296) - BytesReadDataNodeCache: 0 - BytesReadLocal: 26.40 MB (27679296) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26.40 MB (27679296) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 85.220ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 40.38 MB (42340225) - PerReadThreadRawHdfsThroughput: 690.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.872ms - RowBatchQueuePutWaitTime: 4s393ms - RowsRead: 1.80M (1796782) - RowsReturned: 1.80M (1796782) - RowsReturnedRate: 824.28 K/sec - ScanRangesComplete: 23 (23) - ScannerThreadsInvoluntaryContextSwitches: 417 (417) - ScannerThreadsTotalWallClockTime: 7s992ms - MaterializeTupleTime(*): 159.767ms - ScannerThreadsSysTime: 34.994ms - ScannerThreadsUserTime: 3s538ms - ScannerThreadsVoluntaryContextSwitches: 1.40K (1398) - TotalRawHdfsReadTime(*): 38.211ms - TotalReadThroughput: 4.40 MB/sec Filter 4 (8.00 KB): - Files processed: 23 (23) - Files rejected: 21 (21) - Files total: 23 (23) - RowGroups processed: 1.75K (1755) - RowGroups rejected: 0 (0) - RowGroups total: 1.75K (1755) - Rows processed: 32.77K (32768) - Rows rejected: 0 (0) - Rows total: 1.80M (1796782) - Splits processed: 2 (2) - Splits rejected: 0 (0) - Splits total: 2 (2) Instance 5f429df048b5534b:41bcce1800000189 (host=foo.246.40:22000):(Total: 3s273ms, non-child: 2s686ms, % non-child: 82.06%) Hdfs split stats (:<# splits>/): 6:1/253.95 MB 2:3/590.52 MB 3:2/508.03 MB 7:3/604.64 MB 0:3/368.60 MB 4:5/751.72 MB 1:4/286.05 MB Filter 4 arrival: 253ms MemoryUsage(500.000ms): 568.41 KB, 39.00 MB, 39.41 MB, 37.42 MB, 37.74 MB, 30.46 MB, 2.11 MB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.71 - BloomFilterBytes: 8.00 KB (8192) - PeakMemoryUsage: 39.85 MB (41781629) - PerHostPeakMemUsage: 201.17 MB (210939788) - RowsProduced: 1.76M (1755658) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s162ms - TotalStorageWaitTime: 29.321ms - TotalThreadsInvoluntaryContextSwitches: 152 (152) - TotalThreadsTotalWallClockTime: 5s582ms - TotalThreadsSysTime: 63.990ms - TotalThreadsUserTime: 913.860ms - TotalThreadsVoluntaryContextSwitches: 1.76K (1762) Fragment Instance Lifecycle Timings: - ExecTime: 3s215ms - ExecTreeExecTime: 247.388ms - OpenTime: 26.143ms - ExecTreeOpenTime: 83.393us - PrepareTime: 31.941ms - ExecTreePrepareTime: 423.016us DataStreamSender (dst_id=20):(Total: 287.102ms, non-child: 287.102ms, % non-child: 100.00%) - BytesSent: 41.46 MB (43473296) - OverallThroughput: 144.41 MB/sec - PeakMemoryUsage: 4.08 MB (4280736) - RowsReturned: 1.76M (1755658) - SerializeBatchTime: 286.259ms - UncompressedRowBatchSize: 41.46 MB (43473296) CodeGen:(Total: 52.881ms, non-child: 52.881ms, % non-child: 100.00%) - CodegenTime: 1.270ms - CompileTime: 6.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.695ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 27.141ms HDFS_SCAN_NODE (id=1):(Total: 247.168ms, non-child: 247.168ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.95 MB 2:3/590.52 MB 3:2/508.03 MB 7:3/604.64 MB 0:3/368.60 MB 4:5/751.72 MB 1:4/286.05 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:4 BytesRead(500.000ms): 0, 25.79 MB, 25.79 MB, 25.79 MB, 25.79 MB, 25.79 MB - FooterProcessingTime: (Avg: 2.923ms ; Min: 2.923ms ; Max: 2.923ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 25.79 MB (27038391) - BytesReadDataNodeCache: 0 - BytesReadLocal: 25.79 MB (27038391) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 25.79 MB (27038391) - CachedFileHandlesHitCount: 6 (6) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 82.314ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 35.77 MB (37504151) - PerReadThreadRawHdfsThroughput: 744.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.976ms - RowBatchQueuePutWaitTime: 2s056ms - RowsRead: 1.76M (1755658) - RowsReturned: 1.76M (1755658) - RowsReturnedRate: 7.10 M/sec - ScanRangesComplete: 21 (21) - ScannerThreadsInvoluntaryContextSwitches: 54 (54) - ScannerThreadsTotalWallClockTime: 2s341ms - MaterializeTupleTime(*): 151.727ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 243.962ms - ScannerThreadsVoluntaryContextSwitches: 984 (984) - TotalRawHdfsReadTime(*): 34.616ms - TotalReadThroughput: 8.60 MB/sec Filter 4 (8.00 KB): - Files processed: 21 (21) - Files rejected: 20 (20) - Files total: 21 (21) - RowGroups processed: 1.72K (1715) - RowGroups rejected: 0 (0) - RowGroups total: 1.72K (1715) - Rows processed: 16.38K (16384) - Rows rejected: 0 (0) - Rows total: 1.76M (1755658) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) Averaged Fragment F06:(Total: 1s574ms, non-child: 1s494ms, % non-child: 94.93%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:1s610ms max:1s610ms mean: 1s610ms stddev:0.000ns execution rates: min:1.33 MB/sec max:1.33 MB/sec mean:1.33 MB/sec stddev:0.50 B/sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643810) - PerHostPeakMemUsage: 24.69 MB (25894531) - RowsProduced: 274 (274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s372ms - TotalStorageWaitTime: 1.515ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s545ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 191 (191) Fragment Instance Lifecycle Timings: - ExecTime: 1s494ms - ExecTreeExecTime: 8.533ms - OpenTime: 41.860ms - ExecTreeOpenTime: 43.574us - PrepareTime: 38.064ms - ExecTreePrepareTime: 140.446us DataStreamSender (dst_id=21):(Total: 636.506us, non-child: 636.506us, % non-child: 100.00%) - BytesSent: 426.81 KB (437052) - OverallThroughput: 654.83 MB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 274 (274) - SerializeBatchTime: 28.817us - UncompressedRowBatchSize: 426.81 KB (437052) CodeGen:(Total: 70.358ms, non-child: 70.358ms, % non-child: 100.00%) - CodegenTime: 923.583us - CompileTime: 9.718ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 38 (38) - NumInstructions: 550 (550) - OptimizationTime: 31.078ms - PeakMemoryUsage: 275.00 KB (281600) - PrepareTime: 28.997ms HDFS_SCAN_NODE (id=4):(Total: 8.895ms, non-child: 8.895ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 115.125us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 351.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.115ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 274 (274) - RowsReturnedRate: 30.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.411ms - MaterializeTupleTime(*): 4.716ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 1.305ms - TotalReadThroughput: 0.00 /sec Fragment F06: Instance 5f429df048b5534b:41bcce1800000192 (host=foo.221.36:22000):(Total: 1s574ms, non-child: 1s494ms, % non-child: 94.93%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB MemoryUsage(500.000ms): 799.15 KB, 799.15 KB, 799.15 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643810) - PerHostPeakMemUsage: 24.69 MB (25894531) - RowsProduced: 274 (274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s372ms - TotalStorageWaitTime: 1.515ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s545ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 191 (191) Fragment Instance Lifecycle Timings: - ExecTime: 1s494ms - ExecTreeExecTime: 8.533ms - OpenTime: 41.860ms - ExecTreeOpenTime: 43.574us - PrepareTime: 38.064ms - ExecTreePrepareTime: 140.446us DataStreamSender (dst_id=21):(Total: 636.506us, non-child: 636.506us, % non-child: 100.00%) - BytesSent: 426.81 KB (437052) - OverallThroughput: 654.83 MB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 274 (274) - SerializeBatchTime: 28.817us - UncompressedRowBatchSize: 426.81 KB (437052) CodeGen:(Total: 70.358ms, non-child: 70.358ms, % non-child: 100.00%) - CodegenTime: 923.583us - CompileTime: 9.718ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 38 (38) - NumInstructions: 550 (550) - OptimizationTime: 31.078ms - PeakMemoryUsage: 275.00 KB (281600) - PrepareTime: 28.997ms HDFS_SCAN_NODE (id=4):(Total: 8.895ms, non-child: 8.895ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 214.935us ; Min: 214.935us ; Max: 214.935us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 115.125us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 351.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.115ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 274 (274) - RowsReturnedRate: 30.80 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.411ms - MaterializeTupleTime(*): 4.716ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 1.305ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F08:(Total: 1s600ms, non-child: 1s513ms, % non-child: 94.57%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:1s630ms max:1s630ms mean: 1s630ms stddev:0.000ns execution rates: min:1.32 MB/sec max:1.32 MB/sec mean:1.32 MB/sec stddev:0.88 B/sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643810) - PerHostPeakMemUsage: 40.30 MB (42254172) - RowsProduced: 274 (274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s444ms - TotalStorageWaitTime: 2.151ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s567ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 201 (201) Fragment Instance Lifecycle Timings: - ExecTime: 1s514ms - ExecTreeExecTime: 8.804ms - OpenTime: 44.043ms - ExecTreeOpenTime: 39.485us - PrepareTime: 41.829ms - ExecTreePrepareTime: 162.009us DataStreamSender (dst_id=24):(Total: 170.872us, non-child: 170.872us, % non-child: 100.00%) - BytesSent: 426.81 KB (437052) - OverallThroughput: 2.38 GB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 274 (274) - SerializeBatchTime: 22.526us - UncompressedRowBatchSize: 426.81 KB (437052) CodeGen:(Total: 77.593ms, non-child: 77.593ms, % non-child: 100.00%) - CodegenTime: 982.348us - CompileTime: 10.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 38 (38) - NumInstructions: 550 (550) - OptimizationTime: 32.252ms - PeakMemoryUsage: 275.00 KB (281600) - PrepareTime: 33.806ms HDFS_SCAN_NODE (id=5):(Total: 9.210ms, non-child: 9.210ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 128.953us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 379.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.437ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 274 (274) - RowsReturnedRate: 29.75 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.963ms - MaterializeTupleTime(*): 4.764ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 1.208ms - TotalReadThroughput: 0.00 /sec Fragment F08: Instance 5f429df048b5534b:41bcce1800000214 (host=foo.221.36:22000):(Total: 1s600ms, non-child: 1s513ms, % non-child: 94.57%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB MemoryUsage(500.000ms): 799.15 KB, 799.15 KB, 799.15 KB ThreadUsage(500.000ms): 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1643810) - PerHostPeakMemUsage: 40.30 MB (42254172) - RowsProduced: 274 (274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s444ms - TotalStorageWaitTime: 2.151ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s567ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 201 (201) Fragment Instance Lifecycle Timings: - ExecTime: 1s514ms - ExecTreeExecTime: 8.804ms - OpenTime: 44.043ms - ExecTreeOpenTime: 39.485us - PrepareTime: 41.829ms - ExecTreePrepareTime: 162.009us DataStreamSender (dst_id=24):(Total: 170.872us, non-child: 170.872us, % non-child: 100.00%) - BytesSent: 426.81 KB (437052) - OverallThroughput: 2.38 GB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 274 (274) - SerializeBatchTime: 22.526us - UncompressedRowBatchSize: 426.81 KB (437052) CodeGen:(Total: 77.593ms, non-child: 77.593ms, % non-child: 100.00%) - CodegenTime: 982.348us - CompileTime: 10.860ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 38 (38) - NumInstructions: 550 (550) - OptimizationTime: 32.252ms - PeakMemoryUsage: 275.00 KB (281600) - PrepareTime: 33.806ms HDFS_SCAN_NODE (id=5):(Total: 9.210ms, non-child: 9.210ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 257.200us ; Min: 257.200us ; Max: 257.200us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 470.04 KB (481324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 470.04 KB (481324) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 470.04 KB (481324) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 128.953us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 810.13 KB (829576) - PerReadThreadRawHdfsThroughput: 379.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.437ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 274 (274) - RowsReturnedRate: 29.75 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.963ms - MaterializeTupleTime(*): 4.764ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 1.208ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F09:(Total: 4s071ms, non-child: 4s019ms, % non-child: 98.73%) split sizes: min: 149.35 KB, max: 149.35 KB, avg: 149.35 KB, stddev: 0 completion times: min:4s091ms max:4s091ms mean: 4s091ms stddev:0.000ns execution rates: min:36.50 KB/sec max:36.50 KB/sec mean:36.50 KB/sec stddev:0.98 B/sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 922.34 KB (944474) - PerHostPeakMemUsage: 341.86 MB (358462422) - RowsProduced: 1.70K (1704) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s439ms - TotalStorageWaitTime: 3.407ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 4s044ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 22.996ms - TotalThreadsVoluntaryContextSwitches: 211 (211) Fragment Instance Lifecycle Timings: - ExecTime: 4s022ms - ExecTreeExecTime: 4.744ms - OpenTime: 17.370ms - ExecTreeOpenTime: 114.370us - PrepareTime: 30.888ms - ExecTreePrepareTime: 144.494us DataStreamSender (dst_id=25):(Total: 442.300us, non-child: 442.300us, % non-child: 100.00%) - BytesSent: 2.97 MB (3113415) - OverallThroughput: 6.56 GB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 1.70K (1704) - SerializeBatchTime: 212.142us - UncompressedRowBatchSize: 2.97 MB (3113415) CodeGen:(Total: 45.945ms, non-child: 45.945ms, % non-child: 100.00%) - CodegenTime: 434.662us - CompileTime: 6.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 6 (6) - NumInstructions: 98 (98) - OptimizationTime: 9.572ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 29.003ms HDFS_SCAN_NODE (id=6):(Total: 5.170ms, non-child: 5.170ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 110.49 KB (113139) - BytesReadDataNodeCache: 0 - BytesReadLocal: 110.49 KB (113139) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 110.49 KB (113139) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 5.590us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.00 KB (131072) - PerReadThreadRawHdfsThroughput: 30.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4.230ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.70K (1704) - RowsReturned: 1.70K (1704) - RowsReturnedRate: 329.55 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.631ms - MaterializeTupleTime(*): 157.985us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 3.541ms - TotalReadThroughput: 73.66 KB/sec Fragment F09: Instance 5f429df048b5534b:41bcce1800000215 (host=foo.221.44:22000):(Total: 4s071ms, non-child: 4s019ms, % non-child: 98.73%) Hdfs split stats (:<# splits>/): 3:1/149.35 KB MemoryUsage(500.000ms): 843.34 KB, 843.34 KB, 843.34 KB, 794.34 KB, 794.34 KB, 794.34 KB, 794.34 KB, 794.34 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 922.34 KB (944474) - PerHostPeakMemUsage: 341.86 MB (358462422) - RowsProduced: 1.70K (1704) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s439ms - TotalStorageWaitTime: 3.407ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 4s044ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 22.996ms - TotalThreadsVoluntaryContextSwitches: 211 (211) Fragment Instance Lifecycle Timings: - ExecTime: 4s022ms - ExecTreeExecTime: 4.744ms - OpenTime: 17.370ms - ExecTreeOpenTime: 114.370us - PrepareTime: 30.888ms - ExecTreePrepareTime: 144.494us DataStreamSender (dst_id=25):(Total: 442.300us, non-child: 442.300us, % non-child: 100.00%) - BytesSent: 2.97 MB (3113415) - OverallThroughput: 6.56 GB/sec - PeakMemoryUsage: 786.09 KB (804960) - RowsReturned: 1.70K (1704) - SerializeBatchTime: 212.142us - UncompressedRowBatchSize: 2.97 MB (3113415) CodeGen:(Total: 45.945ms, non-child: 45.945ms, % non-child: 100.00%) - CodegenTime: 434.662us - CompileTime: 6.510ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2063424) - NumFunctions: 6 (6) - NumInstructions: 98 (98) - OptimizationTime: 9.572ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 29.003ms HDFS_SCAN_NODE (id=6):(Total: 5.170ms, non-child: 5.170ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/149.35 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 110.49 KB, 110.49 KB, 110.49 KB - FooterProcessingTime: (Avg: 2.818ms ; Min: 2.818ms ; Max: 2.818ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 110.49 KB (113139) - BytesReadDataNodeCache: 0 - BytesReadLocal: 110.49 KB (113139) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 110.49 KB (113139) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - DecompressionTime: 5.590us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.00 KB (131072) - PerReadThreadRawHdfsThroughput: 30.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4.230ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.70K (1704) - RowsReturned: 1.70K (1704) - RowsReturnedRate: 329.55 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.631ms - MaterializeTupleTime(*): 157.985us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 3.541ms - TotalReadThroughput: 73.66 KB/sec